Skip to main content
Wellcome Open Research logoLink to Wellcome Open Research
. 2020 Nov 20;5:168. Originally published 2020 Jul 16. [Version 2] doi: 10.12688/wellcomeopenres.16058.2

Tracking Excess Deaths (TRACKED) – an interactive online tool to monitor excess deaths associated with the COVID-19 pandemic in the United Kingdom

Michael T C Poon 1,2, Paul M Brennan 2,3, Kai Jin 1,2, Jonine D Figueroa 1,2, Cathie L M Sudlow 1,2,3,4,a
PMCID: PMC11411238  PMID: 39301141

Version Changes

Revised. Amendments from Version 1

The revised version of the manuscript contains several changes to the text in response to reviewers’ comments. First, we added further information on building this web application using the “Shiny” package in R (first paragraph under “Data processing and statistical packages”). Second, we expanded on the potential implication of a broad COVID-related death definition in relation to the observed reduction in deaths due to respiratory diseases (third paragraph under “Discussion”). Lastly, we related our web application to other online resources and made distinction of the information provided in our interactive tool (first paragraph under “Strengths and limitations”).

Abstract

Background: We aimed to describe trends of excess mortality in the United Kingdom (UK) stratified by nation and cause of death, and to develop an online tool for reporting the most up to date data on excess mortality

Methods: Population statistics agencies in the UK including the Office for National Statistics (ONS), National Records of Scotland (NRS), and Northern Ireland Statistics and Research Agency (NISRA) publish weekly mortality data. We used mortality data up to 22 nd May in the ONS and the NISRA and 24 th May in the NRS. The main outcome measures were crude mortality for non-COVID deaths (where there is no mention of COVID-19 on the death certificate) calculated, and excess mortality defined as difference between observed mortality and expected average of mortality from previous 5 years.

Results: There were 56,961 excess deaths, of which 8,986 were non-COVID excess deaths. England had the highest number of excess deaths per 100,000 population (85) and Northern Ireland the lowest (34). Non-COVID mortality increased from 23 rd March and returned to the 5-year average on 10 th May. In Scotland, where underlying cause mortality data besides COVID-related deaths was available, the percentage excess over the 8-week period when COVID-related mortality peaked was: dementia 49%, other causes 21%, circulatory diseases 10%, and cancer 5%. We developed an online tool (TRACKing Excess Deaths - TRACKED) to allow dynamic exploration and visualisation of the latest mortality trends.

Conclusions: Continuous monitoring of excess mortality trends and further integration of age- and gender-stratified and underlying cause of death data beyond COVID-19 will allow dynamic assessment of the impacts of indirect and direct mortality of the COVID-19 pandemic.

Keywords: COVID-19, coronavirus, excess deaths, mortality, web application

Introduction

Suppression and mitigation strategies adopted by the UK government and public health agencies have been necessary for COVID-19 disease control. In the United Kingdom (UK), 47,975 people have died of COVID-19 in the latest data released in late May from UK death registries 13 . This number of deaths was already higher than the annual excess deaths associated with the seasonal influenza 4 . The impact of the mitigation strategies has extended beyond only patients with COVID-19. Patients with non-COVID-19 diagnoses may have been harmed as a result of indirect effects of COVID-19, including changes in health service provision, health behaviours, or socio-economic effects.

Excess mortality is the number of deaths above the expected average from previous years. Analysis of the total excess mortality provides a measure of both direct and indirect effects from COVID-19. In the UK, COVID-19 related deaths (where COVID-19 was mentioned on the death certificate, whether or not it was the primary underlying cause) are a measure of the direct impact of COVID-19 1, 2, 5 . Trends in non COVID-related deaths can demonstrate the possible indirect effects of COVID-19. Excess deaths due to changes in behaviour or access to health services may take longer to accrue depending on the natural history of different diseases. Tracking excess mortality and understanding its determinants will allow development of health policies and services that minimise indirect causes of excess deaths.

Population statistics agencies in the UK publish weekly overall and COVID-19 mortality data 13 . In Scotland, timely reporting of cause-specific mortality data allows trend assessment of excess deaths stratified by broad underlying cause 6 . As the UK begins to ease from full to partial suppression strategy, monitoring of excess deaths across the country will be a crucial component of understanding the impact of measures to control the pandemic. We aimed to describe trends in excess mortality in the UK, stratified by nation and cause of death, and to develop an online tool for reporting the most up to date data on excess mortality. The SARS-CoV-2 pandemic has had significant impact beyond the UK on global health and the approach we describe will be of value worldwide.

Methods

Data sources

The Office for National Statistics (ONS), National Records of Scotland (NRS), and Northern Ireland Statistics and Research Agency (NISRA) publish weekly mortality data on Tuesday, Wednesday, and Friday, respectively. The average total deaths of the corresponding week from the previous 5 years are provided and are considered as the expected number of deaths. ONS reports annual population sizes in each of the four nations in the UK. We use these publicly available data for our analyses.

Definitions

COVID-related deaths refer to deaths where COVID-19 was mentioned on the death certificate 13 . Non-COVID deaths are deaths without mention of COVID-19 on the death certificate. NRS provides cause-specific deaths categorised using the 10 th revision of the International Classification of Disease (ICD-10) codes. These include cancer (C00-C97), dementia/Alzheimer’s (F01, F03, and G30), circulatory diseases including heart disease and stroke (I00-I99), non-COVID respiratory diseases (J00-J99), and others. We define excess deaths as the difference from expected number of deaths.

Excess mortality quantifies the impact of pandemics on a population. This can be estimated by regression models taking mortality data and communicable disease activities into account 7, 8 . However, this approach is not possible for novel pathogens because monitoring of the infection activity changes as testing techniques and capacities improve. Here, we define excess deaths as the absolute difference between the observed number of deaths and the expected number of deaths.

ONS, NRS, and NISRA have different definitions of week number. The end date of the first week is: 3 rd Jan in ONS, 5 th Jan in NRS, and 10 th Jan in NISRA. The date of the first confirmed COVID-19 case was 31 st Jan 2020 in England, 27 th Feb 2020 in Northern Ireland, 28 th Feb 2020 in Wales, and 1 st March 2020 in Scotland. England, Scotland, and Wales adopted full suppression strategy “lockdown” on 26 th March 2020 and Northern Ireland followed on 28 th March 2020.

Data processing and statistical procedures

All code is available to view and download at https://github.com/michaelpoontc/tracked and is archived with Zenodo 9 . We built this web application using the “Shiny” package (v1.5.0) and we host the web application on a cloud server. The script automatically downloads and extracts the latest data from ONS, NRS, and NISRA (see Data Availability section). Data is organised into weekly overall deaths, COVID-related deaths, non-COVID deaths, and 5-year average deaths stratified by UK nation. For NRS, data on cause-specific deaths are also extracted.

We calculated the crude number of deaths per 100,000 persons and derived 95% confidence intervals (CI) using the normal approximation to the binomial distribution. To visualise trends, we also calculated 4-week rolling means and CIs. We performed all programming and statistical procedures in R (version 4.0.0). The R packages used include epitools (v0.5-10.1) for statistical analyses, and tidyr (v1.0.3), dplyr (v0.8.5), and ggplot2 (v3.3.0) for data manipulation and visualisation.

Results

These results are based on the latest data release up to 22 nd May 2020 in England, Wales, and Northern Ireland and 24 th May 2020 in Scotland. The total number of deaths was 323,057, of which 56,961 were excess deaths compared with the 5-year average. There were 47,975 COVID-related deaths, representing the majority (84%) of excess deaths, and 8,986 non-COVID excess deaths. The numbers of deaths per 100,000 population in each nation are presented in Table 1. England had the highest number of all, COVID-related, and non-COVID excess deaths (89, 74 and 15 per 100,000 respectively). Northern Ireland had the lowest number of excess deaths, all COVID-related (34 per 100,000). COVID-related deaths were also the sole contributor to excess deaths in Wales.

Table 1. Number of deaths per 100,000 stratified by nations of the United Kingdom from the start of 2020 to late-May ,

Number of deaths per 100,000 people *
Nations Total
N (95% CI)
Excess
N (95% CI)
COVID-related excess
N (95% CI)
Non-COVID excess
N (95% CI)
UK 484 (482-485) 85 (85-86) 72 (71-72) 13 (13-14)
England 480 (478-482) 89 (89-90) 74 (74-75) 15 (15-16)
Scotland 532 (526-538) 75 (73-78) 65 (63-68) 10 (9-11)
Wales 529 (521-537) 60 (57-63) 66 (63-69) -6 (-5 to -7)
Northern Ireland 380 (371-389) 34 (31-37) 37 (34-40) -3 (-2 to -4)

Data from the ONS for England and Wales covers 28 th Dec 2019 to 22 nd May 2020; data from NRS for Scotland covers 30 th Dec 2019 to 24 th May 2020; data from NISRA for Northern Ireland covers 3 rd Jan 2020 to 22 nd May 2020.

* Confidence intervals calculated using normal approximation to the binomial distribution. COVID-related deaths are deaths where COVID-19 was mentioned on the death certificate. Non-COVID deaths are deaths where there was no mention of COVID-19 on the death certificate.

Overall mortality trends

In all four nations, mortality was lower than the 5-year average from mid-January to the beginning of March ( Figure 1). Mortality rose sharply from the week beginning 23 rd March when all UK nations adopted full suppression strategy. Peak mortality occurred between 13 th April and 26 th April. The overall mortality trends were parallel to the COVID mortality trends.

Figure 1. Overall crude mortality trends in the UK from January 2020.

Figure 1.

Weekly mortality plotted on the last day of week as defined respectively by the ONS, NRS, and NISRA. Shading represents 95% confidence intervals calculated using normal approximation to binomial distribution. COVID-related deaths are deaths where COVID-19 was mentioned on the death certificate.

Non-COVID mortality trends

In England and Scotland, non-COVID mortality increased from 23 rd March and returned to the 5-year average on 10 th May, following the trends of COVID-related deaths ( Figure 2). In Wales and Northern Ireland, there was little apparent change in non-COVID mortality with overlapping 95% CI, which may be due to the lower number of deaths reported ( Figure 2).

Figure 2. Crude mortality trends of non-COVID and COVID-related deaths in the UK from January 2020.

Figure 2.

Weekly mortality plotted on the last day of week as defined respectively by the ONS, NRS, and NISRA. Shading represents 95% confidence intervals calculated using normal approximation to binomial distribution. COVID-related deaths are deaths where COVID-19 was mentioned on the death certificate. Expected non-COVID deaths are equivalent to total deaths expected derived from 5-year average.

Cause-specific mortality in Scotland

The latest data from Scotland includes up to 24 th May 2020. Overall, in 2020, there were 17% (N=4,129) excess deaths compared to expected, and 2% (N=553) excess non-COVID deaths. The number of excess deaths by cause is presented in Table 2. Deaths from dementia and other causes were 15% and 12% higher than the respective number of expected deaths. There were 3% excess deaths attributable to cancer. There was little overall mortality change to circulatory disease. There was a deficit of 20% in non-COVID respiratory deaths.

Table 2. Number of deaths in Scotland stratified by cause of death in different periods of time.

All available data
(30 Dec 2020 to 17 May 2020)
8-week period over the peak of mortality
(23 Mar 2020 to 17 May 2020)
Cause of death Total Expected Excess Excess as % of
expected
Total Expected Excess Excess as % of
expected
Cancer 6741 6577 164 2.5 (2.1 to 2.9) 2552 2425 127 5.2 (4.4 to 6.1)
Circulatory 6541 6557 -16 -0.2 (-0.1 to -0.4) 2516 2287 229 10.0 (8.8 to 11.2)
Dementia 3151 2735 416 15.2 (13.9 to 16.6) 1337 897 440 49.1 (45.8 to 52.3)
Respiratory 2769 3462 -693 -20.0 (-18.7 to -21.4) 901 1037 -136 -13.1 (-11.1 to -15.2)
Others 6297 5624 673 12.0 (11.1 to 12.8) 2430 2004 426 21.3 (19.5 to 23.0)

Cause-specific deaths categorised using ICD-10 codes. These include cancer (C00-C97), dementia/Alzheimer’s (F01, F03, and G30), circulatory diseases including heart disease and stroke (I00-I99), non-COVID respiratory diseases (J00-J99), and others.

Because the number of overall deaths was lower than the 5-year average in the period before COVID-related deaths increased in April, we also report excess deaths over the 8-week period when the excess mortality peaked. Between 23 rd March and 17 th May 2020, there were 48% (N=9,734) excess deaths, and 13% (N=1,087) excess non-COVID deaths. Dementia and other causes remained major contributors to the excess deaths ( Table 2). Deaths from cancer and circulatory diseases were 5% and 10% higher than expected, respectively. The deficit of deaths in respiratory diseases was -13%.

Changes in non-COVID cause-specific mortality compared with expected mostly occurred between the start of April and the start of May, returning to expected levels thereafter ( Figure 3).

Figure 3. Crude mortality trends in Scotland stratified by causes of death.

Figure 3.

Weekly mortality in Scotland plotted on the last day of week as defined by the NRS. Shading represents 95% confidence intervals calculated using normal approximation to binomial distribution. Cause-specific deaths categorised using ICD-10 codes. These include cancer (C00-C97), dementia/Alzheimer’s (F01, F03, and G30), circulatory diseases including heart disease and stroke (I00-I99), non-COVID respiratory diseases (J00-J99), and others.

Publicly available online resource

The mortality trends reported here are changing as the COVID-19 pandemic evolves and both population-wide suppression measures and health services change. Having a responsive and updated portal for visualising and understanding trends should inform policymakers and other stakeholders. We have developed an online tool – TRACKing Excess Deaths (TRACKED) to inform users of the latest mortality trends ( http://www.trackingexcessdeaths.com/) 6 . All the findings reported here can be found in the web application, which enables dynamic exploration and visualisation of the data.

Discussion

COVID-19 was directly responsible for most excess deaths observed in 2020. Using publicly available mortality data in the UK, we also demonstrated an increase in non-COVID excess deaths during the COVID-19 pandemic, which was more pronounced in England and Scotland than in Wales and Northern Ireland. There were excess deaths due to cancer, circulatory disease, dementia, and other causes but not respiratory diseases. Non-COVID deaths have now returned to the expected levels. Overall mortality was lower than expected in early 2020 prior to its steep increase at the beginning of April; interpretation of excess deaths should take this into account. Our online, interactive tool provides the latest trends and figures on excess deaths in all four nations of the UK.

There are several potential explanations for the observed excess of non-COVID deaths. First, demand for SARS-CoV-2 infection testing generally exceeded testing capacity before and during the peak of COVID-19 pandemic. Common symptoms of COVID-19 are also non-specific 10 . Hence, even though COVID-19-attributed deaths include suspected as well as confirmed COVID-19 cases, under-diagnosis of COVID-19 (and hence its recognition as a cause of death) is likely and its extent will vary. The observation that the rise and fall of non-COVID deaths closely mirrors that of COVID-related deaths suggests that misclassification of cause of death is likely to contribute to the trends observed.

Second, the definition of COVID-related deaths includes those when COVID-19 was mentioned on the death certificate, whether it was the primary cause, contributing cause, or suspected 2, 11 . This contrasts with the convention of using the underlying cause of death to categorise cause-specific deaths in population statistics. The definition of COVID-related deaths may mask trends in other causes of deaths, therefore underestimating the impact of COVID-19 on non COVID-related deaths and cause-specific deaths. This could explain the observed reduction in deaths due to respiratory diseases in Scotland because deaths normally attributed to respiratory diseases would be covered by the broad definition of COVID-related death.

Third, many health authorities and clinicians have raised concerns regarding the potential adverse effects of change in health behaviours of the public. Both Public Health England and Scotland have reported a marked reduction in emergency care attendances 1214 . Data from other parts of the world are consistent with the general health behaviours observed in the UK. For example, in the United States, revascularisation for ST-elevation myocardial infarction (STEMI) across nine centres reduced by 38% 15 , while time from symptom onset to first medical contact in a single centre in Hong Kong increased from 83 minutes before to 318 minutes during the COVID-19 pandemic 16 . It is likely that some patients in the UK have died during this pandemic as a result of not receiving time-sensitive life-saving medical intervention or as a result of delayed presentation to medical services. The return of non-COVID deaths to the expected levels may indicate a change in health behaviour following a public information campaign to persuade the public to seek urgent medical help when required 17 .

Fourth, some health services had to be suspended to increase capacity for treating people with COVID-19. This involved most non-urgent care, including screening programmes and non-urgent surgery for cancer and other conditions. These restrictions are unlikely to contribute to short-term mortality, which reflects changes in urgent care, but they may have significant impact on medium to long-term mortality, investigation of which will require longitudinal analysis.

As discussed, non-COVID mortality is likely to be under-reported because of the definition of COVID-related deaths. The WHO recommends classifying a death due to COVID-19 as “a death resulting from a clinically compatible illness, in a probable or confirmed COVID-19 case, unless there is a clear alternative cause of death that cannot be related to COVID disease” 18 . Reporting of deaths attributable to COVID-19 according to the WHO recommendation as well as other underlying causes will clarify trends of cause-specific excess deaths. More accurate and consistent recording of mortality data during the COVID-19 pandemic will require standardisation of death certification through specific advice for medical practitioners.

Limitations

Using publicly available routine mortality data, we were able to quantify non-COVID excess deaths as a part of the wider impact of the COVID-19 pandemic. Our online tool dynamically displays and visualises mortality data to the user’s specifications so that statistics in different periods in relation to the pandemic can be examined. TRACKED is distinct from existing online applications 19, 20 , and regularly updated information sites 21, 22 , because of its focus on non-COVID excess mortality, the availability of cause-specific mortality in Scotland, and interactive components to exploring the data.

There are, however, some limitations. First, variable delays in registration of deaths are likely to affect these data. For example, 17% and 27% of deaths were registered more than 7 days after date of death during 2018 in Wales and England, respectively 23 . Completeness increased to 92% by 1 month. The current data release lag of 2 weeks by the ONS allows better capture of deaths, though incompleteness is still likely to be about 10%. In Scotland, death registration is more timely (95% within 8 days) 24 because of legislation that requires it 25 . Whether the COVID-19 pandemic has affected registration delay is currently unknown. Hence, deaths are under-reported and the mortality data used in our analyses provisional, but registries will continue to update their data. Our online tool uses the latest data, incorporating revisions as well as the latest available mortality data.

Second, the current data release does not include age-standardisation or stratification for cause-specific deaths. Should these become available, we will enhance our online tool to provide further information on these. Third, the NRS may under-report mortality data because it does not include deaths occurring outside Scotland. However, the effect of this will be minimised by the full suppression lockdown strategy as most people stay at their usual residence. Fourth, the causes of deaths provided by the NRS are broad and do not allow the identification of high-risk groups most susceptible to the indirect impact of COVID-19. For example, COVID-19 is likely to have a larger impact on more advanced stage and grade cancers.

Future developments

As data availability increases, we plan to incorporate age- and gender-adjusted mortality data into our online tool to better monitor non-COVID mortality. Mortality trends stratified by age and gender will help identify those at highest risk. If location-based and cause-specific data become available, we will include these to examine geographical variations and changes in cause-specific mortality.

Conclusion

There is excess mortality directly and indirectly associated with COVID-19 in the UK. The number of non-COVID excess deaths peaked at the same time as COVID-related deaths but now appear to have returned to the expected levels. Deaths attributed to major non-COVID causes, including dementia, cancer, and circulatory diseases, increased over the peak of the pandemic. Continuous monitoring of these trends and further integration of information on age, gender, location, and cause of death into our online tool will enable increasingly detailed and dynamic assessment of the impact on mortality of the COVID-19 pandemic and associated health policies. The strategy that we have described and observations we have made will be relevant to other countries.

Data availability

Source data

The Office for National Statistics provides mortality data for England and Wales and the data can be accessed here ( https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/datasets/weeklyprovisionalfiguresondeathsregisteredinenglandandwales). Scottish data is provided by the National Records of Scotland ( https://www.nrscotland.gov.uk/covid19stats). Data in Northern Ireland is provided by the Northern Ireland Statistics and Research Agency ( https://www.nisra.gov.uk/publications/weekly-deaths).

Software availability

TRACKED is available at: http://www.trackingexcessdeaths.com/.

Source code available from: https://github.com/michaelpoontc/tracked.

Archvied source code at time of publication: https://doi.org/10.5281/zenodo.3904375 9 .

License: MIT License.

Funding Statement

This work was funded by Wellcome (grant 207800 to Dr Figueroa; grants 216767, 214571 to Prof Sudlow). Mr Poon is funded by Cancer Research UK Brain Tumour Centre of Excellence Award (C157/A27589). Prof Sudlow is also funded by the British Heart Foundation, HDR UK and the Scottish Funding Council.

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 2 approved, 2 approved with reservations]

References

  • 1. Office for National Statistics: Deaths registered weekly in England and Wales, provisional: week ending 8 May 2020.2020. Reference Source [Google Scholar]
  • 2. National Records of Scotland: Deaths involving coronavirus (COVID-19) in Scotland.2020. Reference Source [Google Scholar]
  • 3. Northern Ireland Statistics and Research Agency: Weekly death registrations in Northern Ireland, 2020.2020. Reference Source [Google Scholar]
  • 4. Public Health England: Surveillance of influenza and other respiratory viruses in the UK - Winter 2019 to 2020. 2020. Reference Source [Google Scholar]
  • 5. Northern Ireland Statistics and Research Agency: Coronavirus (COVID-19) Statistics.2020. Reference Source [Google Scholar]
  • 6. Figueroa J, Brennan P, Theodoratou E, et al. : Trends in excess cancer and cardiovascular deaths in Scotland during the COVID-19 pandemic 30 December 2019 to 20 April 2020. Epidemiology. 2020. 10.1101/2020.05.02.20086231 [DOI] [Google Scholar]
  • 7. Iuliano AD, Roguski KM, Chang HH, et al. : Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. Lancet. 2018;391(10127):1285–300. 10.1016/S0140-6736(17)33293-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Paget J, Spreeuwenberg P, Charu V, et al. : Global mortality associated with seasonal influenza epidemics: New burden estimates and predictors from the GLaMOR Project. J Glob Health. 2019;9(2):020421. 10.7189/jogh.09.020421 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. Poon M: michaelpoontc/tracked: tracked_v1.0 (Version v1.0). Zenodo. 2020. 10.5281/zenodo.3904375 [DOI] [Google Scholar]
  • 10. Docherty AB, Harrison EM, Green CA, et al. : Features of 20 133 UK patients in hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: prospective observational cohort study. BMJ. 2020;369:m1985. 10.1016/j.jacc.2020.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Office for National Statistics: Deaths involving COVID-19, England and Wales: deaths occurring in April 2020.2020. Reference Source [Google Scholar]
  • 12. Public Health England: Emergency department: weekly bulletins for 2020.2020. Reference Source [Google Scholar]
  • 13. Public Health Scotland: COVID-19 wider impacts on the health care system.2020. Reference Source [Google Scholar]
  • 14. NHS England: A&E Attendances and Emergency Admissions April 2020 Statistical Commentary.2020. Reference Source [Google Scholar]
  • 15. Garcia S, Albaghdadi MS, Meraj PM, et al. : Reduction in ST-Segment Elevation Cardiac Catheterization Laboratory Activations in the United States during COVID-19 Pandemic. J Am Coll Cardiol. 2020;75(22):2871–2872. 10.1016/j.jacc.2020.04.011 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Tam CCF, Cheung KS, Lam S, et al. : Impact of Coronavirus Disease 2019 (COVID-19) Outbreak on ST-Segment–Elevation Myocardial Infarction Care in Hong Kong, China. Circ Cardiovasc Qual Outcomes. 2020;13(4):e006631. 10.1161/CIRCOUTCOMES.120.006631 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. NHS England: Help us help you: NHS urges public to get care when they need it.2020. Reference Source [Google Scholar]
  • 18. World Health Organization: International guiodelines for certification and classification (coding) of COVID-19 as cause of death.2020. Reference Source [Google Scholar]
  • 19. EUROMOMO: Graphs and maps — EUROMOMO. Reference Source [Google Scholar]
  • 20. Public Health Scotland: COVID-19 Daily Dashboard. Reference Source [Google Scholar]
  • 21. Roser M, Ritchie H, Ortiz-Ospina E, et al. : Coronavirus Pandemic (COVID-19). Our World in Data.2020. Reference Source [Google Scholar]
  • 22. Stabe M, Klasa A, Wisniewska A, et al. : Coronavirus tracker: the latest figures as countries fight Covid-19 resurgence. 2020. Reference Source [Google Scholar]
  • 23. Office for National Statistics: Impact of registration delays on mortality statistics in England and Wales: 2018.2020. Reference Source [Google Scholar]
  • 24. National Records of Scotland: Births and Deaths: Days until Registration.2017. Reference Source [Google Scholar]
  • 25. UK Government: Registration of Births, Deaths and Marriages (Scotland) Act 1965.1965. Reference Source [Google Scholar]
Wellcome Open Res. 2024 Oct 8. doi: 10.21956/wellcomeopenres.18112.r95091

Reviewer response for version 2

Gashirai Mbizvo 1

Cathie and colleagues have undertaken a nice study helping to track excess mortality during a pandemic using multiple publically available sources, ascribing what proportion of the deaths are related to COVID itself and what proportion are not (or not at least directly). This will allow for planning of services to cater for wider morbidity and mortality outside of COVID. The methods are appropriate to the aims of the study. The tool will be helpful for other researchers to use. In particular, the data sources used can be quite a challenge to navigate and analyse, so it is nice to have a tool that pools the data and does that for one. 

I have only one minor comment - I wonder if they might wish to integrate the timing of the various national vaccine implementations so we can see if these had any visible potential associations with the trends seen in both COVID and non-COVID excess deaths. This may help with some of the potential explainability of trends seen. It would also be, for example, interesting to see if there is a decline in non-covid excess deaths in trend with vaccination as it would suggest vaccines have a wider impact on herd protection beyond direct primary COVID prevention.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Neurology (epilepsy), epidemiology, health data science

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2024 Sep 18. doi: 10.21956/wellcomeopenres.18112.r95088

Reviewer response for version 2

Chryso Pallari 1

As a general comment, the work described here is very interesting and the manuscript is well written. 

However, please consider some minor comments below:

1)In the abstract, please mention the year in which you are referring to, when you talk about 22nd of May and 24th of May.

2)In the Methods section, I believe is crucial to mention what regression models were built for the specific analysis. 

3)Introduction is very well written. However, I would like to read more on the already existing online tools, so the reader can get an idea about why this work is important.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Partly

Reviewer Expertise:

epidemiology, infectious diseases, COVID-19 pandemic, excess mortality

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2020 Nov 27. doi: 10.21956/wellcomeopenres.18112.r41538

Reviewer response for version 2

Akshaya Srikanth Bhagavathula 1

I appreciate the authors' revision and they provided satisfactory reply to my comments. In this regard, no further changes are required and I recommend for indexing.

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

NA

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Wellcome Open Res. 2020 Nov 27.
Michael Poon 1

Thank you for your prompt reply and we appreciate your feedback on our manuscript.

Wellcome Open Res. 2020 Aug 27. doi: 10.21956/wellcomeopenres.17614.r39786

Reviewer response for version 1

Nicola Luigi Bragazzi 1

The authors described trends of excess mortality in the UK stratified by nation and cause of death, and developed an online tool for reporting the most up to date data on excess mortality.

The article is outstanding, well-conducted and well-reported according to high scientific standards. I suggest the authors elaborate more on the concept of "excess mortality". The authors should also refer to other research and tools, such as the EuroMOMO initiative. The authors could quote and discuss the following papers: Paget et al. (2019 1 ) and Iuliano et al. (2018 2 ).

Is the work clearly and accurately presented and does it cite the current literature?

Partly

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Epidemiology, biostatistics, mathematical modeling

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

References

  • 1. : Global mortality associated with seasonal influenza epidemics: New burden estimates and predictors from the GLaMOR Project. J Glob Health .2019;9(2) : 10.7189/jogh.09.020421 020421 10.7189/jogh.09.020421 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. : Estimates of global seasonal influenza-associated respiratory mortality: a modelling study. The Lancet .2018;391(10127) : 10.1016/S0140-6736(17)33293-2 1285-1300 10.1016/S0140-6736(17)33293-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
Wellcome Open Res. 2020 Nov 16.
Michael Poon 1

Please see our point-by-point response to the reviewer's comments.

The authors described trends of excess mortality in the UK stratified by nation and cause of death, and developed an online tool for reporting the most up to date data on excess mortality.

The article is outstanding, well-conducted and well-reported according to high scientific standards.

Response: Thank you for the positive comments.

I suggest the authors elaborate more on the concept of “excess mortality”. The authors should also refer to other research and tools, such as the EuroMOMO initiative. The authors could quote and discuss the following papers: Paget et al. (20191) and Iuliano et al. (20182).

Response: We have clarified the discussion and added references to other data visualization tools and the distinctive features of our tools compared to others into the manuscript (under “Strengths and Limitations”, first paragraph). In particular, we have clarified that our intention was not to monitor Covid-19 deaths but rather other underlying causes and non-COVID deaths due to the pandemic. We have discussed the concept of excess mortality and further clarified our definition of excess mortality in our manuscript (under “Definitions”, second paragraph).

Wellcome Open Res. 2020 Jul 31. doi: 10.21956/wellcomeopenres.17614.r39789

Reviewer response for version 1

Akshaya Srikanth Bhagavathula 1

Thank you for providing this opportunity to review this interesting manuscript. Although the authors have done interesting work, there are some comments and suggestions that can help to improve the quality of work. 

  1. The title is misleading, according to their the authors need to explain the design, implementation, and working process of the TRACKED software, but it is not mentioned in the methods. 

  2. It is better to consider the extent of excessive death in two patterns. a) Past five years to before COVID and b) during the COVID period (from the first case of COVID-19 reported in the UK).

  3. I am sure there are other applications similar to what the authors mentioned in the world. Its better to list them and describe how the TRACKER software is different and validation of the data is done to quantify the results would be interesting. 

  4. It is interesting to discuss death due to respiratory disease are much lower than the expected rate and this is particularly lower in the COVID-19 period. Can the authors explain why this differences occurred?

Is the work clearly and accurately presented and does it cite the current literature?

Yes

If applicable, is the statistical analysis and its interpretation appropriate?

Yes

Are all the source data underlying the results available to ensure full reproducibility?

Yes

Is the study design appropriate and is the work technically sound?

Yes

Are the conclusions drawn adequately supported by the results?

Yes

Are sufficient details of methods and analysis provided to allow replication by others?

Yes

Reviewer Expertise:

Infectious diseases, Global Health, Chronic diseases, Public Health and Gastroenterology.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Wellcome Open Res. 2020 Nov 16.
Michael Poon 1

Please see our point-by-point response to the reviewer's comments. 

Thank you for providing this opportunity to review this interesting manuscript. Although the authors have done interesting work, there are some comments and suggestions that can help to improve the quality of work.

1. The title is misleading, according to their the authors need to explain the design, implementation, and working process of the TRACKED software, but it is not mentioned in the methods.

Response: We have added more details about the process of the online tool in the Methods section as requested by the reviewer. This interactive tool was constructed using R Shiny ( https://shiny.rstudio.com/ ) to build the web application in R. The R script automatically downloads and extracts the latest mortality data from Office of National Statistics, National Records of Scotland, and Northern Ireland Statistics and Research Agency, into an analysable format. Subsequent processes generated the graphs and figures displayed in the web application using the stated R packages. All associated codes are available in https://github.com/michaelpoontc/tracked . Our revised Methods section (under “Data processing and statistical procedures”, first paragraph) clarifies the implementation and processes of our interactive web application.

2. It is better to consider the extent of excessive death in two patterns. a) Past five years to before COVID and b) during the COVID period (from the first case of COVID-19 reported in the UK).

Response: Our original intent was to examine the indirect effects of initial lockdown mitigation measures on non-COVID excess deaths and not necessarily COVID directly. As the pandemic has stretched on for many months and is continuing to evolve, A strength of our online tool is that it allows the user to dynamically look at these trends at any time-period of interest (see tabs under “Nations), which will be useful even beyond the COVID pandemic. To illustrate the interactive component of our web application, you may select the time period within the England tab to display mortality data in England between 03 Jan 2020 and 31 Jan 2020 – before the first case of confirmed COVID-19 case. All numbers at the top are specific for this period. Comparing this to the period when excess mortality was highest during the first wave (between 27 March 2020 and 08 May 2020), these numbers are vastly different. Excess deaths data is dynamic during the pandemic and our interactive tool allows the user to examine the data depending on temporal time period or death outcome of interest. This manuscript aims to only summarize some of the tool’s capabilities and ability to help researchers to better understand mortality data during the COVID-19 pandemic.

3. I am sure there are other applications similar to what the authors mentioned in the world. Its better to list them and describe how the TRACKER software is different and validation of the data is done to quantify the results would be interesting.

Response: Yes indeed. Since our manuscript submission, there have been several online sources that display different aspects of COVID-related mortality ( https://ourworldindata.org/mortality-risk-covid?country=~GBR#case-fatality-rate-of-covid-19-compared-to-other-diseases , https://www.ft.com/content/a2901ce8-5eb7-4633-b89c-cbdf5b386938 , https://www.kingsfund.org.uk/publications/deaths-covid-19#impact-on-overall-mortality , https://www.euromomo.eu/graphs-and-maps/ , https://public.tableau.com/profile/phs.covid.19#!/vizhome/COVID-19DailyDashboard_15960160643010/Overview ). We have now referred to these in our manuscript (under “Strengths and Limitations”, first paragraph). However, our web application is distinct in several aspects. First, this is the only available tool to collate UK-wide data into one platform in which users can explore up-to-date data dynamically. This is important because the four devolved nations of the UK have different public health strategies for the COVID-19 pandemic. Our web application facilitates comparison and view across all four nations. Secondly, non-COVID-related deaths are not always presented in publicly available data or online tools. These non-COVID excess deaths may be attributed to indirect effects of the pandemic, such as public health policies, changes in hospital services, and other mitigation strategies. Lastly, we present cause-specific mortality in Scotland, which is not available in other existing online tools. While this is helpful to interpret the non-COVID-related deaths, we recognise that the numbers are small and comparison between nations is not possible. However, the data adds granularity to non-COVID-related deaths that is otherwise not available elsewhere. We have now added these into our manuscript (under “Strengths and Limitations”, first paragraph). On the point of validity, we use publicly available data published by national statistics agencies. If there were errors in these data that led to the agencies updating them accordingly, this online application will also display those latest, corrected data because of the background workings explained in the methods section (also see https://github.com/michaelpoontc/tracked for codes for further detail if required).

4.  It is interesting to discuss death due to respiratory disease are much lower than the expected rate and this is particularly lower in the COVID-19 period. Can the authors explain why this differences occurred?

Response: As these are observational data, we cannot know for sure why rates were low. However, there are some likely plausible hypotheses: 1) COVID-related death is a new distinct respiratory cause of death. At present, COVID-related deaths encompass all deaths mentioning COVID-19, which may or may not be the main or contributory cause of death. Many deaths that might otherwise normally be attributed as “respiratory” will be covered by this broad definition, which could explain the paradoxical reduction in respiratory deaths. 2) the UK government reported a relatively low influenza activity in the UK 2019-2020 (https://www.gov.uk/government/statistics/annual-flu-reports). Since seasonal influenza epidemics are an important cause for deaths due to respiratory diseases, this was likely to have attributed to the observation. We have commented on this in our discussion (under “Discussion”, third paragraph).

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Source data

    The Office for National Statistics provides mortality data for England and Wales and the data can be accessed here ( https://www.ons.gov.uk/peoplepopulationandcommunity/birthsdeathsandmarriages/deaths/datasets/weeklyprovisionalfiguresondeathsregisteredinenglandandwales). Scottish data is provided by the National Records of Scotland ( https://www.nrscotland.gov.uk/covid19stats). Data in Northern Ireland is provided by the Northern Ireland Statistics and Research Agency ( https://www.nisra.gov.uk/publications/weekly-deaths).


    Articles from Wellcome Open Research are provided here courtesy of The Wellcome Trust

    RESOURCES