Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Aug 25;16(8):e0256638. doi: 10.1371/journal.pone.0256638

Differential impact of the COVID-19 pandemic on laboratory reporting of norovirus and Campylobacter in England: A modelling approach

Nikola Ondrikova 1,2,3,*, Helen E Clough 1,3, Amy Douglas 4, Miren Iturriza-Gomara 5, Lesley Larkin 4, Roberto Vivancos 3,6,7, John P Harris 1,8, Nigel A Cunliffe 1,3
Editor: Shinya Tsuzuki9
PMCID: PMC8386829  PMID: 34432849

Abstract

Background

The COVID-19 pandemic has impacted surveillance activities for multiple pathogens. Since March 2020, there was a decline in the number of reports of norovirus and Campylobacter recorded by England’s national laboratory surveillance system. The aim is to estimate and compare the impact of the COVID-19 pandemic on norovirus and Campylobacter surveillance data in England.

Methods

We utilised two quasi-experimental approaches based on a generalised linear model for sequential count data. The first approach estimates overall impact and the second approach focuses on the impact of specific elements of the pandemic response (COVID-19 diagnostic testing and control measures). The following time series (27, 2015–43, 2020) were used: weekly laboratory-confirmed norovirus and Campylobacter reports, air temperature, conducted Sars-CoV-2 tests and Index of COVID-19 control measures stringency.

Results

The period of Sars-CoV-2 emergence and subsequent sustained transmission was associated with persistent reductions in norovirus laboratory reports (p = 0.001), whereas the reductions were more pronounced during pandemic emergence and later recovered for Campylobacter (p = 0.075). The total estimated reduction was 47% - 79% for norovirus (12–43, 2020). The total reduction varied by time for Campylobacter, e.g. 19% - 33% in April, 1% - 7% in August.

Conclusion

Laboratory reporting of norovirus was more adversely impacted than Campylobacter by the COVID-19 pandemic. This may be partially explained by a comparatively stronger effect of behavioural interventions on norovirus transmission and a relatively greater reduction in norovirus testing capacity. Our study underlines the differential impact a pandemic may have on surveillance of gastrointestinal infectious diseases.

Introduction

The impact of the COVID-19 pandemic has been felt at many levels beyond the direct consequences of illness and death from the Sars-CoV-2 virus. In England, laboratory reports of both norovirus and Campylobacter spp. are recorded via the national laboratory surveillance system (Second-Generation Surveillance System, SGSS); only Campylobacter is a notifiable causative agent under the Health Protection (notification) Regulations of 2010 [1]. In March 2020, a reduction was observed in the number of norovirus and Campylobacter laboratory reports to SGSS. The Emergency Department (ED) syndromic surveillance indicators reported by Public Health England also showed a decrease in ED attendances for all gastrointestinal illnesses during the same period [2].

This study focuses on norovirus and Campylobacter in England as these are the most common viral and bacterial causative agents of Infectious Intestinal Disease (IID), respectively [3]. Norovirus is responsible for the majority of gastroenteritis outbreaks in semi-enclosed settings such as hospitals [4] and care homes [5] in England, and the overall burden exceeds that of all other IID–causing pathogens [6]. The estimated annual economic cost of norovirus infections (£63 - £106 million) is higher than for Campylobacter (£33 - £75 million) [7]. Outbreaks of GI disease caused by Campylobacter infections are occasionally reported, and might be underestimated [8], but the majority of infections reported to national surveillance are defined as sporadic cases.

Campylobacteriosis is usually associated with consumption of undercooked food and cross-contamination during food preparation, particularly with handling chicken, but several other types of animal products have also been implicated in transmission [9]. Norovirus is predominantly associated with person-to-person transmission, although foodborne outbreaks due to contaminated food products (predominantly shellfish) or infected food handlers do occur [10]. Both pathogens display yearly seasonal effects; while norovirus activity is likely directly dependent on weather factors such as temperature [11], human Campylobacter infection depends on weather factors indirectly, through other mediating factors such as weather-related changes in human behaviour [12].

Previous studies have shown that the IID incidence derived through routine national surveillance underestimates the true disease burden [6]. Specifically, for every norovirus case detected by routine surveillance, another 288 cases (CI 239–346) are unreported in the community [6]. The corresponding figure is 1 in 9 (CI 6–14) for Campylobacter [6]. This study aims to assess the impact of the pandemic on the laboratory surveillance of norovirus and Campylobacter in England. We also explored the effect on surveillance of public health measures introduced during the pandemic; specifically, we investigated the relationship between laboratory reporting of norovirus and Campylobacter and (i) the number of Sars-CoV-2 tests conducted; and (ii) the stringency of infection prevention and control measures implemented at various points during the pandemic. To the best of our knowledge, this is the first study to compare, both quantitative and qualitative differences in the pandemic’s impact on the number of norovirus and Campylobacter reports. Additionally, the analysis provides insights into how to account for the pandemic in detection algorithms and predictive models used more broadly in public health.

Materials and methods

General approach and data utilised in the study

We utilised two quasi-experimental approaches to examine the reduction in laboratory reports of norovirus and Campylobacter in England that occurred since the emergence of Sars-Cov-2. The first approach aimed to estimate the overall decrease of laboratory reports and identify the type of the impact. The second approach examined the impact of the COVID-19 pandemic on laboratory reporting, utilising the stringency index to indicate the intensity of infection control and prevention measures and related changes in healthcare-seeking behaviour, and the number of Sars-Cov-2 tests conducted.

Weekly laboratory report totals for norovirus and Campylobacter between week 27, 2015 and week 43, 2020 were extracted from the national laboratory reporting surveillance system. Additionally, the Central England Temperature (CET) was used to indicate air temperature across England. The CET is a daily measure produced by the national meteorological service; we used weekly mean values to match the granularity of the laboratory reports.

Then, COVID-19 related data such as conducted Sars-CoV-2 tests and indicators of COVID-19 control measures stringency were considered. Specifically, data on testing for Sars-CoV-2 in England performed at diagnostic laboratories were used to indicate the pressure on testing services and the capacity to carry out regular activities. The Stringency Index is a measure to quantify the strictness of the government’s response on a given day. It is based on nine control measures such as school and restaurant closures, stay at home orders and restriction on gatherings. The exact calculation is described elsewhere [13]. Tests were analysed as weekly sums and stringency index data as weekly means. Individual, explanatory time series together with data summaries and exploratory analysis are available on GitHub.

Measurement of overall impact

The overall impact is estimated with simplified models which in one categorical indicator (δ) represents the impact of policy decisions and change in human behaviour on reporting of both pathogens. The first COVID-19 death in the United Kingdom was reported in week 11 of 2020, national lockdown was announced in week 12 and started in week 13; hence three starting points (weeks 11, 12 and 13) are compared. Since our goal was to maximise the number of data points for the model to learn from, the considered period ends on week 43 of 2020.

This approach allows us to test whether the model, including the indicator, is significantly better than the model without it (H0). Two types of impact were tested [14]; i) level shift representing a consistent impact (δ = 1), and ii) transient shift assuming exponential decay of the impact (0 < δ < 1). For example, level shift is the same on the first as well as the fifth or tenth week, while for transient shift, the highest impact is assumed at the beginning, but decreases exponentially with time, e.g. (δ = 0.85) in the second week but (δ = 0.52) in the fifth week (see Fig 1). The estimated coefficient of the indicator is then a relative change in the weekly laboratory reports of a given pathogen, considering the other variables and effects in the model such as air temperature, seasonality and autoregression. To verify the significance of impact estimates, temporal falsification was performed. Figures of the expected trajectory for both pathogens, i.e. the expected number of laboratory reports had the pandemic not taken place, were based on the respective H0 models.

Fig 1. Effect types considered in the comparison, W12-W43, 2020.

Fig 1

Measurement of specific trends

In order to identify specific trends, the COVID-19 pandemic was represented by using two variables: Sars-CoV-2 tests and stringency index. The residual impact was then captured by the impact indicator determined in the first (overall) model. Both of these variables were differenced to achieve stationarity. This was confirmed with the Ljung-Box test only for a shorter, 2-year period, and this period was therefore used in the sensitivity analysis. Specifically, a model was fitted to the shorter period and the point estimate was considered stable if it fell within the 95% confidence interval estimated from the longer period model.

It was assumed that the stringency of control measures would have a lagged effect, whereas testing would have impacted the diagnostic laboratories’ capacity on the given week.

Statistical analysis

All of the models were fitted with a GLM for count time series (TSGLM). The conditional distribution was chosen as negative binomial to account for over-dispersion, and the link function was logarithmic [15]. Furthermore, all the models consider autoregressive effects (number of reports in week t depends directly on the number of reports in week t-1), two seasonal waves, a linear trend, indicators for Christmas and Easter Holidays and air temperature lagged by one week. This was determined based on the epidemiology and surveillance of both pathogens. A summary of all the models is provided in Table 1.

Table 1. Summary of the models.

log(γt) = intercept + linear trend + autoregression + [seasonal waves] + [explanatory variables]
Overall Impact Specific Trends
Explanatory variables Description N C N C
Air temperature t-1 Central England Temperature from previous week
Easter Holidays Indicates weeks of Easter holidays
Christmas Holidays Indicates weeks of Christmas holidays
Pandemic Indicates weeks 11/12/13-43 of 2020, starting with the first death in the United Kingdom
Sars-CoV-2 testing Number of tests at general diagnostic laboratories in a week (weeks 15–43, 2020; otherwise 0)
Stringency index t-1 Indicates lagged stringency of control measures against Covid-19 (weeks 3–42, 2020; otherwise 0)

Models were assessed based on Akaike Information Criterion (AIC) and Logarithmic Score. Finally, all of the 95% level confidence intervals were obtained by parametric bootstrap. The analysis was performed using R [16] and the figures were produced with the R package ‘ggplot2’[17]. The method used in this study is implemented in the ‘tscount’ R package, and it is described in detail in Liboschik, Fokianos and Fried [18]. The function used to estimate and to test the significance of the overall impact is explained here [14]. The code to reproduce the analysis is available on GitHub.

Results

Overall impact

The reduction in norovirus laboratory reports was significantly associated with the period after the first death from COVID-19 in the UK (week 11, 2020). The norovirus model assuming lagged effect of the first COVID-19 death, i.e. level shift starting in week 12, was better in terms of AIC (W11 = 2425.0, W12 = 2414.0, W13 = 2416.0) and logarithmic score (W11 = 4.32, W12 = 4.30, W13 = 4.30). The results for the Campylobacter models were similar, with level shift starting in weeks 11 and 12 being slightly better; AIC (W11 = 3452.3, W12 = 3452.7, W13 = 3458.3), logarithmic score (W11 = 6.17, W12 = 6.17, W13 = 6.18). Models assuming transient shift (i.e. exponential decay) starting in week 12 also showed better fit. For simplicity, only models assuming the start of the pandemic in week 12 will be discussed further.

Both pathogens showed a decrease in expected laboratory reports, but these effects were qualitatively different (Table 2). The reduction in the number of norovirus reports was best described by level shift (~59%; CI 51% - 67%), i.e. the impact of the pandemic was consistent over time (p = 0.001). The decrease in Campylobacter reports was better described by transient shift (δ = .85). The estimated impact was ~46% (CI 38% - 55%) on week 12, ~39% (32% - 47%) on week 13 and so on; the mean weekly reduction across weeks 12 and 43 was ~9% (CI 8% - 11%). This decrease was statistically significant at the 10% but not the 5% level (p = 0.075). As illustrated by Fig 2, this is likely because the effect was too short to be detected with a higher level of significance. The impact on norovirus was more pronounced.

Table 2. Overall impact of the COVID-19 pandemic (W12-W43, 2020) on norovirus and Campylobacter: Comparison of effect types, data from 2015–2020.

Norovirus Campylobacter
Effect Type AIC LogS p Reduction (CI) % AIC LogS p Reduction (CI) %
Level Shift 2414.0 4.30 0.001 59 (51–67) 3452.7 6.17 0.192 12 (7–17)
(δ = 1)
Transient shift 2471.4 4.40 0.024 18 (15–21) 3417.9 6.10 0.071 12 (9–15)
(δ = .90)
Transient shift 2492.2 4.44 0.045 9 (6–11) 3417.5 6.10 0.075 9 (8–11)
(δ = .85)
Transient shift 2501.8 4.46 0.065 10 (7–11) 3419.8 6.11 0.084 7 (6–8)
(δ = .80)

Fig 2. Estimated (overall) impact of COVID-19 pandemic: Norovirus, Campylobacter, W12 –W43, 2020.

Fig 2

The figure displays the model’s prediction (Fitted) and the actual number of weekly reports (Actual). The section with the ribbon, i.e. confidence interval, highlights what was expected in the absence of a pandemic.

To verify these results, temporal falsification was performed. In particular, the period between weeks 12 and 43, 2019 was used to estimate and test the significance of a best-fitting effect type, i.e. level shift for norovirus, transient shift for Campylobacter model. This period was not significantly associated with changes in the number of laboratory reports of norovirus or Campylobacter.

Specific trends

The second modelling approach also demonstrated that norovirus was impacted relatively more during the early months of COVID-19 pandemic. Specifically, the relative effect of the stringency of the COVID-19 control measures was greater for norovirus laboratory reporting than for Campylobacter. In particular, changes in the stringency index were associated with a reduction of ~2% (CI 0% - 5%) on average (12–43, 2020) for norovirus and ~1% (CI 0% - 2%) for Campylobacter. Additionally, changes in testing capacity appear to have more negatively impacted norovirus reporting. As suggested by the model coefficient estimates (Table 3), norovirus laboratory reports decreased by ~2% (CI 0% - 10%) due to Sars-CoV-2 diagnostic testing on average every week while Campylobacter laboratory reports decreased by ~1% (CI 0% - 4%).

Table 3. Specific trends of the COVID-19 pandemic’s impact (W11-W43, 2020) on norovirus and Campylobacter: Modelling coefficients, data from 2015–2020.

Norovirus Campylobacter
Estimate CI(lower) CI(upper) Estimate CI(lower) CI(upper)
Intercept 2.226 1.887 2.683 2.564 2.192 3.11
Ar (1) 0.627 0.552 0.684 0.605 0.518 0.661
Sin (2) 0.015 -0.028 0.059 0.011 -0.01 0.031
Cos (2) -0.018 -0.058 0.021 0.021 0.002 0.043
Sin (4) 0.019 -0.02 0.063 -0.001 -0.02 0.021
Cos (4) 0.027 -0.014 0.067 -0.004 -0.023 0.018
Christmas -0.078 -0.266 0.1 -0.362 -0.455 -0.26
Easter 0.048 -0.101 0.196 -0.083 -0.165 -0.006
Linear trend -0.004 -0.019 0.026 0.005 -0.005 0.015
Air temperature (°C) -0.048 -0.059 -0.039 0.016 0.013 0.02
Sars-cov-2 tests -0.002 -0.008 0.004 -0.001 -0.003 0.001
Stringency -0.013 -0.031 -0.001 -0.006 -0.012 -0.001
Shift -0.792 -1.015 -0.627 -0.551 -0.745 -0.399
Overdispersion parameter 0.035 0.027 0.046 0.012 0.01 0.015

“AR(1)” is an autoregressive term of order 1; “Sin(2)” and “Cos(2)” sinusoidal components to represent annual peaks; “Sin(4)” and “Cos(4)” similarly represent bi-annual peaks; “Christmas” and “Easter” are binary variables reflecting each period respectively; “Sars-cov-2” tests is the number of Sars-cov-2 tests conducted; Stringency stands for stringency index as defined in [13]; and “shift” is a level shift for norovirus, transient shift fo Campylobacter as determined by the Overall Impact model.

Comparison: Overall impact, specific trends

The models, including specific trends, i.e. number of Sars-CoV-2 tests conducted and stringency index, on top of the shift variable, performed better in terms of the logarithmic score for weekly reports of norovirus (overall impact = 4.30, specific trends = 4.28) and Campylobacter (overall impact = 6.10, specific trends = 6.08). Similarly, in terms of AIC—2414.0 vs. 2412.0 for norovirus; 3417.5 vs. 3411.3 for Campylobacter.

A simpler (overall) model might have underestimated the impact as the total decrease in norovirus reports determined by the second (specific trends) model has wider confidence intervals ~59% (CI 47% - 79%). On the other hand, the point estimates of both the Overall Impact and Specific Trends models were ~59%. Similarly, the total mean reduction of Campylobacter reports estimated by the Specific Trends model was between ~11% (CI 8% - 17%), which is higher than the simpler Overall Impact model ~9% (8% - 11%). Note that the impact estimate from the Specific Trends models is a sum of all the pandemic related estimates, i.e. conducted Sars-CoV-2 tests, stringency index and the shift determined by the overall impact model.

As both models including the specific trends showed better (i.e. lower) logarithmic score and AIC, these estimates will be discussed in the Discussion. The total estimated reduction was 47% - 79% for norovirus (12–43, 2020). The total reduction has changed in time for Campylobacter, e.g. 19% - 33% in April, 1% - 7% in August.

Discussion

Our findings demonstrate that the reduction in laboratory reports of norovirus was significantly associated with changes in infection control policies and Sars-CoV-2 virus testing approaches consequent upon the emergence of the COVID-19 pandemic. The impact of the pandemic was more pronounced for weekly laboratory reporting of norovirus than laboratory reporting of Campylobacter. These impacts were qualitatively different; while Campylobacter reports noticeably decreased within the first weeks of the pandemic and later recovered (e.g. 19% - 33% in April, 1% - 7% in August), norovirus reports also decreased but then remained low (47% - 79%). Additionally, we found a stronger association of norovirus reports with changes in the stringency of COVID-19 control measures and the number of Sars-CoV-2 tests conducted, compared with Campylobacter.

The differential reduction in the reporting of norovirus and Campylobacter is likely explained by several reasons. Firstly, laboratory testing for norovirus was likely more impacted during the pandemic than was Campylobacter. The Royal College of Pathologists issued guidance [19] on halting the testing of non-bloody diarrhoea specimens, with which norovirus is typically associated. Additionally, the capacity to obtain samples for laboratory confirmation during IID-related outbreaks which are more commonly associated with norovirus [20], could potentially have been compromised by the pandemic. Overall, diagnostic laboratories likely prioritised Sars-CoV-2 testing over routine testing; of note, with increasing Sars-CoV-2 tests, norovirus laboratory reports decreased more compared with Campylobacter. A reduction in testing for norovirus and Campylobacter as well as other gastrointestinal pathogens was also reported in the USA [21].

Secondly, behavioural changes are likely to have impacted norovirus transmission more than Campylobacter. Norovirus infections are mostly transmitted person-to-person [22], and cause outbreaks in health and social care settings, with the greatest burden in care homes [5, 23], similar to the new coronavirus [24, 25]. On the other hand, risk factors for Campylobacter infection are mostly associated with foodborne transmission routes and poor food hygiene and handling, particularly with the consumption of under-cooked chicken [9, 26]. Considering these similarities between norovirus and Sars-CoV-2, there is likely to have been a true reduction in the incidence of norovirus resulting from infection control measures introduced for COVID-19 such as greater handwashing, social distancing and enhanced hygiene in care homes and other community and health care setttings. Regarding Campylobacter, restaurant closures due to the pandemic could have potentially reduced the transmission of infection, although food delivery was still available; an increase in preparation of food in the home, with the risk of inappropriate hygiene and under-cooking, could have had a more pronounced effect on increasing the risk of campylobacteriosis [26].

A further consideration is change in healthcare-seeking behaviour during the pandemic. Although laboratory reports of both pathogens decreased when the control measures against COVID-19 were more restrictive, this pattern was stronger for norovirus. A possible explanation is that norovirus and Campylobacter differ in clinical severity and duration of illness. Norovirus generally causes mild symptoms lasting 1–2 days [27]. Campylobacteriosis typically lasts longer (1–5 days) and is associated with symptoms such as severe abdominal pain and bloody diarrhoea [28], meaning that patients with Campylobacter infection may be relatively more likely to contact healthcare services and to have a sample taken for laboratory diagnosis during the period in which pathogen confirmation was possible.

Strengths and limitations

This study investigated the impact of the COVID-19 pandemic on the routine laboratory reporting of norovirus and Campylobacter using a quasi-experimental modelling approach; consideration of seasonality, autoregression and other factors helped to quantify the level of uncertainty. We were able to estimate the magnitude and direction of overall and specific impacts in terms of testing capacity and of behavioural changes via stringency of COVID-19 control measures, and were able to demonstrate that the impact of the pandemic differed qualitatively between norovirus and Campylobacter. We also showed that simply including a categorical indicator to capture the effect of the pandemic in existing models and algorithms might underestimate the impact and that additional variables such as the stringency index can be helpful.

This study has some limitations. Firstly, the analysis was performed on aggregated national data, and regional differences were not investigated. However, reliable estimation of regional level impact would be challenging, especially for norovirus due to the low numbers of laboratory reports in some regions and increasing uncertainty around the estimate. Modelling both pathogens brings many challenges; for example, specific risk factors and seasonality for Campylobacter can vary with age and different Campylobacter spp. [29], while for norovirus, season, age and certain annual events, such as the return to school after the summer break are considered to impact substantially on norovirus reporting. Norovirus is also more affected by underreporting and underascertainment [6], bringing additional uncertainty. Considering all of these challenges, our estimates might be conservative. Furthermore, we could not account for all the trends which might have affected the model estimates. For example, the increasing number of Sars-CoV-2 tests performed at the diagnostic laboratories at the period of time when there was lower testing capacity than later in the year coincides with the end of the norovirus season. Also, variables used in our analysis, such as stringency index, are proxies for what we hoped to estimate. In particular, we could not estimate the proportion of the impact attributed to specific factors such as a genuine reduction in transmission, changes in healthcare-seeking behaviour, etc.

Conclusion

The number of reports of norovirus and Campylobacter fell significantly with the emergence of Sars-CoV-2. However, while laboratory reports of Campylobacter recovered, reports of norovirus remained low. The reasons are likely multifactorial, including differences in the transmission routes of these two pathogens. Since the predominant transmission route for norovirus is person to person, measures such as enhanced hand hygiene and enhanced infection prevention and control measures in social and healthcare settings, if maintained at a population level, could result in a sustained reduction in norovirus cases. Our study underlines the differential impact a pandemic may have on surveillance of gastrointestinal infectious diseases and so highlights that society’s best efforts to control the pandemic infectious agent can have impacts above and beyond those that might be most immediately expected. This adds to the need for pandemic preparedness to include consideration of the maintenance of priority routine surveillance systems and the resource to analyse surveillance data during the pandemic period. The direct as well as indirect effects of the pandemic could, through impairing essential surveillance functions, impede the ability to detect ongoing threats to national or international public health [30].

Acknowledgments

Helen E. Clough, Roberto Vivancos, Nigel A. Cunliffe and Nikola Ondrikova are affiliated to the National Institute for Health Research (NIHR) Health Protection Research Unit in Gastrointestinal Infections at University of Liverpool, in partnership with Public Health England, in collaboration with University of Warwick. The views expressed are those of the author(s) and not necessarily those of the NIHR, the Department of Health and Social Care or Public Health England.

We are very grateful to the editor and two reviewers (anonymous, Christian Bottomley) for their comments and suggestions.

Data Availability

Non-sensitive data underlying the results and code to reproduce the analysis presented in the study are available at https://doi.org/10.5281/zenodo.5035653. Raw norovirus and Campylobacter data were replaced with synthetic (model-generated) data. Routine surveillance data cannot be shared publicly because the provision of the data is dependent on the intended use. Raw norovirus and Campylobacter data are available from Public Health England (EEDD@phe.gov.uk).

Funding Statement

NO is funded by EPSRC and ESRC Centre for Doctoral Training in Quantification and Management of Risk & Uncertainty in Complex Systems & Environments - Grant No. (EP/L015927/1).Funding website: https://gow.epsrc.ukri.org/NGBOViewGrant.aspx?GrantRef=EP/L015927/1 The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.HEALTH PROTECTION (NOTIFICATION) REGULATIONS 2010. https://www.legislation.gov.uk/uksi/2010/659/made
  • 2.Public Health England. Emergency department: weekly bulletins for 2020. 2020. https://www.gov.uk/government/publications/emergency-department-weekly-bulletins-for-2020
  • 3.Tam CC, O’Brien SJ, Tompkins DS, et al. Changes in causes of acute gastroenteritis in the United Kingdom over 15 years: Microbiologic findings from 2 prospective, population-based studies of infectious intestinal disease. Clin. Infect. Dis. 2012. doi: 10.1093/cid/cis028 [DOI] [PubMed] [Google Scholar]
  • 4.Sandmann FG, Shallcross L, Adams N, et al. Estimating the Hospital Burden of Norovirus-Associated Gastroenteritis in England and Its Opportunity Costs for Nonadmitted Patients. Clin Infect Dis Published Online First: 2018. doi: 10.1093/cid/ciy167 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Inns T, Wilson D, Manley P, et al. What proportion of care home outbreaks are caused by norovirus? An analysis of viral causes of gastroenteritis outbreaks in care homes, North East England, 2016–2018. BMC Infect Dis 2019;20:1–8. doi: 10.1186/s12879-019-4717-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Tam CC, Rodrigues LC, Viviani L, et al. Longitudinal study of infectious intestinal disease in the UK (IID2 study): incidence in the community and presenting to general practice. Gut 2012;61:69–77. doi: 10.1136/gut.2011.238386 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Tam CC, O’Brien SJ. Economic Cost of Campylobacter, Norovirus and Rotavirus Disease in the United Kingdom. PLoS One 2016;11:e0138526. doi: 10.1371/journal.pone.0138526 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Gillespie IA, O’Brien SJ, Adak GK, et al. Point source outbreaks of Campylobacter jejuni infection—Are they more common than we think and what might cause them? Epidemiol Infect Published Online First: 2003. doi: 10.1017/s0950268803008409 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Adak GK, Meakins SM, Yip H, et al. Disease risks from foods, England and Wales, 1996–2000. Emerg Infect Dis Published Online First: 2005. doi: 10.3201/eid1103.040191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Hardstaff JL, Clough HE, Lutje V, et al. Foodborne and Food-Handler Norovirus Outbreaks: A Systematic Review. Foodborne Pathog. Dis. 2018. doi: 10.1089/fpd.2018.2452 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Lopman B, Armstrong B, Atchison C, et al. Host, weather and virological factors drive norovirus epidemiology: Time-series analysis of laboratory surveillance data in England and Wales. PLoS One Published Online First: 2009. doi: 10.1371/journal.pone.0006671 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Rushton SP, Sanderson RA, Diggle PJ, et al. Climate, human behaviour or environment: Individual-based modelling of Campylobacter seasonality and strategies to reduce disease burden. J Transl Med 2019;17:34. doi: 10.1186/s12967-019-1781-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Hale T, Petherick A, Phillips T, et al. Oxford COVID-19 Government Response Tracker, Blavatnik School of Government. Work Pap 2020.
  • 14.Liboschik T, Kerschke P, Fokianos K, et al. Modelling interventions in INGARCH processes. Int J Comput Math 2016;93:640–57. doi: 10.1080/00207160.2014.949250 [DOI] [Google Scholar]
  • 15.Hudson P, Rizzoli A, Grenfell B, et al. The Ecology of Wildlife Diseases. 2002. [Google Scholar]
  • 16.R Core Team. R: A Language and Environment for Statistical Computing. Vienna, Austria: R Found. Stat. Comput. 2020. [Google Scholar]
  • 17.Wickham H. ggplot2: Elegant Graphics for Data Analysis. Springer-Verlag; New York: 2009. http://ggplot2.org [Google Scholar]
  • 18.Liboschik T, Fokianos K, Fried R. tscount: An R package for analysis of count time series following generalized linear models. J Stat Softw 2017;82:1–51. [Google Scholar]
  • 19.RCPath and Professional Bodies (IBMS A and A. Prioritisation/deferral of Pathology Laboratory Work (in light of SARS-CoV-2 (COVID19) epidemic). 2020. moz-extension://41dca055-44fc-3245-bea7-16c166ccbca6/enhanced-reader.html?openApp&pdf=https%3A%2F%2Fwww.rcpath.org%2Fuploads%2Fassets%2Ff5123842-950f-49c5-bf69ed866a7ca3da%2FPrioritisation-deferral-of-pathology-laboratory-work.pdf
  • 20.Public Health England. National norovirus and rotavirus bulletin: management information. 2020. https://www.gov.uk/government/statistical-data-sets/national-norovirus-and-rotavirus-bulletin-management-information
  • 21.Laszkowska M, Kim J, Faye AS, et al. Prevalence of Clostridioides difficile and Other Gastrointestinal Pathogens in Patients with COVID-19. Dig Dis Sci Published Online First: 2021. doi: 10.1007/s10620-020-06760-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.De Graaf M, Van Beek J, Koopmans MPG. Human norovirus transmission and evolution in a changing world. Nat. Rev. Microbiol. 2016. doi: 10.1038/nrmicro.2016.48 [DOI] [PubMed] [Google Scholar]
  • 23.Lindsay L, Wolter J, De Coster I, et al. A decade of norovirus disease risk among older adults in upper-middle and high income countries: A systematic review. BMC Infect Dis 2015;15. doi: 10.1186/s12879-015-1168-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Wang L, Didelot X, Yang J, et al. Inference of person-to-person transmission of COVID-19 reveals hidden super-spreading events during the early outbreak phase. Nat Commun Published Online First: 2020. doi: 10.1038/s41467-020-18836-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Li P, Chen L, Liu Z, et al. Clinical features and short-term outcomes of elderly patients with COVID-19. Int J Infect Dis Published Online First: 2020. doi: 10.1016/j.ijid.2020.05.107 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Domingues AR, Pires SM, Halasa T, et al. Source attribution of human campylobacteriosis using a meta-analysis of case-control studies of sporadic infections. Epidemiol. Infect. 2012. doi: 10.1017/S0950268811002676 [DOI] [PubMed] [Google Scholar]
  • 27.Harris JP. Norovirus Surveillance: An Epidemiological Perspective. J Infect Dis 2016;213:S8–11. doi: 10.1093/infdis/jiv452 [DOI] [PubMed] [Google Scholar]
  • 28.Crushell E, Harty S, Sharif F, et al. Enteric Campylobacter: Purging Its Secrets? Pediatr. Res. 2004;55:3–12. doi: 10.1203/01.PDR.0000099794.06260.71 [DOI] [PubMed] [Google Scholar]
  • 29.Doorduyn Y, Van Den Brandhof WE, Van Duynhoven YTHP, et al. Risk factors for indigenous Campylobacter jejuni and Campylobacter coli infections in the Netherlands: A case-control study. Epidemiol Infect Published Online First: 2010. doi: 10.1017/S095026881000052X [DOI] [PubMed] [Google Scholar]
  • 30.World Health Organization. Checklist and Indicators for Monitoring Progress in the Development of IHR Core Capacities in State Parties. 2011.

Decision Letter 0

Shinya Tsuzuki

25 May 2021

PONE-D-21-11454

Differential Impact of the COVID-19 Pandemic on Laboratory Reporting of Norovirus and Campylobacter in England: Modelling Approach

PLOS ONE

Dear Dr. Ondrikova,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by 25th June 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Shinya Tsuzuki, MD, MSc

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially identifying or sensitive patient information) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. Please see http://www.bmj.com/content/340/bmj.c181.long for guidelines on how to de-identify and prepare clinical data for publication. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3.We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

Additional Editor Comments:

One of the reviewers raised some concerns about modelling and I agree with his opinion. Please address the comments from both reviewers before further consideration.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The study “Differential Impact of the COVID-19 Pandemic on Laboratory Reporting of Norovirus and Campylobacter in England: Modelling Approach” is interesting. The data and methodology parts are well described. I would recommend the authors add some more explanations and also describe the contribution of this work in the introduction section. Moreover, attention should be given to the following highlighted points before resubmitting.

1. Page 10 of 21, “The conditional distribution was chosen as negative binomial to account for over-dispersion, and the link function was logarithmic.” How the conditional distribution is selected any reference or source please provide details.

2. Page 13 of 21, “In particular, changes in the stringency index were associated with a reduction of ~7% (CI 2% - 6%)” check these confidence limits.

3. Table 3, the values of Sars-cov-2 tests is not correct for norovirus.

4. Construct a table that lists the character shorthand.

5. From Figure 1 it seems that the Actual data is following downward trend while the predicted data trend is upward. Is this a real picture of the data or correct modelling?

Reviewer #2: The authors present interesting surveillance data on the impact of lockdown restrictions on laboratory reports of norovirus and Campylobacter. The paper is very well written and broadly speaking the modelling approach seems reasonable. My main difficulty with the paper was that I found the results of the modelling hard to interpret in light of the data presented in Figure 2.

In the figure, norovirus cases reduce from ~200 per week pre-COVID to <20 cases per week post COVID, which is a >90% reduction. Why are the estimates presented in Table 2 significantly lower, even for delta=1?

Similarly, for Campylobacter the decrease is from ~1,000 to 250 which corresponds to a 75% reduction. But again the estimates are lower.

I agree with the authors assessment that delta=1 for norovirus and approximately 0.85 for Campylobacter but they do not provide any justification for the later value. You could argue, for example, that the reduction in Campylobacter halves over 4 weeks and 0.85^4=0.52.

It is a bit of shame that delta is not estimated from the data. Fitting a transfer function model would be one way to do this - see for example chapter 13 of “Time Series Analysis” by Box, Jenkins , Reinsel and Ljung (a pdf version of the book is available for free online)

In summary, I suspect the modelling needs to be revisited or better explained. If this can be addressed, then I think this will be an excellent paper.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Christian Bottomley

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Aug 25;16(8):e0256638. doi: 10.1371/journal.pone.0256638.r002

Author response to Decision Letter 0


9 Jul 2021

We appreciate the time and effort that the reviewers have dedicated to providing their valuable feedback. We have been able to incorporate changes to the analysis and the manuscript to reflect the comments provided.

Point-by-point response to the reviewers’ comments and concerns.

Comments from Reviewer 1

• Comment 1: I would recommend the authors add some more explanations and also describe the contribution of this work in the introduction section

Response: Even though, the contribution of the study is described in the discussion, I agree that it is good to mention it more in the introduction too. The highlighted text was added to the introduction.

Changes in the manuscript (Introduction, lines 123-127):

… To the best of our knowledge, this is the first study to compare, both quantitative and qualitative differences in the pandemic’s impact on the number of norovirus and Campylobacter reports. Additionally, the analysis provides insights into how to account for the pandemic in detection algorithms and predictive models used more broadly in public health.

• Comment 2 (Page 10 of 21): “The conditional distribution was chosen as negative binomial to account for over-dispersion, and the link function was logarithmic.” How the conditional distribution is selected any reference or source please provide details.

Response: A negative binomial model is a standard approach to dealing with over-dispersion: for background context and to guide the reader we have inserted reference 15 was added (Materials and methods, line 193).

• Comment 3 (Page 13 of 21): “In particular, changes in the stringency index were associated with a reduction of ~7% (CI 2% - 6%)” check these confidence limits.

Response: Thank you for pointing this out – yes, this was indeed a typo. These values have further changed since the second model was updated in response to Referee 2 (Results, lines 249-254).

• Comment 4 (Table 3): The values of Sars-cov-2 tests is not correct for norovirus.

Response: The model was updated so this table has now changed.

• Comment 5 (Table 3): Construct a table that lists the character shorthand.

Response: We have modified the caption to Table 3 to reflect the shorthand, since this seems to be the most parsimonious way to represent this information.

• Comment 6 (Figure 1): From Figure 1 it seems that the Actual data is following downward trend while the predicted data trend is upward. Is this a real picture of the data or correct modelling?

Response: The Figure 1 (now Fig. 2) shows what would have happened had there been no pandemic. While norovirus in England tends to have winter seasonality and is expected to decrease in spring, Campylobacter reports tend to increase in spring. However, due to the pandemic, this was disrupted and so it is expected that the prediction (what would have happened) and the actual data (what happened) will look different.

Changes in the manuscript (Results section, line 228):

As illustrated by Fig 2, this is likely because the effect was too short to be detected with higher level of significance.

Notes under Fig 2 (lines 239-242): The figure displays the model’s prediction (Fitted) and the actual number of weekly reports (Actual). The section with the ribbon, i.e. confidence interval, highlights what was expected in the absence of a pandemic.

Comments from Reviewer 2

• Comment 1 (Figure 2): In the figure, norovirus cases reduce from ~200 per week pre-COVID to <20 cases per week post COVID, which is a >90% reduction. Why are the estimates presented in Table 2 significantly lower, even for delta=1?

Response: We agree this needs clarification. The pandemic arrived in the UK at the time of the year when norovirus usually decreases. Since our modelling accounts for the seasonality, some decrease is expected and shouldn’t necessarily be attributed to the pandemic. Similarly, this applies to the increasing air temperature (weaker for Campylobacter) and effect of easter holidays (dip in reporting). Also, the model considers the autoregressive nature of the weekly reporting. Therefore, the observed difference between the lines does not equal the estimated impact of the pandemic. On top of that, the actual difference between the Actual and Fitted lines in the pandemic period is ~86% and since the model’s Mean Absolute Error (MAE) on non-pandemic period is ~20 reports the estimates we provide make sense. Even the model assuming the start of the pandemic on week 13 showed point estimate of 62% (CI 53% - 70%); confirming the stability of the estimate.

Changes to the manuscript (Results, lines 265 - 280):

To make the models easier to interpret and compare, an impact variable was added to the second model to capture residual effects of the pandemic unexplained by the proxies, i.e. number of Sars-CoV-2 tests conducted and stringency index. The section comparing the models now discusses total effect estimated by both models. This new addition widened the estimates, and these were updated in the abstract and the discussion. However, these still might be conservative and so this has been added to the limitations.

(Discussion, line 350)

Modelling both pathogens brings many challenges; … Considering all of these challenges, our estimates might be conservative.

• Comment 2: Similarly, for Campylobacter the decrease is from ~1,000 to 250 which corresponds to a 75% reduction. But again, the estimates are lower.

Response: Similarly, to the response above, there is a lot of uncertainty, e.g. seasonality can differ by region (see Louis et al., 2005). In our paper, the estimate is provided as a mean value over the 32 weeks. The estimated impact at the beginning was between 38% – 55% but then it decreased exponentially. The actual difference between the lines is ~34% during the pandemic and the MAE in the period before the pandemic was ~76 reports. Clarifications were added to the manuscript (see highlights below).

Changes in the manuscript (Materials and methods, lines 165-170):

… For example, level shift is the same on the first as well as the fifth or tenth week, while for transient shift, the highest impact is assumed at the beginning, but decreases exponentially with time, e.g. (δ = 0.85) in the second week but (δ = 0.52) in the fifth week (see Fig. 1). The estimated coefficient of the indicator is then a relative change in the weekly laboratory reports of a given pathogen, considering the other variables and effects in the model such as air temperature, seasonality and autoregression.

• Comment 3: I agree with the authors assessment that delta=1 for norovirus and approximately 0.85 for Campylobacter but they do not provide any justification for the later value. You could argue, for example, that the reduction in Campylobacter halves over 4 weeks and 0.85^4=0.52.

Response: The reduction for Campylobacter indeed halves over 4 weeks. As described in the methods, we compare level and transient shifts. The transient shift represents exponential decay. To clarify this more in the paper, a plot visualising the individual effects was added as well as specific examples in the text.

Changes in the manuscript (Results, lines 224-228):

The decrease in Campylobacter reports was better described by transient shift (δ = .85). The estimated impact was ~46% (CI 38% - 55%) on week 12, ~39% (32% - 47%) on week 13 and so on; the mean weekly reduction across weeks 12 and 43 was ~9% (CI 8% - 11%). This decrease was statistically significant at the 10% but not the 5% level (p = 0.075).

• Comment 4: It is a bit of shame that delta is not estimated from the data. Fitting a transfer function model would be one way to do this - see for example chapter 13 of “Time Series Analysis” by Box, Jenkins , Reinsel and Ljung (a pdf version of the book is available for free online)

Response: As the paper aims to demonstrate not only quantitative, but also qualitative difference between the impacts of the pandemic on norovirus and Campylobacter, I think the current format of the analysis achieves this better, i.e. it allows for easier communication of the message – Norovirus is more similar to Sars-CoV-2 than Campylobacter and so the reduction in norovirus is related to the actual measures, not only changes to the health seeking behaviour. It is our feeling that a more detailed analysis along the constructive lines suggested is beyond the scope of our paper.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Shinya Tsuzuki

30 Jul 2021

PONE-D-21-11454R1

Differential impact of the COVID-19 pandemic on laboratory reporting of norovirus and Campylobacter in England: a modelling approach

PLOS ONE

Dear Dr. Ondrikova,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by 13th August 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Shinya Tsuzuki, MD, MSc

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

Both reviewers made positive decisions but one of them raised a minor concern. Please answer the comment before publication.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: I would like to thank the authors for addressing my comments. In my view the paper is acceptable for publication. I have one question and a suggestion.

Question:

I was unsure how to interpret the norovirus shift parameter estimate in the new Table 3. I imagined exponentiating this parameter would give me the measure of impact but it doesn't (exp(-0.792)=0.45 but the reported impact is 59%). Is this an error or how should this parameter be interpreted?

Suggestion:

Given that seasonality is so important in this analysis it might be worth illustrating it somehow - e.g. by promoting the weekly time series figures from the supplementary information to the main text.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Christian Bottomley

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Aug 25;16(8):e0256638. doi: 10.1371/journal.pone.0256638.r004

Author response to Decision Letter 1


10 Aug 2021

We appreciate the extra effort that the reviewers have dedicated to providing additional feedback. We have incorporated changes to the manuscript and one of the figures to reflect the comments provided.

Here is a point-by-point response to the comments.

Comments from Reviewer 2

• Question: I was unsure how to interpret the norovirus shift parameter estimate in the new Table 3. I imagined exponentiating this parameter would give me the measure of impact but it doesn't (exp(-0.792)=0.45 but the reported impact is 59%). Is this an error or how should this parameter be interpreted?

Response: Thank you for spotting this, it needs clarification in the text. Briefly, since three variables represent the impact in the second model, the estimate is a sum of these three variables giving us ~59% decrease.

Specifically, all coefficients are transformed by exponentiating and subtracting one – (exp(coefficient) – 1) * 100. So the shift is then (exp(-0.792) – 1) * 100 ~ 55%. In the second model, we have two more variables indicating impact, which are added to the shift. As stringency index and the number of conducted Sars-CoV-2 tests vary over time, we need to multiply the coefficients by the actual values of the respective variable. Additionally, we only consider the period between weeks 12 and 43 to match the timeline of the shift variable. For norovirus, both the conducted tests and stringency index give us a decrease of approximately 2%, which is 4% in total and 55% + 4 % gives 59%. The simpler overall model represents the pandemic only with the shift indicator where (exp(-0.880) -1) *100 ~59%.

Changes in the manuscript (Results, lines 271-281):

… A simpler (overall) model might have underestimated the impact as the total decrease in norovirus reports determined by the second (specific trends) model has wider confidence intervals ~59% (CI 47% - 79%). On the other hand, the point estimates of both the Overall Impact and Specific Trends models were ~59%. Similarly, the total mean reduction of Campylobacter reports estimated by the Specific Trends model was between ~11% (CI 8% - 17%), which is higher than the simpler Overall Impact model ~9% (8% - 11%). Note that the impact estimate from the Specific Trends models is a sum of all the pandemic related estimates, i.e. conducted Sars-CoV-2 tests, stringency index and the shift determined by the overall impact model.

• Suggestion: Given that seasonality is so important in this analysis it might be worth illustrating it somehow - e.g. by promoting the weekly time series figures from the supplementary information to the main text.

Response: Thank you for the suggestion. Figure 2 now includes the previous season (2018/19), showing two years in total, and the seasonality is visible there.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Shinya Tsuzuki

12 Aug 2021

Differential impact of the COVID-19 pandemic on laboratory reporting of norovirus and Campylobacter in England: a modelling approach

PONE-D-21-11454R2

Dear Dr. Ondrikova,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Shinya Tsuzuki, MD, MSc

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Shinya Tsuzuki

16 Aug 2021

PONE-D-21-11454R2

Differential impact of the COVID-19 pandemic on laboratory reporting of norovirus and Campylobacter in England: a modelling approach

Dear Dr. Ondrikova:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Shinya Tsuzuki

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    Non-sensitive data underlying the results and code to reproduce the analysis presented in the study are available at https://doi.org/10.5281/zenodo.5035653. Raw norovirus and Campylobacter data were replaced with synthetic (model-generated) data. Routine surveillance data cannot be shared publicly because the provision of the data is dependent on the intended use. Raw norovirus and Campylobacter data are available from Public Health England (EEDD@phe.gov.uk).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES