Abstract
Background
Surveillance of SARS-CoV-2 in wastewater offers a near real-time tool to track circulation of SARS-CoV-2 at a local scale. However, individual measurements of SARS-CoV-2 in sewage are noisy, inherently variable and can be left-censored.
Aim
We aimed to infer latent virus loads in a comprehensive sewage surveillance programme that includes all sewage treatment plants (STPs) in the Netherlands and covers 99.6% of the Dutch population.
Methods
We applied a multilevel Bayesian penalised spline model to estimate time- and STP-specific virus loads based on water flow-adjusted SARS-CoV-2 qRT-PCR data for one to four sewage samples per week for each of the more than 300 STPs.
Results
The model captured the epidemic upsurges and downturns in the Netherlands, despite substantial day-to-day variation in the measurements. Estimated STP virus loads varied by more than two orders of magnitude, from ca 1012 virus particles per 100,000 persons per day in the epidemic trough in August 2020 to almost 1015 per 100,000 in many STPs in January 2022. The timing of epidemics at the local level was slightly shifted between STPs and municipalities, which resulted in less pronounced peaks and troughs at the national level.
Conclusion
Although substantial day-to-day variation is observed in virus load measurements, wastewater-based surveillance of SARS-CoV-2 that is performed at high sampling frequency can track long-term progression of an epidemic at a local scale in near real time.
Keywords: SARS-CoV-2, qRT-PCR, wastewater-based surveillance, early warning, hospital admissions
Key public health message.
What did you want to address in this study?
The primary aim of this study was to estimate SARS-CoV-2 virus loads in sewage in the Netherlands, using data from a comprehensive national surveillance programme. The secondary aim was to compare estimated virus loads in sewage with hospital admission data in order to use the sewage signal as a main indicator of morbidity.
What have we learnt from this study?
Virus loads in sewage water can vary by more than two orders of magnitude. The dynamics of the COVID-19 epidemic in wastewater were largely synchronised between municipalities. Estimated virus loads in sewage closely followed the daily number of hospitalisations and case notifications.
What are the implications of your findings for public health?
Surveillance of SARS-CoV-2 in wastewater can track in near real-time how the COVID-19 epidemic develops within a defined local area, even in the presence of substantial background signals and day-to-day variation.
Introduction
The COVID-19 pandemic has posed one of the most severe threats to public health in recent history. Severity and progression of the disease are variable, depending on host risk factors and pathogen variants [1-3]. Transmission can also occur via asymptomatic or pre-symptomatic individuals [4]. These characteristics hamper effective epidemiological surveillance for the infection dynamics, as case notifications are biased, depending on strain-dependent severity of disease, willingness to get tested, testing capacity and public health policies. Epidemiological surveillance based on hospital admissions is less biased but does not provide an accurate picture in the early and late stages of an epidemic when hospitalisations are rare. This is especially true at a local scale (e.g. municipalities) and for variants causing relatively mild disease (such as the Omicron relative to the Delta variant). Serological surveillance for severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2) can provide population-level estimates of the fraction of the population that has been infected [5]. Serological surveys, however, are costly and each survey only provides a cross-sectional snapshot of the population at a single time point.
In contrast with earlier applications of wastewater-based surveillance such as the identification of emerging enteric viruses [6], monitoring of SARS-CoV-2 in sewage can supply quantitative information at a local scale [7]. In the COVID-19 pandemic, the detection of SARS-CoV-2 in faeces has accelerated the introduction of wastewater surveillance in a variety of settings, including airports, hospitals and cities. Wastewater-based surveillance has now been implemented in many countries [8]. However, many of these activities are carried out by local governmental bodies or independent research groups and are often restricted to specific locations. This makes it difficult to compare variations over time and geographically in a broader perspective.
Here we report data and statistical analyses from a national wastewater-based surveillance programme in the Netherlands. Since 7 September 2020, all sewage treatment plants (STPs) in the Netherlands have been providing between one and four samples per week to the Dutch National Institute for Public Health and the Environment (RIVM). Since almost every Dutch household is connected to a sewer, coverage of the programme is close to 100%. Samples are subjected to a standardised extraction protocol and analysed by real-time RT-PCR within 2–4 days after sampling. As measurements of SARS-CoV-2 RNA in sewage are inherently variable and can be left-censored (i.e. not able to detect RNA at low virus loads), our aim was to integrate the available data to provide estimates of the latent true SARS-CoV-2 virus loads over time for all STPs. We analysed data from 1 August 2020 (when 60% of the population had already been included) up to and including 8 February 2022 (when coverage exceeded 99%). Hence, the time series data cover the winter epidemic of 2020/21, the 2021 summer surge after many restrictions had been lifted, and the 2021/22 winter epidemic.
Methods
Sampling, RNA extraction, and qRT-PCR
In the Netherlands, sewage of 99.6% of the population is treated at 317 STPs, of which four closed between start and end of the period of analysis (Figure 1). Coverage of the programme was over 99% of the Dutch population (> 17 million) as only a small fraction of the population in the Netherlands is not connected to a sewage system. The catchment areas of STPs vary in size from covering ca 1,000 to more than 800,000 inhabitants. At each STP, sewage samples were collected 1–4 times per week, and the weekly number of samples generally increased over the study period. Samples contained a volume of 500–1,000 mL, taken from a larger 24 h flow-proportional sample, and were sent to RIVM for analysis.
At the central laboratory, RNA extraction was performed on each sample using the Viral NA Large Volume kit on the MagNA Pure 96 instrument (Roche, Basel, Switzerland). Detection of SARS-CoV-2 RNA was based on an assay described by the Centers for Disease Control and Prevention (CDC) [9], and qRT-PCR was performed in duplicate for the N1 and N2 targets. In each analysis run we included both positive and negative controls, and added equine arteritis virus (EAV) to the samples to check for uncontrolled viral inhibition. Using an internal standard, quantification cycle (Cq) values were converted to RNA concentrations (RNA/mL). The RNA concentrations of the four measurements were averaged to yield an average RNA concentration. When all four measurements yielded a non-detect result, we reported the sample as negative/left-censored. The RNA/mL values obtained from the RT-qPCR were subsequently divided by the number of permanent residents in the catchment area of the STP and multiplied by 100,000 and by the 24 h water flow of the STP of origin to obtain the number of genome copies per 100,000 inhabitant equivalents. Throughout, we use ‘number of virus particles’ as shorthand for ‘number of genome copies’, and ‘virus load’ as shorthand for number of virus particles per 100,000 normalised by 24 h flow. Finally, municipalities often make use of multiple STPs. Therefore, to transform STP virus loads to virus loads per municipality, the virus loads per STP contributing to a given municipality were weighted by the number of inhabitants serviced by each STP in that municipality.
Statistical analysis
The basis for the analyses were log10-transformed virus concentration data, normalised by 24 h sewage water flow rates (unit: virus particles 100,000 persons/day; henceforth called virus load). The analyses employed a Bayesian multilevel spline model with random effects at the level of the STPs [10,11]. In the model, the expected log10-transformed virus load at time t and STP i, ci(t), was given by
, |
where c(t) represents the national trend and the di(t) represent the STP-specific deviations. The central goal was to infer the unknown latent virus loads ci(t) in the presence of measurement error and left-censoring. The national trend c(t) was modelled with a penalised spline (p-spline) with cubic b-spline basis functions and 15 equidistant knots (yielding 17 regression coefficients). The results presented here were obtained with a first-order random walk prior for the regression coefficients [11], using an N(12,1) prior distribution for the first regression coefficient and an inverse gamma(1, 0.0005) prior distribution for the variance parameter [11]. In this manner, the national log10-transformed virus load at the first time point was normally distributed a priori, with a mean of 12 per 100,000 persons per day and approximate 95% prior range of 10–14 per 100,000 persons per day. This provided good coverage for virus loads at the first time points (August 2020). In a similar manner, STP-specific deviations from the trend were modelled with cubic b-splines with 15 equidistant knots (yielding 17 coefficients per STP), and with zero-mean normal prior distributions (N(0,1)). Hence, plant-specific deviations were a priori expected to be no more than ca 100-fold (i.e. 2 standard deviations) lower or higher than the trend. Of note, this choice covered almost all (> 99.9%) individual measurements for all STPs over time.
We also explored a suite of alternatives, e.g. estimating the variance of the deviations, or replacing the p-spline for the national virus load with a b-spline using N(13,1) prior distributions for the regression coefficient, and evaluated competing models using the leave-one-out information criterion [12]. Here we report results from the best-fitting model. Throughout, we assume that the log10-transformed virus load measurements Yit at plant i and time t were normally distributed, Yit~N(ci(t), σ), and we used an uninformative (improper uniform) prior distribution for σ>0.
The probability of virus detection in a sample is determined by the detection limit of the qRT-PCR, the daily flow rates of water through the sewerage, and possibly also by the composition of the sewage. Hence, there is no fixed predefined cut-off for RNA detection that can be applied to all STPs at all time points, and we included in the analyses a two-parameter logistic function that determined the probability of detection. The parameters c0 (load at which detection occurs with a probability of 0.5) and k (steepness of the detection curve) were estimated. Hence, denoting the probability of detection by
, |
a non-detect result added a contribution 1-p(detection|ci(t)) to the likelihood. In this manner, samples in which no RNA is detected tended to pull the estimated load ci(t) to lower values. The parameter c0 was given a weakly informative N(12, 0.5) prior distribution (a priori of 50% probability of detection ranges from log virus load of ca 11–13), and k was provided with an uninformative (improper) uniform prior distribution (k>2). The event of a detection was Bernoulli-distributed, D~Bernoulli(p(detection|ci(t))). Putting it together, the log-likelihood contributions were given by
where fD and fY denote the log Bernoulli and log normal probability densities, respectively.
To tie the results at the STP level to other organisational levels (municipality, safety region, national) we applied posterior weighting of the estimated virus loads (i.e. the exponentiated estimated log loads), where weighting was proportional to the numbers of persons contributing to the various organisational units. Demographic data were obtained from Statistics the Netherlands using the census of 1 January 2020 [13], with the exception of the municipal mergers of January 2021 and 2022 which we added manually to the demographic data. Specifically, the expected log10-transformed virus load at time t in municipality i, bi(t), was given by
, |
where we summed over all STPs j, and Ii,j were the number of inhabitants in municipality i serviced by STP j. Log-transformed virus loads at other organizational levels (safety region, province) were calculated similarly. Of note, the analyses reported here included all but the three overseas extraordinary municipalities (Bonaire, St Eustatius and Saba).
We analysed sewage data of more than 47,000 measurements spanning the period from 1 August 2020 (when the majority of STPs had been included in the national programme) up to and including 8 February 2022. For comparison of the results with other epidemic indicators, we also made use of the daily incidence of hospital admissions (cases per 100,000 persons) and the daily number of positive tests, both stratified by municipality. All analyses were performed with Stan (version 2.21.0) and R (version 4.1.3), using RStan (version 2.21.2) as interface to Stan [14]. We ran 10 Markov chain Monte Carlo chains in parallel and based the analyses on 1,000 samples from well-mixed chains, where we applied 1/4 thinning to minimise correlations between samples. Data, scripts and figures are available in the online repository at https://github.com/rivm-syso/SARS-CoV-2_sewage.
Results
Descriptive statistics
The Dutch sewage surveillance programme for SARS-CoV-2 was initiated in the first months of 2020. Since its inception, the number of included STPs has increased over time such that 80 STPs provided samples in August 2020, and all 313–317 STPs provided samples from September 2020 onwards. An overview of the location and size of STPs in the Netherlands is provided in Figure 1 and shows that STPs in the densely populated western parts of the Netherlands are generally substantially larger than those in other regions. Approximately 3% of all measurements (1,479 of 46,448) yielded a non-detection, and those were concentrated in the early stages of the epidemic when virus loads were still low (< 1012.5). It is noteworthy that STPs often process sewage from multiple municipalities, and it is not uncommon that a municipality is served by multiple STPs. Hence, STPs do not follow the hierarchical organisational structure of the Dutch administrative divisions, which makes averaging from STP-level analyses to municipalities, provinces and safety regions not straightforward.
Estimation of viral loads
Figure 2 shows the latent virus loads for the nine largest STPs. Results for all 317 STPs are available in the online repository at https://github.com/rivm-syso/SARS-CoV-2_sewage. In general, the model described the data well, and indicators suggested that the estimation procedure yielded satisfying results. Specifically, the scale reduction factor was close to 1, there were no divergent transitions, components of the posterior distribution were located well within the support of the prior distributions yielding strong posterior contraction, there were no systematic deviations of residuals from posterior medians. Further, in Supplementary Figure S1 we show that approximately 95% of observations were within the 95% posterior prediction intervals.
Estimated virus loads were generally low in August and September 2020 and were estimated between 1012–1013 virus particles per 100,000 inhabitants per day. At these virus loads, a sizeable fraction of samples can yield a non-detection, especially at the lower end of this range. This is illustrated in Figure 3, which shows the probability of detection as a function of virus load, estimated from the joint data of all STPs. The estimated probability of detection was close to 0 at a virus load of 1011, close to 50% at a virus load of 1012, and almost 1 at a virus load of 1013. Estimated parameters of the detection function were c0 = 12.1 (95% credible interval (CrI): 12.1–12.2) for the posterior median of the logistic midpoint, and k = 4.2 (95% CrI: 4.0–4.4) for the posterior median of the logistic growth rate.
Between August 2020 and November 2020, virus loads increased by more than one order of magnitude to a peak value close to ca 1014 particles per 100,000 per day in many STPs. Thereafter, virus loads started to decline gradually in all STPs. From May 2021 onwards, when the vaccination coverage was strongly increasing, virus loads started to decrease at a faster pace until the early summer. Subsequently, virus loads increased and reached a peak in early August 2021 by the temporary lifting of restrictions for vaccinated persons. Finally, from October 2021, virus loads started increasing again, first to just under 1014 particles per 100,000 per day in most STPs in December 2021, and subsequently to well over 1014 and even up to 1015 particles per 100,000 per day in February 2022.
Overall, we observed that trends in virus loads corresponded to main epidemiological events. This was true even though we estimate that measurement variation was substantial. In fact, the posterior median of the standard deviation of the observation model was σ=0.353 (95% CrI: 0.351–0.355), such that individual measurements could be 102σ ≈ 5-fold lower or higher than the estimated virus load. This, however, is still substantially smaller than the 100- to 1,000-fold increases and decreases in virus loads from epidemic troughs to peaks and vice versa.
Relation to hospital admissions
The estimated virus loads in the nine largest municipalities in the Netherlands are presented in Figure 4. We obtained these municipal estimates from the STP estimates by weighting the relevant posterior virus loads by the number of inhabitants in the focal municipality. The patterns were similar to those in Figure 2 for the STPs. The peaks and troughs at the municipality levels matched the estimated peaks and troughs at the STP level. Estimated virus loads for all 345 municipalities are available in the online repository and were broadly similar to the results presented in Figures 2 and 4. For comparison with other epidemic indicators, Figure 4 also shows the log-transformed daily incidence of hospital admissions. In addition, we provide in Supplementary Figure S2 the estimated virus loads in the nine largest municipalities with the daily number of positive tests, showing a similar correspondence between virus loads and case notifications as we observed between virus loads and hospitalisations.
Finally, Figure 5 shows the inferred log-transformed virus loads in the Netherlands, using the population-weighted STP estimates, together with the log-transformed daily total number of hospitalisations. Again, overall patterns of estimated virus loads were similar to those shown in Figures 2 and 4. Interestingly, epidemic troughs and peaks in the national estimate were less pronounced than those observed in most STPs. For instance, virus load estimates were as low as 1012 particles per 100,000 per day in many STPs in August 2020 but almost 1013 at the national level, and almost 1015 in the February 2022 peak but only just over 1014 at the national level. The fact that local epidemics were not fully synchronised is the reason that the national trend was less pronounced than those in the individual STPs (Figure 2). In fact, there was up to 10-fold variation from one STP to the next in peak height and trough depth, and up to 4 week shifts in the timing of the peaks and troughs.
Discussion
More than 99% of the Dutch population is connected to the sewerage and thus to an STP. This makes it possible to perform high resolution and near real-time surveillance of pathogens that are shed in faeces, urine and other excreta and secreta [15,16]. However, sewage is a complex matrix to analyse [17], and proper controls are necessary to accurately quantify SARS-CoV-2 RNA. It is known that the amount of precipitation and the composition of industrial wastewater that is mixed in with the sewage of the general population will affect SARS-CoV-2 RNA concentrations determined by RT-PCR [18]. Still other factors that can affect measurements include the length of sewer lines and ambient temperature [19]. Here we have shown that even when there is substantial noise or day-to-day variation in RNA concentrations detected in sewage, it is possible to reliably estimate variations in underlying latent SARS-CoV-2 virus loads over time. This is possible because virus loads in sewage increase and decline exponentially during epidemics, often by more than two orders of magnitude. These very strong variations over time dwarf the noise in the signal, which is determined by the standard deviation of the log10-transformed virus load measurements (σ). In the analyses, the standard deviation is estimated at 0.353, such that the estimated latent virus load can be approximately fivefold lower or higher than the individual measurements.
Our analyses using multilevel splines provide a convenient research tool to analyse sewage data, as it enables a natural borrowing of information from the national virus load and samples taken around the same time. This has not hitherto been included in other smoothing approaches of sewage data [20]. In this manner, we have been able to infer trends over time in the latent true virus loads for all 317 STPs in the Netherlands, as well as for a variety of other organisational levels (e.g. municipality, safety region, province and national). Specifically, we provided estimates of the latent virus loads at all time points and in particular for STPs on days when no measurements are available. In principle, our method of analysis can be extended further to any level of organisation. In addition, subsampling from sewer lines in STPs with an unusually high virus load is also possible [21]. Especially in large STPs (such as Amsterdam-West and other STPs in Figure 2) there may be substantial differences between city districts with respect to SARS-CoV-2 prevalence, possibly associated with risk factors such as vaccination coverage and socioeconomic status [22].
Although our analyses provide an adequate fit to the data, we do not claim that the results are optimal for all SPTs at all time points. Rather, they provide a parameter-sparse description of the data, linking the 317 STP time series through the national virus load. This seemed to work well in general, but it should be noted that the model has difficulty following very sudden changes in virus load data. A prominent example were the sudden and strong drops in virus loads around October 2021. This is only partially resolved by adding more knots to the splines, at the cost of greatly increasing computation times (data not shown). Future extensions could also focus on adding STP-specific measurement noise or perhaps even directly modelling the PCR data and water flow rates jointly.
Our statistical modelling has provided a description of trends in virus loads at a local level by weighing all available wastewater measurements. In contrast, other modelling studies have focused on relating national or subnational virus loads to case notification data or hospitalisations using mechanistic modelling, with the aim to estimate the incidence and prevalence of the number of infections over time ([23-25] and references therein). The two approaches serve different purposes, and each has its strengths and limitations. A main strength of the mechanistic modelling is that all parameters have a biological interpretation, and that these analyses can be used for scenario studies. The results from such analyses, however, depend critically on model assumptions and are surrounded with large uncertainties. Our analyses do not yield a mechanistic interpretation but give precise estimates of latent virus loads that arguably are less dependent on specific model assumptions.
Our analyses provide steps to integrate noisy individual virus load measurements in sewage into more smooth estimates of the underlying latent virus load. This is valuable in itself, but we believe that the future value of the analyses will be mostly in combining the sewage data with other epidemic indicators such as hospitalisations or positive tests [26,27]. In addition, since the infrastructure of receiving sewage samples is in place, the detection of other viruses can and will be added to the Dutch sewage surveillance programme. These include rotavirus and enteroviruses but also respiratory syncytial virus and influenza viruses [28,29], thus providing a comprehensive and general surveillance tool to support pandemic preparedness. Moreover, sewage surveillance has also shown potential as a means to track antimicrobial resistance in the population [30]. In principle, our methods of analysis can be directly applied to other targets and can deal with noise and unbalanced data in a systematic manner.
Conclusion
Wastewater-based surveillance of SARS-CoV-2 can track long-term epidemic progression at a local scale in near real time, even in the presence of substantial noise and day-to-day variation. This can support public health authorities by early notification of local increases in virus circulation in a semi-endemic situation with decreasing numbers of case notifications and hospital admissions.
Data availability
All data or links to data as well as all scripts are available at our online repository at https://github.com/rivm-syso/SARS-CoV-2_sewage.
Ethical statement
No ethical approval was required for this study, as it does not contain any information that can be traced to individual persons.
Funding statement
This research was financed by the Dutch Ministry of Health, Welfare and Sport, and by the Japan Society for the Promotion of Science (FM, JSPS KAKENHI Grant number 20J00793). The funders had no role in the design and conduct of the study, nor the decision to prepare and submit the manuscript for publication.
Acknowledgements
We are indebted to representatives of the Dutch Water Authorities, in particular Mark van der Werf, Imke Leenen, and Bert Palsma, for facilitating the current study. We would like to thank all STP personnel working in water laboratories responsible for the actual sampling of wastewater. We gratefully acknowledge comments on the manuscript by Susan van den Hof, Irene Veldhuijzen, and Rianne van Gageldonk-Lafeber. This research was financed by the Dutch Ministry of Health, Welfare and Sport, and by the Japan Society for the Promotion of Science (FM, JSPS KAKENHI Grant number 20J00793). This work was published as a preprint article on MedRxiv (Michiel van Boven, Wouter A Hetebrij, Arno Swart, Erwin Nagelkerke, Rudolf FHJ van der Beek, Sjors Stouten, et al. Modelling patterns of SARS-CoV-2 circulation in the Netherlands, August 2020-February 2022, revealed by a nationwide sewage surveillance program. 30 May 2022. doi: https://doi.org/10.1101/2022.05.25.22275569).
Supplementary Data
Conflict of interest: None declared.
Authors’ contributions: SARS-CoV-2 wastewater studies in the Netherlands were initiated by WJL and AMdRH. Analyses were initiated by MvB, and carried out by MvB, AS and WAH. First draft was written by MvB. WAH, AS, EN, RFHJB, SS, RTH, FM, AK, AMRvdD, AW, WL and AMdRH discussed results and provided input on the draft of the manuscript.
References
- 1. McDonald SA, Miura F, Vos ERA, van Boven M, de Melker HE, van der Klis FRM, et al. Estimating the asymptomatic proportion of SARS-CoV-2 infection in the general population: Analysis of nationwide serosurvey data in the Netherlands. Eur J Epidemiol. 2021;36(7):735-9. 10.1007/s10654-021-00768-y [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Richardson S, Hirsch JS, Narasimhan M, Crawford JM, McGinn T, Davidson KW, et al. Presenting characteristics, comorbidities, and outcomes among 5700 patients hospitalized with COVID-19 in the New York City area. JAMA. 2020;323(20):2052-9. 10.1001/jama.2020.6775 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3. Patone M, Thomas K, Hatch R, Tan PS, Coupland C, Liao W, et al. Mortality and critical care unit admission associated with the SARS-CoV-2 lineage B.1.1.7 in England: an observational cohort study. Lancet Infect Dis. 2021;21(11):1518-28. 10.1016/S1473-3099(21)00318-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Ravindra K, Malik VS, Padhi BK, Goel S, Gupta M. Asymptomatic infection and transmission of COVID-19 among clusters: systematic review and meta-analysis. Public Health. 2022;203:100-9. 10.1016/j.puhe.2021.12.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Vos ERA, van Boven M, den Hartog G, Backer JA, Klinkenberg D, van Hagen CCE, et al. Associations Between measures of social distancing and severe acute respiratory syndrome coronavirus 2 seropositivity: a nationwide population-based study in the Netherlands. Clin Infect Dis. 2021;73(12):2318-21. 10.1093/cid/ciab264 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. McCall C, Wu H, Miyani B, Xagoraraki I. Identification of multiple potential viral diseases in a large urban center using wastewater surveillance. Water Res. 2020;184:116160. 10.1016/j.watres.2020.116160 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7. Lodder W, de Roda Husman AM. SARS-CoV-2 in wastewater: potential health risk, but also data source. Lancet Gastroenterol Hepatol. 2020;5(6):533-4. 10.1016/S2468-1253(20)30087-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8. Bonanno Ferraro G, Veneri C, Mancini P, Iaconelli M, Suffredini E, Bonadonna L, et al. A state-of-the-art scoping review on SARS-CoV-2 in sewage focusing on the potential of wastewater surveillance for the monitoring of the COVID-19 pandemic. Food Environ Virol. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Lu X, Wang L, Sakthivel SK, Whitaker B, Murray J, Kamili S, et al. US CDC real-time reverse transcription PCR panel for detection of severe acute respiratory syndrome coronavirus 2. Emerg Infect Dis. 2020;26(8):1654-65. 10.3201/eid2608.201246 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10. Di Serio C, Lamina C. Investigating determinants of multiple sclerosis in longitunal studies: a Bayesian approach. J Probab Stat. 2009;2009:198320. 10.1155/2009/198320 [DOI] [Google Scholar]
- 11. Lang S, Brezger A. Bayesian P-Splines. J Comput Graph Stat. 2004;13(1):183-212. 10.1198/1061860043010 [DOI] [Google Scholar]
- 12. Vehtari A, Gelman A, Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput. 2017;27(5):1413-32. 10.1007/s11222-016-9696-4 [DOI] [Google Scholar]
- 13.Statistics Netherlands. Inwoners per rioolwaterzuiveringsinstallatie, 1-1-2020. [Inhabitants by sewage treatment plant, 1 January 2020]. The Hague: Statistics Netherlands; 2021. Dutch. Available from: https://www.cbs.nl/nl-nl/maatwerk/2021/01/inwoners-per-rioolwaterzuiveringsinstallatie-1-1-2020
- 14. Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, et al. Stan: A Probabilistic Programming Language. J Stat Softw. 2017;76(1):1-32. 10.18637/jss.v076.i01 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Holshue ML, DeBolt C, Lindquist S, Lofy KH, Wiesman J, Bruce H, et al. First case of 2019 novel coronavirus in the United States. N Engl J Med. 2020;382(10):929-36. 10.1056/NEJMoa2001191 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16. Sims N, Kasprzyk-Hordern B. Future perspectives of wastewater-based epidemiology: Monitoring infectious disease spread and resistance to the community level. Environ Int. 2020;139:105689. 10.1016/j.envint.2020.105689 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17. Robinson CA, Hsieh HY, Hsu SY, Wang Y, Salcedo BT, Belenchia A, et al. Defining biological and biophysical properties of SARS-CoV-2 genetic material in wastewater. Sci Total Environ. 2022;807(Pt 1):150786. 10.1016/j.scitotenv.2021.150786 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18. Hokajärvi AM, Rytkönen A, Tiwari A, Kauppinen A, Oikarinen S, Lehto KM, et al. The detection and stability of the SARS-CoV-2 RNA biomarkers in wastewater influent in Helsinki, Finland. Sci Total Environ. 2021;770:145274. 10.1016/j.scitotenv.2021.145274 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19. Bertels X, Demeyer P, Van den Bogaert S, Boogaerts T, van Nuijs ALN, Delputte P, et al. Factors influencing SARS-CoV-2 RNA concentrations in wastewater up to the sampling stage: A systematic review. Sci Total Environ. 2022;820:153290. 10.1016/j.scitotenv.2022.153290 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20. Courbariaux M, Cluzel N, Wang S, Maréchal V, Moulin L, Wurtzer S, et al. A flexible smoother adapted to censored data with outliers and its application to SARS-CoV-2 monitoring in wastewater. Front Appl Math Stat. 2022;8:8. 10.3389/fams.2022.836349 [DOI] [Google Scholar]
- 21. Rubio-Acero R, Beyerl J, Muenchhoff M, Roth MS, Castelletti N, Paunovic I, et al. Spatially resolved qualified sewage spot sampling to track SARS-CoV-2 dynamics in Munich - One year of experience. Sci Total Environ. 2021;797:149031. 10.1016/j.scitotenv.2021.149031 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Coyer L, Boyd A, Schinkel J, Agyemang C, Galenkamp H, Koopman ADM, et al. Differences in SARS-CoV-2 infections during the first and second wave of SARS-CoV-2 between six ethnic groups in Amsterdam, the Netherlands: A population-based longitudinal serological study. Lancet Reg Health Eur. 2022;13:100284. 10.1016/j.lanepe.2021.100284 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23. Ahmed F, Islam MA, Kumar M, Hossain M, Bhattacharya P, Islam MT, et al. First detection of SARS-CoV-2 genetic material in the vicinity of COVID-19 isolation Centre in Bangladesh: Variation along the sewer network. Sci Total Environ. 2021;776:145724. 10.1016/j.scitotenv.2021.145724 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24. Nourbakhsh S, Fazil A, Li M, Mangat CS, Peterson SW, Daigle J, et al. A wastewater-based epidemic model for SARS-CoV-2 with application to three Canadian cities. Epidemics. 2022;39:100560. 10.1016/j.epidem.2022.100560 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Huisman JS, Scire J, Caduff L, Fernandez-Cassi X, Ganesanandamoorthy P, Kull A, et al. Wastewater-based estimation of the effective reproductive number of SARS-CoV-2. Environ Health Perspect. 2022;130(5):57011. 10.1289/EHP10050 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. Hegazy N, Cowan A, D’Aoust PM, Mercier É, Towhid ST, Jia J-J, et al. Understanding the dynamic relation between wastewater SARS-CoV-2 signal and clinical metrics throughout the pandemic. medRxiv. 2022:2022.07.06.22277318. [DOI] [PMC free article] [PubMed]
- 27. Daza-Torres ML, Montesinos-López JC, Kim M, Olson R, Bess CW, Rueda L, et al. Model training periods impact estimation of COVID-19 incidence from wastewater viral loads. Sci Total Environ. 2023;858(Pt 1):159680. 10.1016/j.scitotenv.2022.159680 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28. Wolfe MK, Duong D, Bakker KM, Ammerman M, Mortenson L, Hughes B, et al. Wastewater-based detection of two influenza outbreaks. Environ Sci Technol Lett. 2022;9(8):687-92. 10.1021/acs.estlett.2c00350 [DOI] [Google Scholar]
- 29. Kiulia NM, Gonzalez R, Thompson H, Aw TG, Rose JB. Quantification and trends of rotavirus and enterovirus in untreated sewage using reverse transcription droplet digital PCR. Food Environ Virol. 2021;13(2):154-69. 10.1007/s12560-020-09455-9 [DOI] [PubMed] [Google Scholar]
- 30. Blaak H, Kemper MA, de Man H, van Leuken JPG, Schijven JF, van Passel MWJ, et al. Nationwide surveillance reveals frequent detection of carbapenemase-producing Enterobacterales in Dutch municipal wastewater. Sci Total Environ. 2021;776:145925. 10.1016/j.scitotenv.2021.145925 [DOI] [Google Scholar]
- 31.National Institute for Public Health and the Environment (RIVM). COVID-19 open data repository. Bilthoven: RIVM. [Accessed: 4 May 2022]. Availably from: https://data.rivm.nl/covid-19
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.