Skip to main content
PLOS Neglected Tropical Diseases logoLink to PLOS Neglected Tropical Diseases
. 2023 Sep 14;17(9):e0011610. doi: 10.1371/journal.pntd.0011610

Reporting delays of chikungunya cases during the 2017 outbreak in Lazio region, Italy

Mattia Manica 1,2,3,*, Giovanni Marini 2,3, Angelo Solimini 4, Giorgio Guzzetta 1,3, Piero Poletti 1,3, Paola Scognamiglio 5, Chiara Virgillito 4, Alessandra della Torre 4, Stefano Merler 1,3, Roberto Rosà 2,6, Francesco Vairo 5, Beniamino Caputo 4
Editor: Ran Wang7
PMCID: PMC10501639  PMID: 37708121

Abstract

Background

Emerging arboviral diseases in Europe pose a challenge due to difficulties in detecting and diagnosing cases during the initial circulation of the pathogen. Early outbreak detection enables public health authorities to take effective actions to reduce disease transmission. Quantification of the reporting delays of cases is vital to plan and assess surveillance and control strategies. Here, we provide estimates of reporting delays during an emerging arboviral outbreak and indications on how delays may have impacted onward transmission.

Methodology/principal findings

Using descriptive statistics and Kaplan-Meyer curves we analyzed case reporting delays (the period between the date of symptom onset and the date of notification to the public health authorities) during the 2017 Italian chikungunya outbreak. We further investigated the effect of outbreak detection on reporting delays by means of a Cox proportional hazard model. We estimated that the overall median reporting delay was 15.5 days, but this was reduced to 8 days after the notification of the first case. Cases with symptom onset after outbreak detection had about a 3.5 times higher reporting rate, however only 3.6% were notified within 24h from symptom onset. Remarkably, we found that 45.9% of identified cases developed symptoms before the detection of the outbreak.

Conclusions/significance

These results suggest that efforts should be undertaken to improve the early detection and identification of arboviral cases, as well as the management of vector species to mitigate the impact of long reporting delays.

Author summary

Timely detection of arboviral introduction and transmission is paramount to decrease the probability of further autochthonous transmission in non-endemic countries. When, despite all efforts, autochthonous transmission occurs, then an early detection of cases helps in bringing the outbreak under control. However, due to the still low frequency in Europe of local outbreaks of arboviruses transmitted by the vector mosquito species Aedes albopictus, little is known about the performance of public health surveillance in an ongoing emergency situation. This research investigates the reporting delays observed during the 2017 Italian chikungunya outbreak and provides estimate useful for modeling outbreak responses as well as suggesting the strengthening of the surveillance systems in the early detection and identification of arboviral cases.

Introduction

Timely detection of infected cases enables public health authorities to take effective actions to reduce disease transmission in a population, limiting health and socio-economic impacts. In the case of mosquito-borne diseases, the longer an undetected viremic individual is left exposed to mosquito bites, the higher is the risk of subsequent transmission and of the spread of the pathogen. In the last decades, in European countries, autochthonous transmission of different emerging mosquito-borne diseases such as dengue and chikungunya occurred sporadically. Occasionally these caused local epidemics [13]. These events led several European countries and the European Centre for Disease Prevention and Control to develop surveillance systems and response guidelines for arboviral infections [46]. Estimates of the distribution of case reporting delays (the period between the date of symptom onset and the date of notification to the public health authorities) would represent a valuable indicator of the quality of the public health surveillance process and of health systems’ preparedness [6], although other factors not related to public health efficiency play a role [7]. In fact, factors influencing the length of the reporting delay are expected to be highly heterogeneous across cases as they could be patient specific (e.g. time interval after symptom onset before seeking medical intervention), but they can also be influenced by physicians (e.g. time before visiting the patient or prescribing the proper diagnostic test), by the testing laboratories (e.g. time before sending the test result), and by the socio-technological infrastructure in place to report identified cases to the responsible public health authority.

Chikungunya virus (CHIKV) is a pathogen which belongs to the Togaviridae family (genus Alphavirus) and is transmitted by Aedes mosquito species to humans, that are a competent host [8]. CHIKV has continuously re-emerged in Africa and Asia during the last decade and has been routinely imported into Europe and America through travelers. CHIKV is a perfect example of the difficulties of early identification of pathogen circulation that public health authorities are increasingly facing in Europe [9]. One of the reasons is that a non-negligible fraction of human infections is asymptomatic and that symptomatic patients do not always seek medical care because of mild symptoms and/or lack of knowledge of Aedes transmitted diseases [1012]. Additionally, general practitioners or clinicians may not promptly diagnose the disease because in non-endemic areas this could be confused with other clinical conditions (e.g. measles) due to low disease awareness [13] or more concerning disease (e.g. dengue) [3]. All these factors could contribute to an initially silent circulation of the pathogen in the human population, as occurred in the early phase of the two CHIKV outbreaks experienced in Italy in 2007 and 2017 [1]. In 2017, epidemiological investigations and active case findings identified a total of 499 probable cases, suggesting three main foci (Anzio, Rome and Latina) within Lazio region [14] and an additional one in the Calabria region (Guardavalle) [15]. The outbreak in the Lazio region was identified when the National Reference Laboratory for Arboviral Infections at the National Institute of Public Health and the National Institute for Infectious Diseases analyzed serum and urine samples from a cluster of three suspected cases [16]. All cases resulted IgM positive on 6 and 7 September 2017 and were confirmed through a neutralisation test [14,16,17]. All cases showed symptoms (i.e. high fever above 38° C, severe joint pain and skin rash) but only one case was still symptomatic at the time of laboratory testing. None of the cases had an history of travel in endemic area in the past 15 days, they all lived in the same household and the onset of symptoms happened during their holiday in the coastal area of Anzio [14,16,17]. After the identification of the outbreaks, health authorities implemented blood safety restrictions (e.g.: suspension of blood collection) until 1 December 2017 [15,18] and reactive vector control measures by aerial spraying with pyrethroid insecticides, residual etofenprox-based insecticides and larvicide in street drains in both public areas and private houses [16,19]. The surveillance system in place in the Lazio region in 2017 included different surveillance tools: passive surveillance relying on medical practitioners reporting suspected cases, laboratory-based surveillance, and syndromic surveillance [20]. Based on national and regional guidelines, reporting of suspected arbovirus cases to local Public Health authorities is mandatory [14,17,21]. However, reporting time was not analyzed, despite its importance to inform preventive measures for future outbreaks.

In the present work, we analyze reporting delays during the 2017 chikungunya outbreak in the Lazio region (Italy) and discuss potential consequences in the control of the diseases spread.

Materials and methods

We analyzed all suspected, probable, and confirmed chikungunya cases notified by Regional Service for Epidemiology, Surveillance and control of Infectious Diseases (SERESMI) of Lazio Region between 6th September 2017 and 5th February 2018 [14]. The criteria for suspected case definition were presence of symptoms (fever and joint pain) without history of travel to an endemic country in the 15 days preceding the symptom onset or living with or close to (<200m) a probable/confirmed case. The medical practitioner that suspects an arboviral infection in subjects who meet the clinical and epidemiological case definitions must report it to the competent regional Public Health authority in charge of the epidemiological surveillance (i.e. SERESMI) within 12 hours and collect samples to send for laboratory confirmation. A probable case was defined as any suspected case that tested positive for anti-CHIKV IgM on a single serum sample. A confirmed case was defined as any suspected case that tested positive for either CHIKV PCR or as a suspected case who tested positive for anti-CHIKV IgM on a single serum sample and whose positivity was either confirmed by sero-neutralization or seroconverted from negative to positive or by showing a fourfold increase of Ig titer in two subsequent samples taken at least 2 weeks apart (see [14] and S1 Text for more information on case definition). In the event of positive laboratory tests, the case must be immediately reported by the health authority to the administrative body of the Region and within 12 hours to the Ministry of Health and the National Institute of Health. The guidelines for reporting in effect at the time of the outbreak are included in S1 Text.

The dataset was anonymized, and the following information were provided for each case: date of symptom onset (if any), date of notification, presumed epidemiological link, and case definition (suspect, probable or laboratory confirmed). The date of symptom onset was obtained by interviews carried out during epidemiological investigations [14]. The date of notification represents the date of reporting to SERESMI as a suspect case. This notification took place within 24-h from the assessment of compliance to the definition of suspect case [14]. The epidemiological link indicated the area within the Lazio region where the infection most likely occurred.

In this work, we defined the reporting delay associated with symptomatic cases as the number of days elapsed between the notification date and the date of symptom onset. In addition, we classified each case as occurred before outbreak detection (BOD) or after outbreak detection (AOD), by comparing the date of symptom onset with to the date of first notification (September 6, 2017 [17]). We investigated reporting delays using Kaplan-Meyer curves [22], by considering a dichotomous variable indicating whether the case was BOD or AOD. Given that information is available only for notified cases there is no censoring, and we could not consider undetected (i.e., asymptomatic, not seeking medical care) cases. Obtained findings were used to retrospectively evaluate how the public health response triggered by the outbreak detection affected notification timeliness. We further analyzed the effect of outbreak detection to reporting delays by means of a Cox proportional hazard model [22]. We ran two sensitivity analyses: in the first, we excluded all cases with a reporting delay longer than 30 days to minimize potential recall bias in the identification of the date of symptom onset, in the second we considered only confirmed cases.

Finally, we investigated the proportion of cases that were notified before the end of their infectious period and, under the assumption that notification would prevent further transmission (ie self-protection from bites and implementation of measures for vector control), we estimated the consequent avoided number of days at population level during which uncontrolled onward transmission can occur. We assigned the start and length of the infectious period following the viremia time profile as in Cauchemez et al, 2014 [23]. For each case, the first day of the infectious was sampled one or two days (with equal probability 0.5) before the date of symptom onset, while the length of the infectious period was uniformly sampled between 5 to 8 days. We repeated the process 1000 times to obtain a distribution of infectious period for each case identified during the outbreak. Then, we computed the percentage of cases that were notified before the end of their infectious period and the percentage of days of uncontrolled onward transmission that may have been avoided at population level. In addition, we carried out a sensitivity analysis where we estimated the infectious period of chikungunya cases by fitting a truncated Poisson distribution to data on the duration (in days) of fever in identified imported chikungunya cases in Italy [24], under the assumption that the infectious period overlaps the manifestations of disease symptoms [8]. Then, as in the main analysis, we simulated 1000 infectious period for each case using the estimated truncated Poisson distribution.

Results

In total, 414 cases were notified in the Lazio region, of which 312 with epidemiological link to Anzio, 73 to Rome, 8 to Latina and 21 scattered across the region (Fig 1). Overall, 200, 202, and 12 cases were classified as confirmed, probable and suspected, respectively. Two cases (one in Anzio and one in Rome) with missing information regarding their symptoms’ onset were excluded from the proposed analysis. The epidemiological investigation pointed out that 189 (45.9%) patients developed symptoms before outbreak detection (BOD); 223 (54.1%) afterward (AOD). The median reporting delay was 15.5 overall (interquartile range 7–36.25), 33 days BOD (interquartile range 19–52) and 8 days AOD (interquartile range 5–15).

Fig 1.

Fig 1

A) Time of key events associated with identified cases. On the x-axis the date, on the y-axis the cases ID. Points represent the time at notification. Lines represent the cases’ reporting delay. Different colors are used to group cases into the different epidemiological foci. The grey area defines the period before the detection of the outbreak. B) Cumulative proportion of cases by reporting delays and foci. On the x-axis the reporting delay, on the y-axis the cumulative proportion of cases. Different colors are used to group cases into the different epidemiological foci.

The earliest symptom onset retrospectively identified through epidemiological investigation was on 26th June in Anzio, 72 days before the outbreak detection on September 6th (Fig 1). In Rome and Latina, the other two foci, it was on 20th (17 days BOD) and 13th (24 days BOD) August, respectively. The symptom onset for the first notified cases (earliest notifications, all linked to the Anzio cluster) happened on 5th, 11th, and 25th of August (32, 26, 12 days BOD). On the other hand, the earliest symptom onset for the first notified cases in Rome (8th September) and Latina (12th September) was on 2nd September and 25th August, respectively. The percentage of notified cases within 24h from symptom onset was 3.6% AOD. In the first week after the outbreak detection, reporting involved both recent and retrospective cases (Figs 1 and 2), while after 4 weeks (ie after epidemiological week 40) the notification increasingly involved less recent cases (ie with a greater reporting delay, as shown in Fig 2, panel D).

Fig 2.

Fig 2

A) Weekly number of identified cases by date of symptom onset. B) As A) but by date of notification. Different colors are used to group cases into the different epidemiological foci. C) Distribution of reporting delay by week of symptom onset; boxplots represent median values (horizontal lines), interquartile ranges (box limits), minimum and maximum values (vertical lines) and points represent mean values; counting of epidemiological weeks was extended to the following year (2018). D) As C) but by week of notification. Dashed vertical lines represent the week of outbreak detection.

Using Kaplan-Meier curves, we estimated a median reporting delay of 33 days (95%CI: 31–37) BOD and 8 days (95%CI: 7–9) AOD (Fig 3). Similarly, the Cox model estimated a hazard ratio of being notified of 3.45 (95%CI: 2.80–4.25) AOD compared to BOD; in other words, among all cases that will be eventually identified, the rate of notification was about 3.5 time higher in cases with symptoms’ onset AOD compared to cases with date of symptom onset BOD.

Fig 3. Kaplan Meier curve.

Fig 3

Probability of the length of the reporting delay after symptom onset. On the x-axis the length of the reporting delay, on the y-axis the probability of remaining undetected. The table below represent the cumulative number of notifications at the corresponding time point (x-axis above).

Results of sensitivity analyses confirmed the decrease in the length of reporting delay AOD and showed a lower reporting delay mainly due to the exclusion of patients with a reporting delay over 30 days. Among the 277 records obtained excluding the records with a reporting delay > 30 days (to avoid recall bias), 196 (70.8%) of which concerned cases with date of symptom onset AOD. The median reporting delay was 9 days (interquartile range: 6–16), 18 (interquartile range 11–25) and 7 (interquartile range: 4.75–11) overall, BOD and AOD, respectively. Results of Kaplan-Meier curve estimated a median reporting delay of 18 days (95%CI: 13–29) BOD and 7 days (95%CI: 6–8) AOD confirming the reduced time to notification after outbreak detection. The Cox model estimated a hazard ratio of being notified of 2.6 (95%CI: 2.0–3.4) AOD compared to BOD. Considering only confirmed cases resulted in 199 valid record, 156 (78.4%) of which concerned cases with date of symptom onset AOD. The median reporting delay was 8 days (interquartile range: 5–11.5), 13 (interquartile range 10.5–29) and 6 (interquartile range: 4–10) overall, BOD and AOD, respectively. Results of Kaplan-Meier curve estimated a median timeliness of 13 days (95%CI: 12–26) BOD and 6 days (95%CI: 6–8) AOD confirming the reduced reporting delays after outbreak detection. The Cox model estimated a hazard ratio of being notified of 2.9 (95%CI: 2.1–4.2) AOD compared to BOD.

Following [23], we assumed the infectious period to start one or two days before symptom onset and last between 5 to 8 days. We found that, on average 17% (95%CI: 15.3–18.9%) of cases had a notification time shorter than their infectious period. This percentage was almost zero BOD, 0.9% (95%CI: 0.– 2.1%) but increased up to 30.7% (95%CI: 27.4–34.1%) after outbreak detection (AOD). We estimated no reduction in the number of days per person when onward transmission can occur BOD while it was 0.3 days per person AOD (95%CI: 0.2–0.3) and 0.28 days per person on the whole period (95%CI: 0.2–0.3), respectively. This suggests an average percentage reduction in the number of infectious days at population level of 0.1% AOD (95%CI: 0–0.2%), 8% BOD (95%CI: 6.9–9.1%) and 4.4% in the whole period (95%CI: 3.7–5%). A sensitivity analysis assuming no pre-symptomatic infectiousness and a length of the infectious period similar to the symptomatic period provided comparable results, see supplementary S1 Text.

Discussion

The delay between symptom onset and notification to the public health system is a critical parameter in controlling outbreaks [25]. Such delays have been previously suggested to be one of the key drivers of the size and spread of the 2017 chikungunya outbreak in the Lazio region, Italy [15]. The analysis of reporting delays conducted in this study showed that even after detection of the outbreak by public health authorities, the length of these delays (median 8 days) was still comparable to the duration of the infectious period (5 to 8 days [23]). Since case-based interventions (such as insecticide spraying around the residence of a case) can only occur after case detection, these delays significantly impair the ability of control measures in disrupting pathogen transmission. Therefore, the resulting percentage reduction of days when onward transmission can occur at population level was not high (8% on average) even under the assumption that notification of a case is enough to prevent further transmission.

The reporting delay for the case with the earliest symptom onset (72 days) is higher than the range previously observed for the notification of imported cases in Italy (from 2 to 58 days, 18.6 days on average) [26,27]. Data showed that reporting delays greatly improved after the detection of the first cases, with a 3.5 higher rate of reporting and a mean reporting delay of 13.3 days after outbreak detection compared to 39.9 days before outbreak detection. Nonetheless, it is likely that a large proportion of patients, who presented no or mild symptoms, remained undetected by the public health systems. This hypothesis is supported by evidence gathered after the Italian 2007 outbreak when a seroprevalence study revealed that symptomatic individuals correctly identified by active surveillance represented only 63% of the total number of cases [28]. Indeed, the degree and share of transmission episodes originating from asymptomatic individuals may affect the effectiveness of an outbreak response based on vector control around the place of residence of notified cases.

Reduction of reporting delays should be a priority as suggested by previous theoretical assessment of public health strategies to reduce the risk of autochthonous transmission [29,30]. However, a recent modeling study [31] estimated that shortening the delay from symptom onset to intervention (from an average of 6 to an average of 3 days) would have brought limited reductions in the size of the 2017 chikungunya outbreak. Underlying reasons were the limited effectiveness of control interventions and the potentially wider distribution of transmission distances compared to the area targeted by reactive vector control interventions. However, the same study suggested that an earlier outbreak detection by just two generations of transmission (about 3 weeks) could have reduced the number of cases occurring after outbreak detection by over two thirds, therefore stressing the importance of a surveillance system capable of quickly detecting the introduction of tropical arboviruses, as also observed in France where anticipating vector control intervention by 10 days would have reduced the final outbreak size by 30–40% fewer cases [25,32]. This may be achieved, at least for chikungunya and other non-endemic diseases, by means of preventive rather than reactive measures such as strengthening surveillance of imported cases, raising awareness in both travelers and general practitioners [13,33] and an integrated management of vector population [31,34].

It is relevant to highlight that this study has some limitations. First, all estimates are computed only from the analysis of notified cases, due to unavailable data on the total infected population. Likely, this has biased our results toward shorter reporting delays and an overestimation of the reduction in the probability that onward transmission can occur. In addition, the lack of information on the individual dates of infection and duration of infectiousness may have also led to an overestimation of the reduction in the number of infectious days at population level. Second, data on symptom onset was obtained for each case by interviews carried out during epidemiological investigations and longer reporting delays may correlate with an increased bias in the identification of the exact date of symptom onset. Third, the usefulness of the provided estimates is limited to the description of the 2017 Italian outbreak and might not apply to other settings or conditions. Nevertheless, these are the first estimates of reporting delays during a large exotic arbovirus outbreak in a temperate region.

The frequency of autochthonous transmission events of chikungunya and related arboviruses in Europe is likely to increase in the future due to the growing importation into European countries of infected travelers [35,36] and the progressive expansion of mosquito populations (e.g. Ae. albopictus) representing competent vectors for CHIKV transmission [32].

Early detection of imported chikungunya cases as well as the initial autochthonous transmission events is of the utmost importance to contain or even prevent the spread and size of any future chikungunya outbreak [23,31]. The aim of improving detection and notification timeliness can be achieved only by a sustained and coordinated effort involving many activities. For instance, it is essential not only to raise awareness on chikungunya infection in the general population and in individuals travelling to and from endemic countries but also provide information and training on diagnosis and reporting for medical practitioners. Moreover, medical practitioners should be supported by developing improved diagnostic algorithms as well as improving the information flow by minimizing the time delay between any response steps in the public health surveillance process. An important surveillance tool could be provided by syndromic surveillance where clearly defined sets of symptoms could be used to flag suspected transmission events. Also, novel data sources such as search generated data could be potentially integrated in the surveillance system in order to enhance the early detection of viral transmission. Another critical aspect in reducing reporting delay involves speeding up laboratory procedure both in national reference laboratories as well as in first-line responding hospital laboratories. This can be achieved by strengthening laboratory capability to face increased workload due to increased testing and by increasing laboratory detection capacity challenged by the paucity of available commercial kits, the cross-reactivity between related arboviruses affecting serology testing and the short viremia period. Finally, routine evaluation of reporting performances should be planned and routinely carried out to ensure the surveillance system preparedness and responsiveness.

In conclusion, our results strongly suggest that public health authorities should take actions to increase travelers’ awareness to potential health threats, set up early detection surveillance systems and plan the surveillance and management of the local vector population [37,38] to reduce the risk of autochthonous transmission and local outbreaks.

Supporting information

S1 Text. Supplementary information on the reporting system, control interventions and sensitivity analysis.

(PDF)

Data Availability

The data and code used in this article are available in Figshare, at https://dx.doi.org/10.6084/m9.figshare.23815071.

Funding Statement

The epidemiological investigation and data collection were funded by the Directorate of Health and Social Welfare, Lazio Region, and the Local Public Health Units, Lazio Region. INMI acknowledges the financial support for research on emerging pathogens by the Italian Ministry of Health, grants to Ricerca Corrente linea 1. GG and GM acknowledge that this study was partially funded by EU grant agreement No 874850 MOOD and is catalogued as MOOD 074. MM, AdT and BC acknowledge that this research was supported by EU funding within the MUR PNRR Extended Partnership initiative on Emerging Infectious Diseases (Project no. PE00000007, INF-ACT). The contents of this publication are the sole responsibility of the authors and don't necessarily reflect the views of the European Commission. AdT and RR acknowledge funding from PRIN2020: Tackling mosquitoes in Italy: from citizen to bench and back, Pto. N. 2020XYBN88. BC acknowledges that this project has received from University of Sapienza funding within Bando Ricerca 2022- Progetti diRicercaMedin. N. RM12218148E7F756. The funders had no role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Caputo B, Russo G, Manica M, Vairo F, Poletti P, Guzzetta G, et al. A comparative analysis of the 2007 and 2017 Italian chikungunya outbreaks and implication for public health response. Viennet E, editor. PLoS Negl Trop Dis. 2020;14: e0008159. doi: 10.1371/journal.pntd.0008159 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Cochet A, Calba C, Jourdain F, Grard G, Durand GA, Guinard A, et al. Autochthonous dengue in mainland France, 2022: geographical extension and incidence increase. Eurosurveillance. 2022;27. doi: 10.2807/1560-7917.ES.2022.27.44.2200818 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Lazzarini L, Barzon L, Foglia F, Manfrin V, Pacenti M, Pavan G, et al. First autochthonous dengue outbreak in Italy, August 2020. Eurosurveillance. 2020;25. doi: 10.2807/1560-7917.ES.2020.25.36.2001606 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Johnson N, Fernández de Marco M, Giovannini A, Ippoliti C, Danzetta M, Svartz G, et al. Emerging Mosquito-Borne Threats and the Response from European and Eastern Mediterranean Countries. Int J Environ Res Public Health. 2018;15: 2775. doi: 10.3390/ijerph15122775 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Ramírez AL, van den Hurk AF, Meyer DB, Ritchie SA. Searching for the proverbial needle in a haystack: advances in mosquito-borne arbovirus surveillance. Parasit Vectors. 2018;11: 320. doi: 10.1186/s13071-018-2901-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Jajosky RA, Groseclose SL. Evaluation of reporting timeliness of public health surveillance systems for infectious diseases. BMC Public Health. 2004;4: 29. doi: 10.1186/1471-2458-4-29 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Marinović AB, Swaan C, van Steenbergen J, Kretzschmar M. Quantifying Reporting Timeliness to Improve Outbreak Control. Emerg Infect Dis. 2015;21: 209–216. doi: 10.3201/eid2102.130504 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Schwartz O, Albert ML. Biology and pathogenesis of chikungunya virus. Nat Rev Microbiol. 2010;8: 491–500. doi: 10.1038/nrmicro2368 [DOI] [PubMed] [Google Scholar]
  • 9.Rosenberg R. Threat from Emerging Vectorborne Viruses. Emerg Infect Dis. 2016;22: 910–911. doi: 10.3201/eid2205.160284 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Caputo B, Manica M, Russo G, Solimini A. Knowledge, Attitude and Practices towards the Tiger Mosquito Aedes Albopictus. A Questionnaire Based Survey in Lazio Region (Italy) before the 2017 Chikungunya Outbreak. Int J Environ Res Public Health. 2020;17: 3960. doi: 10.3390/ijerph17113960 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.European Centre for Disease Prevention and Control. Factsheet about chikungunya. Available: https://www.ecdc.europa.eu/en/chikungunya/facts/factsheet
  • 12.World Health Organization. Chikungunya factsheet. 8 Dec 2022. Available: https://www.who.int/news-room/fact-sheets/detail/chikungunya [Google Scholar]
  • 13.Russo G, Caputo B, Di Lascio A, Gatto G, Solimini A. Awareness towards Chikungunya virus infection risk by general practitioners in Rome: a questionnaire based survey before the 2017 outbreak. Infect Dis Trop Med. 2018;4: e451. [Google Scholar]
  • 14.Vairo F, Mammone A, Lanini S, Nicastri E, Castilletti C, Carletti F, et al. Local transmission of chikungunya in Rome and the Lazio region, Italy. Roques P, editor. PLOS ONE. 2018;13: e0208896. doi: 10.1371/journal.pone.0208896 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Riccardo F, Venturi G, Di Luca M, Del Manso M, Severini F, Andrianou X, et al. Secondary Autochthonous Outbreak of Chikungunya, Southern Italy, 2017. Emerg Infect Dis. 2019;25: 2093–2095. doi: 10.3201/eid2511.180949 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.European Centre for Disease Prevention and Control. Clusters of autochthonous chikungunyacases in Italy, 14 September 2017. Stockholm: ECDC; 2017. Available: https://www.ecdc.europa.eu/sites/default/files/documents/14-Sep-2017-RRA-Chikungunya-Italy-revised.pdf
  • 17.Venturi G, Di Luca M, Fortuna C, Remoli ME, Riccardo F, Severini F, et al. Detection of a chikungunya outbreak in Central Italy, August to September 2017. Eurosurveillance. 2017;22. doi: 10.2807/1560-7917.ES.2017.22.39.17-00646 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Venturi G, Fabiani M, Amendola A, Marsili G, Benedetti E, Fiorentini C, et al. Lack of Evidence of Chikungunya Virus Infection among Blood Donors during the Chikungunya Outbreak in Lazio Region, Italy, 2017. Viruses. 2022;14: 619. doi: 10.3390/v14030619 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.European Centre for Disease Prevention and Control. Clusters of autochthonous chikungunya cases in Italy, first update– 9 October 2017. Stockholm: ECDC; 2017. Available: https://www.ecdc.europa.eu/sites/default/files/documents/RRA-chikungunya-Italy-update-9-Oct-2017.pdf
  • 20.Vairo F, Di Pietrantonj C, Pasqualini C, Mammone A, Lanini S, Nicastri E, et al. The Surveillance of Chikungunya Virus in a Temperate Climate: Challenges and Possible Solutions from the Experience of Lazio Region, Italy. Viruses. 2018;10: 501. doi: 10.3390/v10090501 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Ministry of Health. Italian National plan for the surveillance and control of Chikungunya, Dengue and Zika 2017. Ministry of Health; Available: http://www.salute.gov.it/portale/news/p3_2_1_1_1.jsp?lingua=italiano&menu=notizie&p=dalministero&id=3013 [Google Scholar]
  • 22.Therneau TM, Grambsch PM. Modeling survival data: extending the Cox model. New York: Springer; 2000. [Google Scholar]
  • 23.Cauchemez S, Ledrans M, Poletto C, Quenel P, De Valk H, Colizza V, et al. Local and regional spread of chikungunya fever in the Americas. Eurosurveillance. 2014;19. doi: 10.2807/1560-7917.es2014.19.28.20854 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Beltrame A, Angheben A, Bisoffi Z, Monteiro G, Marocco S, Calleri G, et al. Imported Chikungunya Infection, Italy. Emerg Infect Dis. 2007;13: 1264–1266. doi: 10.3201/eid1308.070161 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Jourdain F, de Valk H, Noël H, Paty M-C, L’Ambert G, Franke F, et al. Estimating chikungunya virus transmission parameters and vector control effectiveness highlights key factors to mitigate arboviral disease outbreaks. Rodo X, editor. PLoS Negl Trop Dis. 2022;16: e0010244. doi: 10.1371/journal.pntd.0010244 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Summer Fever Study Group, Gobbi F, Capelli G, Angheben A, Giobbia M, Conforto M, et al. Human and entomological surveillance of West Nile fever, dengue and chikungunya in Veneto Region, Italy, 2010–2012. BMC Infect Dis. 2014;14: 60. doi: 10.1186/1471-2334-14-60 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Trentini F, Poletti P, Baldacchino F, Drago A, Montarsi F, Capelli G, et al. The containment of potential outbreaks triggered by imported Chikungunya cases in Italy: a cost utility epidemiological assessment of vector control measures. Sci Rep. 2018;8: 9034. doi: 10.1038/s41598-018-27443-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Moro ML, Rezza G, Grilli E, Angelini R, Macini P, Spataro N, et al. Chikungunya Virus in North-Eastern Italy: A Seroprevalence Survey. Am J Trop Med Hyg. 2010;82: 508–511. doi: 10.4269/ajtmh.2010.09-0322 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Sochacki T, Jourdain F, Perrin Y, Noel H, Paty M-C, de Valk H, et al. Imported chikungunya cases in an area newly colonised by Aedes albopictus: mathematical assessment of the best public health strategy. Eurosurveillance. 2016;21. doi: 10.2807/1560-7917.ES.2016.21.18.30221 [DOI] [PubMed] [Google Scholar]
  • 30.Marini G, Guzzetta G, Marques Toledo CA, Teixeira M, Rosà R, Merler S. Effectiveness of Ultra-Low Volume insecticide spraying to prevent dengue in a non-endemic metropolitan area of Brazil. Lloyd-Smith J, editor. PLOS Comput Biol. 2019;15: e1006831. doi: 10.1371/journal.pcbi.1006831 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Guzzetta G, Vairo F, Mammone A, Lanini S, Poletti P, Manica M, et al. Spatial modes for transmission of chikungunya virus during a large chikungunya outbreak in Italy: a modeling analysis. BMC Med. 2020;18: 226. doi: 10.1186/s12916-020-01674-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Jourdain F, Roiz D, de Valk H, Noël H, L’Ambert G, Franke F, et al. From importation to autochthonous transmission: Drivers of chikungunya and dengue emergence in a temperate area. Lambrechts L, editor. PLoS Negl Trop Dis. 2020;14: e0008320. doi: 10.1371/journal.pntd.0008320 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Le Tyrant M, Bley D, Leport C, Alfandari S, Guégan J-F. Low to medium-low risk perception for dengue, chikungunya and Zika outbreaks by infectious diseases physicians in France, Western Europe. BMC Public Health. 2019;19: 1014. doi: 10.1186/s12889-019-7317-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Schwab SR, Stone CM, Fonseca DM, Fefferman NH. The importance of being urgent: The impact of surveillance target and scale on mosquito-borne disease control. Epidemics. 2018;23: 55–63. doi: 10.1016/j.epidem.2017.12.004 [DOI] [PubMed] [Google Scholar]
  • 35.Dudouet P, Gautret P, Larsen CS, Díaz-Menéndez M, Trigo E, von Sonnenburg F, et al. Chikungunya resurgence in the Maldives and risk for importation via tourists to Europe in 2019–2020: A GeoSentinel case series. Travel Med Infect Dis. 2020;36: 101814. doi: 10.1016/j.tmaid.2020.101814 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Javelle E, Florescu S-A, Asgeirsson H, Jmor S, Eperon G, Leshem E, et al. Increased risk of chikungunya infection in travellers to Thailand during ongoing outbreak in tourist areas: cases imported to Europe and the Middle East, early 2019. Eurosurveillance. 2019;24. doi: 10.2807/1560-7917.ES.2019.24.10.1900146 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Jourdain F, Samy AM, Hamidi A, Bouattour A, Alten B, Faraj C, et al. Towards harmonisation of entomological surveillance in the Mediterranean area. Yakob L, editor. PLoS Negl Trop Dis. 2019;13: e0007314. doi: 10.1371/journal.pntd.0007314 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Bellini R, Michaelakis A, Petrić D, Schaffner F, Alten B, Angelini P, et al. Practical management plan for invasive mosquito species in Europe: I. Asian tiger mosquito (Aedes albopictus). Travel Med Infect Dis. 2020;35: 101691. doi: 10.1016/j.tmaid.2020.101691 [DOI] [PubMed] [Google Scholar]
PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0011610.r001

Decision Letter 0

Justin V Remais, Ran Wang

20 Jun 2023

Dear Dr. Manica,

Thank you very much for submitting your manuscript "Reporting delays of chikungunya cases during the 2017 outbreak in Lazio region, Italy." for consideration at PLOS Neglected Tropical Diseases. As with all papers reviewed by the journal, your manuscript was reviewed by members of the editorial board and by several independent reviewers. In light of the reviews (below this email), we would like to invite the resubmission of a significantly-revised version that takes into account the reviewers' comments.

We cannot make any decision about publication until we have seen the revised manuscript and your response to the reviewers' comments. Your revised manuscript is also likely to be sent to reviewers for further evaluation.

When you are ready to resubmit, please upload the following:

[1] A letter containing a detailed list of your responses to the review comments and a description of the changes you have made in the manuscript. Please note while forming your response, if your article is accepted, you may have the opportunity to make the peer review history publicly available. The record will include editor decision letters (with reviews) and your responses to reviewer comments. If eligible, we will contact you to opt in or out.

[2] Two versions of the revised manuscript: one with either highlights or tracked changes denoting where the text has been changed; the other a clean version (uploaded as the manuscript file).

Important additional instructions are given below your reviewer comments.

Please prepare and submit your revised manuscript within 60 days. If you anticipate any delay, please let us know the expected resubmission date by replying to this email. Please note that revised manuscripts received after the 60-day due date may require evaluation and peer review similar to newly submitted manuscripts.

Thank you again for your submission. We hope that our editorial process has been constructive so far, and we welcome your feedback at any time. Please don't hesitate to contact us if you have any questions or comments.

Sincerely,

Ran Wang, M.D.

Academic Editor

PLOS Neglected Tropical Diseases

Justin Remais

Section Editor

PLOS Neglected Tropical Diseases

***********************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: The methods are appropriate for the analyses conducted. Specific clarifications are noted:

1. To help understand the presented information on timing of infection reporting relative to outbreak detection it would be useful for readers to understand some of the details of the reporting system or systems used in different regions of Italy. Is chikungunya infection reporting mandatory? Please describe the SERESMI reporting system so persons outside Italy can better appreciate the context. Who reports the case information and what are the details of the information which are requested?

2. On page 11, the authors state that notification of infection can lead to a reduction in infectious days. Could the authors clarify what is meant here? Is this the cumulative infectious because of the presumed impact of case recognition on the overall number of cases infected? For each infected individual there would be no change/reduction in the infectious days, but at the population level there could be.

3. The assumption that the symptomatic period and infectious period overlap may not be correct. In most situations the infectious period would precede the infectious period and then seroconversion and reduced infectiousness would be evident during the most symptomatic phase of infection.

Reviewer #2: The study has a clearly articulated hypothesis with subsequent analysis that adequately tests that hypothesis. The population studies is clearly described, and the samples used in analysis are aa comprehensive ans inclusive as possible given reporting limitations. The paper in its current form sufficiently answers the research question.

Reviewer #3: 1. Reporting delay can be the result of patients delaying their presenting for care, especially when the symptoms are mild, or delay in sending the specimens for testing or delay in the laboratory sending the results back to the patient and the health provider. It is also not known how the results gets reported to the surveillance system. It would be useful if the authors can briefly describe how the outbreak emerged, how the cases are detected (from the surveillance system or from clinicians in the community or both) and what is involved in cases processing from suspect cases to probable and confirmed cases (was testing done at surveillance sites or were specimens transported to laboratories?) and how the cases are reported to the surveillance system?

2. What were the criteria for establishing Sept 6 2017 as the “date of first notification”? was it based on a cluster of confirmed cases? What measures were put into place once an outbreak is officially declared? Were family members of cases tested for additional case finding?

3. Vector Control: Since there is no treatment or vaccines for Chikungunya, prevention and control interventions generally rely on case-based interventions (mosquito spraying and other vector control measures around the residence of cases)., the proportion of asymptomatic but infectious individuals in a community would have a varying impact on the effectiveness of the outbreak response. Were community-wide spraying of public spaces part of the vector control in addition to interventions around the place of residence of notified cases?

--------------------

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: The results align with the planned analysis and no deficiencies are noted. Figures are appropriate. Supplemental figures are not included and could not be reviewed.

Reviewer #2: Results are completely presented and figures clear and aesthetically pleasing.

Reviewer #3: The results are clearly presented and the figures are of sufficient quality for clarity.

--------------------

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: The conclusions are appropriate and supported by the data. The most relevant limitations are clearly stated.

The primary deficiency is that specific recommendations on how to improve the process or timeliness of infection reporting in Italy are not provided. This additional specificity would improve the practical relevance of the analysis and findings.

Reviewer #2: The conclusions are supported by the results and the authors provide helpful context that help the reader appreciate the public health significance of the findings.

Reviewer #3: The discussion is good but it is not clear how the authors presented the quantitation of the health burden. what is the definition of health burden and how was that quantitated?

What are the limitations of their study - did they provide readers with a better understanding of reporting delays and how that impacted the final health burden of this outbreak compared to previous studies?

Line 275: What is meant by,” …..and the short radius of treatment compared to the potential distribution of transmission distances”? treatment? Please explain.

--------------------

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: Page 5, Line 147 – dichotomous rather than dichomotic

Page 6, Line 161 – truncated rather than truncate

Page 11, Line 236 – ‘the symptomatic period’ rather than symptom

Reviewer #2: Line 76 - chikungunya should be decapitalized for consistency internally and with the existing literature

Line 153 - analysis should read analyses

Line 180 - figure caption shoukd state “events” rather than “evens”

Reviewer #3: (No Response)

--------------------

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: The supplemental materials do not appear available to review and so were not reviewed.

Reviewer #2: This study answers an important epidemiological question using rigorous methods. The results are presented in a clear manner, elucidating important findings without overstating. The paper provides helpful insight that can help the scientific community better understand the ramifications of public health campagins during disease outbreaks.

Reviewer #3: This manuscript describes a study to quantify reporting delays of cases and assess the impact of these delays on the final health burden during an outbreak of Chikungunya in Italy. Reporting delays of infectious disease outbreaks have major impact on the development and implementation of disease prevention and control strategies. Hence this type of study should be a high priority during inter-epidemic periods to inform how surveillance and health systems should be optimised for managing future outbreaks. The aims are clearly stated and the methods and results are well described. However, there is insufficient information on aspects of the outbreak and the control strategies for readersts to interpret the results and draw conclusions.

Figure Files:

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email us at figures@plos.org.

Data Requirements:

Please note that, as a condition of publication, PLOS' data policy requires that you make available all data used to draw the conclusions outlined in your manuscript. Data must be deposited in an appropriate repository, included within the body of the manuscript, or uploaded as supporting information. This includes all numerical values that were used to generate graphs, histograms etc.. For an example see here: http://www.plosbiology.org/article/info%3Adoi%2F10.1371%2Fjournal.pbio.1001908#s5.

Reproducibility:

To enhance the reproducibility of your results, we recommend that you deposit your laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols

PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0011610.r003

Decision Letter 1

Justin V Remais, Ran Wang

22 Aug 2023

Dear Dr. Manica,

We are pleased to inform you that your manuscript 'Reporting delays of chikungunya cases during the 2017 outbreak in Lazio region, Italy.' has been provisionally accepted for publication in PLOS Neglected Tropical Diseases.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

Should you, your institution's press office or the journal office choose to press release your paper, you will automatically be opted out of early publication. We ask that you notify us now if you or your institution is planning to press release the article. All press must be co-ordinated with PLOS.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Ran Wang, M.D.

Academic Editor

PLOS Neglected Tropical Diseases

Justin Remais

Section Editor

PLOS Neglected Tropical Diseases

***********************************************************

Reviewer's Responses to Questions

Key Review Criteria Required for Acceptance?

As you describe the new analyses required for acceptance, please consider the following:

Methods

-Are the objectives of the study clearly articulated with a clear testable hypothesis stated?

-Is the study design appropriate to address the stated objectives?

-Is the population clearly described and appropriate for the hypothesis being tested?

-Is the sample size sufficient to ensure adequate power to address the hypothesis being tested?

-Were correct statistical analysis used to support conclusions?

-Are there concerns about ethical or regulatory requirements being met?

Reviewer #1: The authors have responded to the comments of the reviewers and have improved the reporting of the methods.

Reviewer #3: The revised method section is now much clearer.

**********

Results

-Does the analysis presented match the analysis plan?

-Are the results clearly and completely presented?

-Are the figures (Tables, Images) of sufficient quality for clarity?

Reviewer #1: Yes, the results match the analysis.

Reviewer #3: The results now make more sense as the authors have provided more information on the how the surveillance and notification system works.

**********

Conclusions

-Are the conclusions supported by the data presented?

-Are the limitations of analysis clearly described?

-Do the authors discuss how these data can be helpful to advance our understanding of the topic under study?

-Is public health relevance addressed?

Reviewer #1: The conclusions are appropriate for the data.

Reviewer #3: The conclusions are supported by the data presented and the limitations of the study have been described. The findings of this study have important public health implcations and the authors have made that clear.

**********

Editorial and Data Presentation Modifications?

Use this section for editorial suggestions as well as relatively minor modifications of existing data that would enhance clarity. If the only modifications needed are minor and/or editorial, you may wish to recommend “Minor Revision” or “Accept”.

Reviewer #1: I have not reviewed this version of the manuscript for minor revisions. Those indicated previously have been addressed by the authors.

Reviewer #3: none required.

**********

Summary and General Comments

Use this section to provide overall comments, discuss strengths/weaknesses of the study, novelty, significance, general execution and scholarship. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. If requesting major revision, please articulate the new experiments that are needed.

Reviewer #1: The manuscript is a valuable contribution to the literature.

Reviewer #3: The authors have addressed all the reviewers' concerns. The methods, results and discussion sections are now much clearer and more informative. I recommend this paper for publication.

PLoS Negl Trop Dis. doi: 10.1371/journal.pntd.0011610.r004

Acceptance letter

Justin V Remais, Ran Wang

31 Aug 2023

Dear Dr. Manica,

We are delighted to inform you that your manuscript, "Reporting delays of chikungunya cases during the 2017 outbreak in Lazio region, Italy.," has been formally accepted for publication in PLOS Neglected Tropical Diseases.

We have now passed your article onto the PLOS Production Department who will complete the rest of the publication process. All authors will receive a confirmation email upon publication.

The corresponding author will soon be receiving a typeset proof for review, to ensure errors have not been introduced during production. Please review the PDF proof of your manuscript carefully, as this is the last chance to correct any scientific or type-setting errors. Please note that major changes, or those which affect the scientific understanding of the work, will likely cause delays to the publication date of your manuscript. Note: Proofs for Front Matter articles (Editorial, Viewpoint, Symposium, Review, etc...) are generated on a different schedule and may not be made available as quickly.

Soon after your final files are uploaded, the early version of your manuscript will be published online unless you opted out of this process. The date of the early version will be your article's publication date. The final article will be published to the same URL, and all versions of the paper will be accessible to readers.

Thank you again for supporting open-access publishing; we are looking forward to publishing your work in PLOS Neglected Tropical Diseases.

Best regards,

Shaden Kamhawi

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Paul Brindley

co-Editor-in-Chief

PLOS Neglected Tropical Diseases

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Text. Supplementary information on the reporting system, control interventions and sensitivity analysis.

    (PDF)

    Attachment

    Submitted filename: Response_reviewers.docx

    Data Availability Statement

    The data and code used in this article are available in Figshare, at https://dx.doi.org/10.6084/m9.figshare.23815071.


    Articles from PLOS Neglected Tropical Diseases are provided here courtesy of PLOS

    RESOURCES