Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2023 Oct 20;18(10):e0292346. doi: 10.1371/journal.pone.0292346

Key performance indicators of COVID-19 contact tracing in Belgium from September 2020 to December 2021

Cécile Kremer 1,*,#, Lander Willem 2,3,#, Jorden Boone 4, Wouter Arrazola de Oñate 5,6, Naïma Hammami 7, Christel Faes 1, Niel Hens 1,2
Editor: Tomohiko Ai8
PMCID: PMC10588862  PMID: 37862313

Abstract

The goal of tracing, testing, and quarantining contacts of infected individuals is to contain the spread of infectious diseases, a strategy widely used during the COVID-19 pandemic. However, limited research exists on the effectiveness of contact tracing, especially with regard to key performance indicators (KPIs), such as the proportion of cases arising from previously identified contacts. In our study, we analyzed contact tracing data from Belgium collected between September 2020 and December 2021 to assess the impact of contact tracing on SARS-CoV-2 transmission and understand its characteristics. Among confirmed cases involved in contact tracing in the Flemish and Brussels-Capital regions, 19.1% were previously identified as close contacts and were aware of prior exposure. These cases, referred to as ‘known’ to contact tracing operators, reported on average fewer close contacts compared to newly identified individuals (0.80 versus 1.05), resulting in fewer secondary cases (0.23 versus 0.28). Additionally, we calculated the secondary attack rate, representing infections per contact, which was on average lower for the ‘known’ cases (0.22 versus 0.25) between December 2020 and August 2021. These findings indicate the effectiveness of contact tracing in Belgium in reducing SARS-CoV-2 transmission. Although we were unable to quantify the exact number of prevented cases, our findings emphasize the importance of contact tracing as a public health measure. In addition, contact tracing data provide indications of potential shifts in transmission patterns among different age groups associated with emerging variants of concern and increasing vaccination rates.

Introduction

Coronavirus disease 2019 (COVID-19), caused by the severe acute respiratory syndrome coronavirus 2 (SARS-CoV-2), emerged in December 2019 and led to a global cumulative number of confirmed cases of more than 598 million and a cumulative number of reported deaths over 6.4 million at the end of August 2022 [1]. To maintain the healthcare system, non-pharmaceutical interventions (NPIs) have been adopted during the pandemic in many countries. In the philosophy of having person-tailored quarantine measures, COVID-19 contact tracing was implemented in several countries. Active case finding and swift contact tracing have been effective for tuberculosis prevention and early treatment for many years [2, 3]. However, the scale required for COVID-19 was unprecedented in many European countries. Effective contact tracing can, when carried out quickly, prevent onward transmission from newly infected individuals and their possibly infected contacts [4]. Hence timely notification of possible exposure to SARS-CoV-2 is essential to break transmission chains, as indicated by several mathematical modeling studies investigating the impact of contact tracing [59]. However, there is a need for empirical studies on the effectiveness of contact tracing [10, 11].

In the absence of a reference period or region, it is not trivial to quantify the effectiveness of contact tracing in terms of the number of cases and deaths averted [12]. However, the potential impact of contact tracing on onward transmission can be evaluated using several key performance indicators (KPIs). The European Center for Disease Control (ECDC) and the World Health Organization (WHO) have proposed the proportion of new cases arising from known contacts as an indication of the quality and completeness of the contact tracing system, by pointing out the capacity of the system to identify all potential cases [13, 14]. As such, a higher proportion of cases that were previously identified as contact indicates that more individuals at risk of infection are reached by contact tracing. Other KPIs include delay distributions, such as the time between the onset of symptoms, clinical tests, and quarantining exposed contacts of an index case. Contact tracing also enhances active surveillance and provides unique data to estimate transmission characteristics, such as secondary attack rates, risk factors associated with infection, and important parameters that determine the speed at which a virus is spreading.

In this study, we used contact tracing data from Belgium (Flemish and Brussels-Capital region) collected between September 2020 and December 2021 to investigate (1) the proportion of all confirmed SARS-CoV-2 cases that were previously traced as a high- or low-risk contact, i.e. ‘known’ cases, (2) the number of traced contacts for ‘known’ and ‘new’ cases, (3) the number of potential secondary cases for ‘known’ and ‘new’ cases, (4) the ratio of potential infections over contacts, i.e. secondary attack rate, and (5) delay distributions. In addition, we investigated social contact and transmission patterns based on these data.

Materials and methods

Description of the contact tracing system

On 7 May 2020, the Flemish Government’s Department of Care started with large-scale contact tracing in order to identify risk contacts of confirmed SARS-CoV-2 cases and alert them of possible exposure to the virus. This coincided with the deconfinement of several restrictive measures from the first lockdown in Belgium. An index case was defined as a confirmed case whose detection initiated a contact tracing event. Index cases were queried about any contacts that occurred from within the two days before symptom onset, or within the two days before their positive SARS-CoV-2 test result in case of no symptoms. Inquiries were made via telephone by call agents at centralized locations. Contacts reported by index cases were classified as high- or low-risk. High-risk contacts (HRC) were defined as physical contacts, or non-physical contacts with a duration of more than 15 minutes within a 1.5 m distance without correct use of face masks. Other contacts not meeting these conditions were deemed low-risk contacts (LRC). Testing and quarantine measures for HRC varied throughout the study period, and LRC were instructed to heighten their vigilance and undergo testing if they exhibited any symptoms [15].

Interview data from the confirmed COVID-19 cases contained demographic information, an encrypted national registry number (NRN), the number of unique persons that an index case had met in the last 48 hours before their positive test or symptom onset (i.e. reported contacts), the number of reported contacts that were registered in the contact tracing database (i.e. registered contacts), and information on the registered contacts that were effectively reached by the contact tracing (i.e. traced contacts). Registered contacts that could not be reached and incomplete contact information hampered the number of contacts traced. Additionally, contacts that were reported by more than one index case were only registered once. Household members who were already in quarantine or isolation were usually not registered as contacts to trace. Note that these two exclusions were adopted during an update of the contact tracing protocol early in the study period, resulting in not all reported contacts being registered. Reported contacts for which no name could be provided were also not registered. Interview data for LRC and HRC included demographic data and an encrypted NRN. The latter allowed us to identify ‘known’ index cases after testing positive. If the NRN was missing, contacts were excluded from the analyses. Contacts that could not be linked to an index case due to missing information (e.g. when the reported index case is not a resident of the included regions) were excluded from the analyses. If contacts were linked to the same index case more than once, the duplicated information was removed. In collectivities such as hospitals, schools, and nursing homes, only individual contacts occurring outside these settings were available. Contacts occurring within a collectivity were followed up by the responsible medical services, these data were not available to us and hence not included in our study.

In the fall of 2020, Belgium experienced a severe second wave of COVID-19 during which the test capacity was under great pressure, resulting in a temporary change in the test strategy. The workload for the contact tracing also increased, and as a result only index cases were called during that time, whereas HRC were informed via text message. More specifically, between 16 October and 2 November 2020, text messages were sent to most HRC, while LRC were not traced at all. As a consequence, the NRN was not recorded for most HRC and LRC and it was not possible to identify these contacts as ‘known’ index cases during September–November 2020. After the summer of 2021, the contact tracing strategy changed to an approach where index cases who had attended some sort of gathering were queried in more detail when there was at least one other index linked to the same gathering or when the index case mentioned they did not know the personal details of their risk contacts. During this period, individuals attending the same gathering were classified as HRC in case the attack rate was high.

Key performance indicators (KPIs)

One of the KPIs for contact tracing according to ECDC and WHO is the proportion of new cases arising from known contacts [13, 14]. These cases have previously received information regarding their potential exposure to the virus, as well as information on testing and quarantine, and we defined them as ‘known’ index cases. In contrast, we defined ‘new’ index cases as individuals that tested positive for SARS-CoV-2 but were not previously identified as a risk contact. We investigated differences between these ‘new’ and ‘known’ index cases in terms of the number of traced contacts and secondary cases, in order to describe the impact of contact tracing on onward transmission. Due to the lack of reliable household information for the entire study period, we did not initially make a distinction between household and non-household contacts. Since the end of May 2021, the identifier for traced HRC included an indicator of household status. Therefore, for the period from June 2021 to December 2021, we can divide HRC into household and non-household contacts. Delay distributions were constructed to investigate how quickly contact tracing was performed. The time between the index case receiving their positive test result and getting contacted by the tracing system gives an indication of how quickly the contact tracing system operated. To assess the intervention as a whole, we also calculated the delay between symptom onset of an index case and its SARS-CoV-2 test, as well as between symptom onset and the receipt of the result of that test, which gives an indication of how quickly individuals are tested after showing symptoms and how quickly the test results are available.

Contact and transmission patterns

Based on the available data sources, we constructed a contact line list in which each traced contact with known NRN was linked to their index case. A transmission line list was conceived by linking infected contacts to their reported index case if positive tests occurred in a 21-day time span, assuming that transmission could have occurred in either direction [16]. If infection of an HRC or LRC was confirmed more than 21 days before or after their index case, transmission between these individuals was deemed very unlikely and the pair was only kept in the contact line list. We had no information on whether non-positive contacts tested negative or were not tested at all. Sequencing information was available to identify variants of concern (VoC) for a limited number of cases. When sequencing information was available for both individuals in a potential transmission pair, but different VoCs were identified, this pair was removed from the transmission line list.

To investigate contact patterns and transmission dynamics over time, age-specific matrices were constructed. We assumed that transmission would have occurred from index to contact. Contact matrices represent the number of contacts between an index in age group i and a contact in age group j, divided by the total number of index cases in age group i. The transmission matrices represent the number of infections in age group j that can be linked to an index case in age group i, divided by the total number of infections in age group j. Since only limited sequencing information was available, we analyzed contact and transmission matrices for specific months during which each VoC was the dominant circulating strain [17]. In December 2020, there was no circulation of a VoC yet. In April and July 2021, there was circulation of the Alpha and Delta VoC, respectively. The Omicron VoC started circulating in Belgium in December 2021, though it did not yet dominate the Delta VoC [17].

Another important transmission characteristic is the serial interval, defined as the time between symptom onset in the index case and symptom onset in their secondary case, which gives an indication of the speed of transmission. We calculated the serial interval over time as the monthly moving average by date of the positive test of the index case (i.e. forward serial interval), assuming that the index case was the source of infection and randomly selecting one index case when there were multiple possibilities. Individuals for whom the timing of symptom onset was not available, because they did not report it or were asymptomatic, were excluded from this calculation. The serial interval was restricted to lie within the biologically plausible interval of -5 to 21 days [18].

Ethical approval

This study has been approved by the Flemish Government’s Department of Care (GE0–1GDF2IA-WT/1GD305/20069780). It was carried out in accordance with international ethical standards (Declaration of Helsinki 1964). It was conducted in accordance with the General Data Protection Regulation (GDPR) and a data processing agreement was concluded between the Flemish Government’s Department of Care and the Universities of Antwerp and Hasselt. All personal data were encrypted by the Flemish Government’s Department of Care before being made available for analysis.

Results

Data extracted on 25 May 2022 included 1,004,694 index cases (987,210 unique individuals) identified between September 2020 and December 2021 (S1 Fig, S1 Table). We were able to link 1,092,985 traced contacts (917,102 unique individuals) to 416,645 unique index cases. In the remainder of this work, we will focus on HRC, since these make up the majority of traced contacts (94.9%). Among the index cases for which at least one HRC was registered in the tracing system, the average number of registered HRC was 2.8 (IQR 1—4). Overall, 76.4% of the registered HRC were effectively traced (S2 Fig). Among index cases linked to at least one traced HRC, the average number of traced HRC was 2.5 (IQR 1—3). During the period from June 2021 to December 2021, 46.6% of all traced HRC were defined as household contacts. For about 30% of the traced HRC, the NRN was missing, resulting in a substantial part of traced HRC that could not be included in these analyses. Furthermore, 1.5% of the traced HRC were linked more than once to the same index case, 8% were linked to an index case without a known identifier, and 3% were linked to an index case not included in the available data.

‘Known’ index cases

From September 2020 to December 2021, 19.1% of all index cases had been previously identified as a risk contact (i.e. ‘known’ index cases), of which 96.7% as HRC. Starting at less than 10% during September–November 2020, the proportion of ‘known’ index cases fluctuated around 20% for the remaining study period, being highest (24.8%) during May–June 2021 and lowest (18.9%) during July–August 2021 (Fig 1a, Table 1). The proportion of ‘known’ index cases was highest among 0–17 year-olds and lowest among those above 65 years old. Changes in the proportion of ‘known’ index cases over time followed a similar trend within each age group (S3 Fig).

Fig 1. Evolution of key performance indicators.

Fig 1

Evolution in the (a) proportion of index cases that were previously identified as a risk contact, (b) average number of traced high-risk contacts (HRC) for ‘new’ and ‘known’ index cases, (c) average number of secondary cases for ‘new’ and ‘known’ index cases, and (d) secondary attack rate (SAR) among traced HRC of ‘new’ and ‘known’ index cases. Vertical bars represent the 95% confidence interval.

Table 1. Key performance indicators.

Mean and 95% confidence interval over time. Bold notation indicates a significant difference between ‘known’ and ‘new’ index cases.

Sep-Nov 2020 Dec 2020—Feb 2021 Mar-Apr 2021 May-Jun 2021 Jul-Aug 2021 Sep-Oct 2021 Nov-Dec 2021
Proportion of ‘known’ index cases 0.081 (0.079—0.082) 0.213 (0.210—0.215) 0.230 (0.228—0.232) 0.248 (0.244—0.251) 0.189 (0.186—0.192) 0.215 (0.213—0.218) 0.215 (0.213—0.216)
Average number of traced HRC
‘Known’ index 0.556 (0.535—0.578) 0.581 (0.566—0.596) 0.610 (0.596—0.624) 0.706 (0.682—0.729) 0.916 (0.886—0.947) 1.083 (1.058—1.107) 0.906 (0.896—0.917)
‘New’ index 0.678 (0.671—0.686) 1.196 (1.185—1.208) 1.219 (1.208—1.230) 1.405 (1.386—1.425) 1.260 (1.243—1.277) 1.465 (1.450—1.481) 0.945 (0.939—0.951)
Average number of secondary cases
‘Known’ index 0.116 (0.110—0.123) 0.159 (0.152—0.165) 0.171 (0.165—0.177) 0.170 (0.161—0.179) 0.166 (0.157—0.175) 0.267 (0.258—0.276) 0.323 (0.318—0.329)
‘New’ index 0.128 (0.126—0.130) 0.327 (0.322—0.332) 0.375 (0.370—0.380) 0.346 (0.338—0.354) 0.253 (0.247—0.258) 0.332 (0.327—0.338) 0.291 (0.289—0.294)
SAR among traced HRC
‘Known’ index 0.185 (0.176—0.195) 0.244 (0.236—0.252) 0.245 (0.237—0.252) 0.212 (0.203—0.222) 0.160 (0.152—0.167) 0.227 (0.221—0.233) 0.335 (0.331—0.340)
‘New’ index 0.175 (0.173—0.177) 0.256 (0.253—0.259) 0.290 (0.288—0.293) 0.233 (0.229—0.236) 0.186 (0.183—0.189) 0.213 (0.210—0.215) 0.289 (0.287—0.291)

High-risk contacts

Index cases that were not previously identified as a risk contact (i.e. ‘new’ index cases) were associated with a significantly higher average number of traced HRC compared to ‘known’ index cases (Fig 1b, Table 1). A drop in the number of traced HRC is observed during November–December 2021, with a smaller but still significant difference between ‘known’ and ‘new’ index cases during that period. In general, the average number of traced HRC was higher for ‘new’ index cases regardless of household status, although the difference with ‘known’ index cases was less pronounced for household HRC (S4 Fig).

Secondary cases and SAR

The average number of secondary cases was relatively stable for ‘known’ index cases until September 2021, and significantly lower compared to the number of secondary cases linked to ‘new’ index cases (Fig 1c, Table 1). In addition to the absolute number of secondary cases, we also compared the secondary attack rate (SAR), representing the number of secondary cases among all contacts. For contacts that could be linked to multiple index cases (13.7% of all HRC), we randomly selected one index case when calculating the SAR. The SAR was significantly higher for ‘new’ index cases from December 2020 until August 2021 (Fig 1d, Table 1). Although the number of traced HRC in the household remained relatively stable over time, an increase was observed in the number of secondary cases and SAR for household contacts (S4 Fig).

Of the 189,900 index cases contacted between September and November 2020, 8.1% had previously been identified as a risk contact. This proportion increased between 1 September and 12 October, after which it decreased until its lowest point around 31 October 2020 before increasing again. During the period around 31 October 2020, there was no substantial difference in the number of traced HRC and secondary cases between ‘known’ and ‘new’ index cases, while it was observed that ‘known’ index cases were associated with fewer HRC and secondary cases for the remaining period (S5 Fig).

Delay distributions

The average time between receiving the positive test result and being contacted by the tracing system was 1.3 days, with 90% of index cases being contacted within 3 days of their test result. The time between positive test and tracing increased between November 2020 and March 2021 compared to the remaining study period (Fig 2). For symptomatic index cases (data available from November 2020 onward), the average time between symptom onset and taking a SARS-CoV-2 test was 2.3 days, with 90% of the index cases tested within 5 days after symptom onset. The average time between symptom onset and their positive test result was 2.9 days, with 90% of the index cases receiving their test results within 6 days after symptom onset. These delays were fairly stable throughout the investigated period (Fig 2).

Fig 2. Delay distributions.

Fig 2

Delay distributions for the time between index symptom onset and test collection (black), between index symptom onset and test result (red), and between positive test index and the call from the tracing center (green).

Contact and transmission patterns

Fig 3 shows the age-specific contact and transmission matrices for December 2020, April 2021, July 2021, and December 2021. During each period, we observed an assortative relation in both the contact and transmission matrices, i.e. most contacts and transmission occurred within age groups. In July 2021, the average number of contacts between individuals aged 20 to 29 years was highest, which is also reflected in the transmission matrices. An increase in transmission from 10–19 year-olds to 40–49 year-olds is observed during July 2021 (when the Delta VoC was dominant in Belgium), while the average number of traced contacts between these age groups remained relatively stable over time. Similarly, in December 2021 (i.e. rise of the Omicron VoC), we observe an increase in transmission from 0–9 year-olds to 30–39 year-olds. The serial interval was shortened over time, in line with previous studies [19, 20]. In addition, we found that the serial interval was shorter for ‘known’ index cases compared to ‘new’ index cases from July 2021 onward (Fig 4).

Fig 3. Contact and transmission patterns.

Fig 3

Age-specific contact (left) and transmission (right) matrix for December 2020, April 2021 (i.e. Alpha VOC), July 2021 (i.e. Delta VOC), and December 2021 (i.e. Omicron VOC).

Fig 4. Serial interval.

Fig 4

Monthly moving average empirical serial interval (in days; 116,453 transmission pairs included; 15,190 transmission pairs with ‘known’ index and 101,263 with ‘new’ index included).

Discussion

In this study, we found that SARS-CoV-2 confirmed cases that had previously been identified as a risk contact generally reported fewer HRC and were associated with fewer secondary infections, as well as a lower secondary attack rate among their HRC. These results reflect the mandatory quarantine for identified risk contacts, but the lower attack rates also suggest that people who were informed of their exposure to an infected person were more careful with the contacts they did have. For both ‘known’ and ‘new’ index cases, we observed an increasing trend in the number of traced HRC, which may be explained by the relaxation of NPIs over time. Delay distributions indicate that the contact tracing system operated fairly quickly during the majority of the study period.

Results from the period September–November 2020 indicate that KPIs obtained during periods of high burden on the healthcare system should be interpreted with caution due to possible changes in testing and quarantine strategies that disturb the standard data flow on which these indicators are based. For example, during the period September–November 2020, we observed a decrease in the proportion of index cases that were previously identified as a risk contact, coinciding with a strong peak in SARS-CoV-2 incidence in the population resulting in changes in testing and tracing strategies. The change in contact tracing strategy after the summer of 2021 may also have impacted the KPIs obtained since September 2021, since index cases that had attended a gathering were possibly linked to many more registered and tested HRC compared to other index cases.

A study evaluating the contact tracing system in Catalonia, Spain, found an increase in the proportion of index cases that had already been identified as a contact from 34% in May 2020 to 58% in November 2020 [21]. This is considerably higher than what we found for Belgium, with the proportion being at most 25% during the period May–June 2021. Furthermore, in our study only 42.2% of the index cases were linked to at least one traced HRC, while in Catalonia 67.1% of index cases reported at least one close contact, of which 99.8% were effectively traced. A study in Portugal conducted between 1 March and 30 April 2020 compared the distribution of secondary cases between index cases that were previously identified as a close contact or returned from affected areas and those that had not been subjected to contact tracing or quarantine measures prior to diagnosis [22]. In line with our results, they found that ‘known’ index cases were associated with a lower number of close contacts. On the contrary, they did not find a difference in the number of secondary cases or SAR between ‘known’ and ‘new’ index cases. Country-specific differences in contact tracing setup, operator training, inquiries made, and the absolute number of confirmed cases to process are likely to have an impact on the effectiveness of contact tracing.

In addition to breaking transmission chains, contact tracing provides an important source of information regarding transmission characteristics. The observed increase in transmission from 10–19 year-olds to 40–49 year-olds during circulation of the Delta VoC, and similarly from 0–9 year-olds to 30–39 year-olds during the rise of the Omicron VoC, indicates an increased transmission potential of children when these VoCs were circulating. Another contributing factor could be the increased vaccination coverage in adults in 2021, resulting in reduced susceptibility, which also implies a reduced potential to transmit the disease given the reduced chance of infection [23]. At the end of July 2021, 60% of the general population of Belgium was fully vaccinated, while at the end of December 2021, 75% of the general population was fully vaccinated and 38% of the adult population had received a booster vaccine [24]. A previous study that linked Belgian contact tracing data with vaccine uptake reported that only 36% of the index cases were fully vaccinated by the end of September 2021 [25].

The shorter serial interval observed for ‘known’ index cases could be explained by the mandatory quarantine endorsed by the tracing, which limits their social contacts and as a result lowers their probability of transmitting the virus later in their infectious period [19]. Furthermore, previous studies have reported a shorter serial interval for Omicron compared to Delta VoC, suggesting faster transmission [26, 27]. In that sense, a shorter serial interval jeopardizes the impact of contact tracing since the turnaround time needs to be reduced, which may not be achievable. This may explain the increased SAR observed in November–December 2021 when the Omicron VoC started circulating.

In addition to operational challenges and disease characteristics, such as asymptomatic infections, the effectiveness of contact tracing also depends on testing policy and compliance, the cooperation of index cases, and the imposed and adopted quarantine and isolation measures. Some index cases might, willingly or unwillingly, not report all of their contacts. This could explain why the number of traced HRC observed in our study is lower than the average of 4 contacts that has been found based on social contact surveys [28]. Even when including only those index cases that were linked to at least one traced HRC, the average was only 2.5 (IQR 1—3) HRC. A possible explanation is that duplicate contacts were usually linked to only one index case to avoid contacting the same individuals more than once. Additionally, individual contacts that were traced as part of a collectivity are not included in the available data. Although the most important thing is to prevent onward transmission, for research and surveillance purposes, it is beneficial to record all individual contacts for each index case. In this way, more comprehensive contact and transmission networks can be reconstructed, which is important for estimating epidemiological characteristics such as the reproduction number and generation interval [2830].

This study is limited by the lack of information on negative clinical tests. As such, we did not know whether risk contacts that did not reappear as index cases were not infected or not tested. Additionally, the availability of the NRN was crucial to assess conversion from contact to index case, resulting in a large part of traced HRC that could not be included in these analyses due to missing NRN. This may have led to an underestimation of the KPIs presented here. In addition, whereas all ‘known’ cases have been previously traced and quarantined, ‘new’ cases are likely to include some cases who were quarantined but not registered as HRC, especially if they were household contacts of an index case. From the available data, the directionality of transmission cannot be assessed. It is possible that an index case was infected by one of their traced contacts, but was the first individual to show symptoms and/or to be contacted by the contact tracing. Due to specific guidelines for testing and contact tracing in collectivities such as nursing homes and schools, the available data are also not fully representative of young children and the elderly population because the majority of their contacts have been traced and followed up by local medical services. Therefore, transmission within these age groups may be underrepresented in our transmission matrices. This may also explain the low proportion of index cases aged over 85 years, as well as the low proportion of ‘known’ index cases among those aged over 65 years. An additional explanation may be the earlier vaccination of elderly, protecting them against infection.

In order to estimate an absolute number of prevented infections, a reference period or region would be needed in which similar NPIs were in place, the same variants were circulating, and, most of all, with contact data being collected without informing risk contacts on their potential exposure, explaining measures to be taken, and motivating contacts to comply. We did not have such reference data, and hence we are restricted to analyzing and reporting relative differences between index cases that were previously informed of their exposure by the contact tracing, and index cases that were not previously contacted by the contact tracing operators. Alternatively, an individual-based model can be used to quantify the effectiveness in terms of what would have happened if no contact tracing was in place. Such a simulation study has been performed for Belgium early in the pandemic, and future research could extend this model to include contact tracing scenarios as they were implemented in real-life [5].

Conclusion

While we did not quantify the effectiveness of contact tracing in all its dimensions, we show that contact tracing in Belgium from September 2020 to December 2021 has been effective in reducing onward transmission. Slowing down the epidemic by contact investigation is of major importance in order to prevent the collapse of healthcare systems [31]. This study also shows that in times of high burden on the healthcare system, contact tracing KPIs should be interpreted with caution in light of changing testing and quarantine strategies. The KPIs used in this study, i.e. the proportion of ‘known’ index cases, number of contacts, secondary cases, SAR, and delay distributions, can be used to continuously monitor the performance and impact of contact tracing. In addition, the data obtained by contact tracing allow to investigate transmission patterns by individual characteristics of the index case, such that contact tracing can be prioritized to individuals with a high contribution to transmission at a certain point in time.

Supporting information

S1 Fig. Number of index cases.

Number of index cases that were contacted during the period from September 2020 to December 2021 by age group, with an overview of the most influential control measures regarding social contacts.

(TIF)

S2 Fig. Traced high-risk contacts.

The proportion of registered high-risk contacts (HRC) that was effectively traced, over time (monthly moving average).

(TIF)

S3 Fig. ‘Known’ index by age group.

Evolution in the proportion of ‘known’ index cases by age group. Vertical bars represent the 95% confidence interval.

(TIF)

S4 Fig. Key performance indicators by household status.

Evolution by household status in the (a) average number of traced HRC for ‘new’ and ‘known’ index cases, (b) average number of secondary cases for ‘new’ and ‘known’ index cases, and (c) secondary attack rate (SAR) among traced HRC of ‘new’ and ‘known’ index cases.

(TIF)

S5 Fig. Key performance indicators fall 2020.

Evolution in the (a) proportion of index cases that were previously identified as a risk contact, (b) average number of traced high-risk contacts (HRC) for ‘new’ and ‘known’ index cases, (c) average number of secondary cases for ‘new’ and ‘known’ index cases, and (d) secondary attack rate (SAR) among traced HRC of ‘new’ and ‘known’ index cases, for the period from September to November 2020.

(TIF)

S1 Table. Index case characteristics.

Proportion of all index cases by province and age group.

(PDF)

Acknowledgments

The authors are grateful for the many interesting discussions within the Controletoren Consortium including members of Hasselt University, Ghent University, KU Leuven, and University of Antwerp.

Data Availability

The R code used for data manipulation and analysis is available on Github (https://github.com/cecilekremer/tracingKPI).

Funding Statement

Part of this project was funded by the Flemish Government’s Department of Care, which also provided the data. The funding source had no involvement in study design, analysis, nor in the decision to submit the paper for publication.

References

  • 1.World Health Organization (WHO). Weekly epidemiological update on COVID-19—107—31 August 2022; 2022.
  • 2. Underwood BR, White VL, Baker T, Law M, Moore-Gillon JC. Contact tracing and population screening for tuberculosis–who should be assessed? Journal of Public Health. 2003;25(1):59–61. doi: 10.1093/pubmed/fdg012 [DOI] [PubMed] [Google Scholar]
  • 3. Erkens C, Kamphorst M, Abubakar I, Bothamley G, Chemtob D, Haas W, et al. Tuberculosis contact investigation in low prevalence countries: a European consensus. European Respiratory Society. 2010. doi: 10.1183/09031936.00201609 [DOI] [PubMed] [Google Scholar]
  • 4. Juneau CE, Briand AS, Collazzo P, Siebert U, Pueyo T. Effective contact tracing for COVID-19: A systematic review. Global Epidemiology. 2023; p. 100103. doi: 10.1016/j.gloepi.2023.100103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Willem L, Abrams S, Libin PJ, Coletti P, Kuylen E, Petrof O, et al. The impact of contact tracing and household bubbles on deconfinement strategies for COVID-19. Nature Communications. 2021;12(1):1–9. doi: 10.1038/s41467-021-21747-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Hellewell J, Abbott S, Gimma A, Bosse NI, Jarvis CI, Russell TW, et al. Feasibility of controlling COVID-19 outbreaks by isolation of cases and contacts. The Lancet Global Health. 2020;8(4):e488–e496. doi: 10.1016/S2214-109X(20)30074-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Grantz KH, Lee EC, D’Agostino McGowan L, Lee KH, Metcalf CJE, Gurley ES, et al. Maximizing and evaluating the impact of test-trace-isolate programs: A modeling study. PLoS Medicine. 2021;18(4):e1003585. doi: 10.1371/journal.pmed.1003585 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8. Aleta A, Martin-Corral D, Pastore y Piontti A, Ajelli M, Litvinova M, Chinazzi M, et al. Modelling the impact of testing, contact tracing and household quarantine on second waves of COVID-19. Nature Human Behaviour. 2020;4(9):964–971. doi: 10.1038/s41562-020-0931-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. James A, Plank M, Hendy S, Binny R, Lustig A, Steyn N, et al. Successful contact tracing systems for COVID-19 rely on effective quarantine and isolation. PLoS ONE. 2021;16(6):e0252499. doi: 10.1371/journal.pone.0252499 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Hossain AD, Jarolimova J, Elnaiem A, Huang CX, Richterman A, Ivers LC. Effectiveness of contact tracing in the control of infectious diseases: a systematic review. The Lancet Public Health. 2022. doi: 10.1016/S2468-2667(22)00001-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Pozo-Martin F, Beltran Sanchez MA, Müller SA, Diaconu V, Weil K, El Bcheraoui C. Comparative effectiveness of contact tracing interventions in the context of the COVID-19 pandemic: a systematic review. European Journal of Epidemiology. 2023;38(3):243–266. doi: 10.1007/s10654-023-00963-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Fetzer T, Graeber T. Measuring the scientific effectiveness of contact tracing: Evidence from a natural experiment. Proceedings of the National Academy of Sciences. 2021;118(33):e2100814118. doi: 10.1073/pnas.2100814118 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.European Centre for Disease Prevention and Control. Monitoring and Evaluation Framework for COVID-19 Response Activities in the EU/EEA and the UK; 2020.
  • 14.World Health Organization. Contact tracing in the context of COVID-19: interim guidance, 1 February 2021. World Health Organization; 2021.
  • 15.Historiek van de wijzigingen;. https://covid-19.sciensano.be/nl/procedures/historiek-wijzigingen.
  • 16. Wu Y, Kang L, Guo Z, Liu J, Liu M, Liang W. Incubation period of COVID-19 caused by unique SARS-CoV-2 strains: a systematic review and meta-analysis. JAMA Network Open. 2022;5(8):e2228008–e2228008. doi: 10.1001/jamanetworkopen.2022.28008 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Cuypers L, Dellicour S, Hong SL, Potter BI, Verhasselt B, Vereecke N, et al. Two years of genomic surveillance in Belgium during the SARS-CoV-2 pandemic to attain country-wide coverage and monitor the introduction and spread of emerging variants. Viruses. 2022;14(10):2301. doi: 10.3390/v14102301 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. He X, Lau EH, Wu P, Deng X, Wang J, Hao X, et al. Temporal dynamics in viral shedding and transmissibility of COVID-19. Nature Medicine. 2020;26(5):672–675. doi: 10.1038/s41591-020-0869-5 [DOI] [PubMed] [Google Scholar]
  • 19. Torneri A, Libin P, Scalia Tomba G, Faes C, Wood JG, Hens N. On realized serial and generation intervals given control measures: The COVID-19 pandemic case. PLoS Computational Biology. 2021;17(3):e1008892. doi: 10.1371/journal.pcbi.1008892 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Ali ST, Wang L, Lau EH, Xu XK, Du Z, Wu Y, et al. Serial interval of SARS-CoV-2 was shortened over time by nonpharmaceutical interventions. Science. 2020;369(6507):1106–1109. doi: 10.1126/science.abc9004 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21. Herrero M, Ciruela P, Mallafré-Larrosa M, Mendoza S, Patsi-Bosch G, Martínez-Solanas È, et al. SARS-CoV-2 Catalonia contact tracing program: evaluation of key performance indicators. BMC Public Health. 2022;22(1):1–13. doi: 10.1186/s12889-022-13695-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Malheiro R, Figueiredo A, Magalhães J, Teixeira P, Moita I, Moutinho M, et al. Effectiveness of contact tracing and quarantine on reducing COVID-19 transmission: a retrospective cohort study. Public Health. 2020;189:54–59. doi: 10.1016/j.puhe.2020.09.012 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Braeye T, Cornelissen L, Catteau L, Haarhuis F, Proesmans K, De Ridder K, et al. Vaccine effectiveness against infection and onwards transmission of COVID-19: Analysis of Belgian contact tracing data, January-June 2021. Vaccine. 2021;39(39):5456–5460. doi: 10.1016/j.vaccine.2021.08.060 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Belgium COVID-19 Dashboard—Sciensano. Google Data Studio;. https://datastudio.google.com/embed/reporting/c14a5cfc-cab7-4812-848c-0369173148ab/page/p_j1f02pfnpc.
  • 25. Proesmans K, Hancart S, Braeye T, Klamer S, Robesyn E, Djiena A, et al. COVID-19 contact tracing in Belgium: main indicators and performance, January–September 2021. Archives of Public Health. 2022;80(1):1–10. doi: 10.1186/s13690-022-00875-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Kremer C, Braeye T, Proesmans K, André E, Torneri A, Hens N. Serial Intervals for SARS-CoV-2 Omicron and Delta Variants, Belgium, November 19–December 31, 2021. Emerging Infectious Diseases. 2022;28(8):1699. doi: 10.3201/eid2808.220220 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Backer JA, Eggink D, Andeweg SP, Veldhuijzen IK, van Maarseveen N, Vermaas K, et al. Shorter serial intervals in SARS-CoV-2 cases with Omicron BA.1 variant compared with Delta variant, the Netherlands, 13 to 26 December 2021. Eurosurveillance. 2022;27(6):2200042. doi: 10.2807/1560-7917.ES.2022.27.6.2200042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Coletti P, Wambua J, Gimma A, Willem L, Vercruysse S, Vanhoutte B, et al. CoMix: comparing mixing patterns in the Belgian population during and after lockdown. Scientific Reports. 2020;10(1):1–10. doi: 10.1038/s41598-020-78540-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Trentini F, Manna A, Balbo N, Marziano V, Guzzetta G, O’Dell S, et al. Investigating the relationship between interventions, contact patterns, and SARS-CoV-2 transmissibility. Epidemics;. doi: 10.1016/j.epidem.2022.100601 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30. Ganyani T, Kremer C, Chen D, Torneri A, Faes C, Wallinga J, et al. Estimating the generation interval for coronavirus disease (COVID-19) based on symptom onset data, March 2020. Eurosurveillance. 2020;25(17):2000257. doi: 10.2807/1560-7917.ES.2020.25.17.2000257 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31. Society TR. COVID-19: examining the effectiveness of non-pharmaceutical interventions; 2023. [Google Scholar]

Decision Letter 0

Tomohiko Ai

11 Jul 2023

PONE-D-22-27415Key performance indicators of COVID-19 contact tracing in Belgium from September 2020 to December 2021PLOS ONE

Dear Dr. Kremer,

Thank you for submitting your manuscript to PLOS ONE. I apologize for the delay in the editorial process. Your paper was evaluated by an expert in the field and myself. Though the topic may be important, there are many points that need to be clarified. Please read the comments carefully and address the issues accordingly.

Please submit your revised manuscript by Aug 25 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Tomohiko Ai, M.D., Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

If you are reporting a retrospective study of medical records or archived samples, please ensure that you have discussed whether all data were fully anonymized before you accessed them and/or whether the IRB or ethics committee waived the requirement for informed consent. If patients provided informed written consent to have data from their medical records used in research, please include this information.

3. Thank you for stating the following in the Competing Interests section:

“Naima Hammami is an employee of the the Flemish Agency for Care and Health and Jorden Boone has been working as a consultant for the agency during the COVID-19 pandemic.

Niel Hens declares that the Universities of Antwerp and Hasselt have received funding for advisory boards and research projects of MSD, GSK, JnJ, Pfizer outside the proposed work. Niel Hens has not received any personal remuneration related to this work.

The other authors declare that they have no competing interests.”

We note that one or more of the authors are employed by a commercial company: Flemish Agency for Care and Health

a.            Please provide an amended Funding Statement declaring this commercial affiliation, as well as a statement regarding the Role of Funders in your study. If the funding organization did not play a role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript and only provided financial support in the form of authors' salaries and/or research materials, please review your statements relating to the author contributions, and ensure you have specifically and accurately indicated the role(s) that these authors had in your study. You can update author roles in the Author Contributions section of the online submission form.

Please also include the following statement within your amended Funding Statement.

“The funder provided support in the form of salaries for authors [insert relevant initials], but did not have any additional role in the study design, data collection and analysis, decision to publish, or preparation of the manuscript. The specific roles of these authors are articulated in the ‘author contributions’ section.”

If your commercial affiliation did play a role in your study, please state and explain this role within your updated Funding Statement.

b. Please also provide an updated Competing Interests Statement declaring this commercial affiliation along with any other relevant declarations relating to employment, consultancy, patents, products in development, or marketed products, etc. 

Within your Competing Interests Statement, please confirm that this commercial affiliation does not alter your adherence to all PLOS ONE policies on sharing data and materials by including the following statement: "This does not alter our adherence to  PLOS ONE policies on sharing data and materials.” (as detailed online in our guide for authors http://journals.plos.org/plosone/s/competing-interests) . If this adherence statement is not accurate and  there are restrictions on sharing of data and/or materials, please state these. Please note that we cannot proceed with consideration of your article until this information has been declared.

Please include both an updated Funding Statement and Competing Interests Statement in your cover letter. We will change the online submission form on your behalf

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: No

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall, the authors address a relevant topic in the field of epidemiological surveillance and intervention in public health. The key performance indicators are well suited, and the division between cases that were previously identified as close contacts and those that were not yet known is adequate. Although other papers have already suggested the effectiveness of contact tracing, there is an abundance of modelling studies and a lack of community and real-world studies. The former are dependent on a plethora of premises that often fail to represent reality, whereas the latter reflect reality with all its complexities, from which I believe this manuscript could be relevant.

The manuscript, however, is poorly designed. The introduction is far too large, and could be reduced to half the size without losing any of its relevant points. In fact, its length – a problem applicable to the entire paper – draws the reader off the idea the authors are trying to communicate.

The title and the abstract focus mainly on the effectiveness of contact tracing. That should be the main aim of the paper, as given by the objectives in the end of the introduction. However, when one reaches the Results and Discussion section, it is mingled with secondary analysis (age and close contacts) which are more dubious, and definitely less relevant. The authors focus too much on the statistical presentation of secondary analysis, without much consideration for the message they are trying to pass and the epidemiological implications of their choices. Also, the authors rely on their figures heavily and provide few data on the results text section, which is a major limitation. The inclusion of 6 figures, with no tables (such as baseline characteristics) suggests that authors were unable to focus their message on the essential. In fact, after reading the manuscript several times, it seems that authors changed their focus midway, which denotes a frail conception.

Notes by parts

Abstract

“(…) fewer close contacts as well as fewer secondary cases and a lower secondary attack rate (…)”: the absence of quantitative data is a major limitation. Even in the abstract, major results ought to be given.

The conclusion that “…individuals aware of their exposure to SARS-CoV-2 seemed more reserved in their social contact behavior” is, at best, an euphemism for the fact that they were placed under quarantine and had less contacts to report, which is the point of contact tracing and quarantine. This is no direct consequence of the results here provided and should not be included.

Introduction:

Lines 8-9: “When restrictions were relieved, countries implemented contact tracing…”. As I understand from the manuscript, this was how Belgium tackled the pandemic; however, in many settings that was not so. In my country, contact tracing was operational prior to the pandemic (for other infectious diseases) and was implemented prior to, during, and after all lockdowns.

Lines 12-14: conceptually, other problems like asymptomatic cases transmitting disease, short incubation periods, acute disease, are all characteristics affecting the effectiveness. Also, a reference is missing.

Lines 20-26: Superfluous. I understand the relevance of the cited papers, yet the previous sentences already established that potential benefits of contact tracing. The authors may opt to include reference 9 in the end of line 20.

Lines 27-34: Same thing. Interesting results to support the effectiveness of contact tracing, but which add nothing to what was previously established. Also, in the first line “It is not trivial…” it seems to this reviewer that there would be no need to compare regions with and without contact tracing, because you are comparing cases subjected to contact tracing to “new” cases. That distinction is already made. Therefore, this section is redundant.

Lines 42-onwards: These are methods. It includes setting, time window and context. I would move this to the methods sections (albeit in fewer sentences) and conclude only with the objectives

Lines 55-56: “We investigated several key indicators and discuss their opportunities and pitfalls”. Meaningless sentence. It is relevant to know which key indicators were selected, which the authors provide in the next sentence.

Lines 59-60: attack rate?

Methods:

Lines 75-80: There is no specification as to what type of measures were implemented for high and low-risk contacts. One assumes that high-risk patients were placed under quarantined, whereas low-risk were either subjected to active surveillance, or were disregarded due to lack of resources. The end sentence (between brackets) is redundant and should be deleted.

Lines 81-87: Although the authors take a lot of consideration to distinguish between reported, registered and traced contacts. I understand that registered contacts were not necessarily traced, which happened frequently for many reasons. However, it is not clear to this reviewer the difference between reported and registered. Was it possible for a case to report 10 contacts, but the interviewer would only register 8 in the system?

Lines 99-100. Other (referenced) papers opted to exclude these cases and contacts.

Line 126 and line 146: there appears to be a contradiction. The transmission line is said to be constructed for cases and their reported index case if the test was positive 21 days before or after the index case. In the end of the paragraph, it is claimed that the serial interval was constrained to -5 to 21 days. Is this referring to different steps of the process?

Results:

The presentation of results is absurd, and needs a complete overhaul.

Lines 143-136: Most likely estimating the speed of contact tracing (which is relevant) rather than transmission.

Line 168: To use percentages to provide numbers larger than 100% is a poor choice to present data. Additionally, I can’t figure where this number comes from. 416 645 unique cases represent 41.5% of all included cases. Even if I may understand there is a dot/comma missing in virtually every data provided, still the number is not correct.

Lines 168-170: If the result you have is summarized in a figure, with no more than a sentence claiming the same as the legend, then it is superfluous. It is an interesting image to present in a workshop or seminar, eventually, but it adds nothing here.

Line 178: It seems like a proportion, and hence could not be 191%. Assuming 19.1%, this is different from the result given in the abstract (20%).

Line 180-181: The proportion seems stable, except for the first point. Rephrase.

Lines: 188-189: Discussion!

Figure 2: Where are the confidence intervals? Are these results significant?

Line 199: 137%. Same issue.

Line 200: 4 points below vs 3 points. Virtually similar. Dubious interpretation.

Line 207: S4 figure is absolutely redundant, even as a supplement.

Line 208-220: This paragraph is a mix of methods, results and discussion. Needs complete rewriting.

Figure 3: Redundant. Doesn’t seem to add to the discussion.

Line 234-242: No clear reason for the stratification per month. Given the information which is provided in the discussion, would it be not more useful to stratify per variant? Also, the differential proportion of vaccination during the time period is never taken into account, statistically. Another option was to stratify per strategy, as given in the first paragraph of the discussion.

Lines 243-250: It is unclear to this reviewer the relevance of this analysis. Given the bias acknowledged by failing to include older people, the results are inconsequential. I would delete this sub-analysis.

Line 336: One third of HRC were excluded. This is tremendous, and should have 1) led the authors to focus more on the effectiveness of contact tracing and quarantine, which is relegated to a secondary position after the introduction, and 2) to provide some comparison between included and excluded HRC, to analyze whether the included are representative of the population and, if not, how not so.

Discussion

Lines 266-267: Individuals attending the same gathering were classified as HRC <- highly relevant data that should be given in the methods section!

Lines 293-295: See previous comment.

Line 301-306: This suggests that analysis should have been stratified by variant, which is meaningful, rather than monthly, which is comparing completely different scenarios.

Lines 307-317: It is not clear why this paragraph is included, at all.

Limitations should note that there may be a differential misclassification of ‘exposure’, as always happens in cases like this: all ‘known’ cases were definitively previously traced, whereas ‘new’ cases are likely to include a few cases who were quarantined, but whose quarantine was unknown to the researchers/public health authorities.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Tomohiko Ai

20 Sep 2023

Key performance indicators of COVID-19 contact tracing in Belgium from September 2020 to December 2021

PONE-D-22-27415R1

Dear Dr. Kremer,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Tomohiko Ai, M.D., Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Tomohiko Ai

12 Oct 2023

PONE-D-22-27415R1

Key performance indicators of COVID-19 contact tracing in Belgium from September 2020 to December 2021

Dear Dr. Kremer:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Tomohiko Ai

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Number of index cases.

    Number of index cases that were contacted during the period from September 2020 to December 2021 by age group, with an overview of the most influential control measures regarding social contacts.

    (TIF)

    S2 Fig. Traced high-risk contacts.

    The proportion of registered high-risk contacts (HRC) that was effectively traced, over time (monthly moving average).

    (TIF)

    S3 Fig. ‘Known’ index by age group.

    Evolution in the proportion of ‘known’ index cases by age group. Vertical bars represent the 95% confidence interval.

    (TIF)

    S4 Fig. Key performance indicators by household status.

    Evolution by household status in the (a) average number of traced HRC for ‘new’ and ‘known’ index cases, (b) average number of secondary cases for ‘new’ and ‘known’ index cases, and (c) secondary attack rate (SAR) among traced HRC of ‘new’ and ‘known’ index cases.

    (TIF)

    S5 Fig. Key performance indicators fall 2020.

    Evolution in the (a) proportion of index cases that were previously identified as a risk contact, (b) average number of traced high-risk contacts (HRC) for ‘new’ and ‘known’ index cases, (c) average number of secondary cases for ‘new’ and ‘known’ index cases, and (d) secondary attack rate (SAR) among traced HRC of ‘new’ and ‘known’ index cases, for the period from September to November 2020.

    (TIF)

    S1 Table. Index case characteristics.

    Proportion of all index cases by province and age group.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    The R code used for data manipulation and analysis is available on Github (https://github.com/cecilekremer/tracingKPI).


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES