Skip to main content
PLOS Global Public Health logoLink to PLOS Global Public Health
. 2023 Feb 28;3(2):e0000980. doi: 10.1371/journal.pgph.0000980

Quasi-experimental evaluation of national border closures on COVID-19 transmission

Mathieu J P Poirier 1,2, Susan Rogers Van Katwyk 1, Gigi Lin 1, Steven J Hoffman 1,2,3,*
Editor: Lorena G Barberia4
PMCID: PMC10021705  PMID: 36962967

Abstract

With over 200 pandemic threats emerging every year, the efficacy of closing national borders to control the transmission of disease in the first months of a pandemic remains a critically important question. Previous studies offer conflicting evidence for the potential effects of these closures on COVID-19 transmission and no study has yet empirically evaluated the global impact of border closures using quasi-experimental methods and real-world data. We triangulate results from interrupted time-series analysis, meta-regression, coarsened exact matching, and an extensive series of robustness checks to evaluate the effect of 166 countries’ national border closures on the global transmission of COVID-19. Total border closures banning non-essential travel from all countries and (to a lesser extent) targeted border closures banning travel from specific countries had some effect on temporarily slowing COVID-19 transmission in those countries that implemented them. In contrast to these country-level impacts, the global sum of targeted border closures implemented by February 5, 2020 was not sufficient to slow global COVID-19 transmission, but the sum of total border closures implemented by March 19, 2020 did achieve this effect. Country-level results were highly heterogeneous, with early implementation and border closures so broadly targeted that they resemble total border closures improving the likelihood of slowing the pandemic’s spread. Governments that can make productive use of extra preparation time and cannot feasibly implement less restrictive alternatives might consider enacting border closures. However, given their moderate and uncertain impacts and their significant harms, border closures are unlikely to be the best policy response for most countries and should only be deployed in rare circumstances and with great caution. All countries would benefit from global mechanisms to coordinate national decisions on border closures during pandemics.

Introduction

Before the COVID-19 pandemic, targeted border closures–restrictions on non-essential entry of foreign nationals from one or more specified countries–were not shown to be effective in controlling the spread of emerging infectious diseases such as influenza, Ebola, and other coronaviruses [1, 2]. Total border closures–restrictions on non-essential entry of foreign nationals from all countries–were rarely enacted prior to COVID-19 and, as such, little evidence has been available about their effectiveness [3]. Nevertheless, the unprecedented speed with which COVID-19 spread globally reignited a debate over whether targeted and/or total border closures can prevent or slow the international transmission of a pandemic. Despite quasi-experimental evaluations of the use of masks [4, 5] and physical distancing [57], there are very few quasi-experimental evaluations of whether national border closures reduced the global spread of COVID-19 in the initial months of the pandemic.

Prior evidence on the effectiveness of border closures to control the transmission of viral pathogens is mixed and largely derived from mathematical models [1, 2, 8]. One study found that targeted travel restrictions between the world’s largest cities would result in a 50% reduction in the international transmission of SARS-CoV-1 [9], whereas a systematic review of influenza transmission concluded that restricting at least 90% of air travel would likely delay the spread of a pandemic by 3–4 weeks [1]. In the case of COVID-19, domestic travel restrictions appear to have slowed outbreaks in several contexts [7, 1012], but there is mixed evidence of international impact [12]. Some mathematical models suggest border closures targeting China had little or no effect on global COVID-19 transmission due to the number of exportation events that had already occurred prior to their implementation [1317], with one study identifying North America and Europe as the primary regions of origin for imported cases in other countries [18].

Although these mathematical models can provide valuable insights on the dynamics of disease transmission–particularly during the early stages of a public health event or when real-world data are scarce–we are now able to evaluate real-world data using quasi-experimental methods that do not rely on parameter assumptions which can vary among modelling studies [8, 19]. Two quasi-experimental studies of 235 country entities [20] and of nine African countries [21] have found that both targeted and total border closures have not had a significant impact on the international transmission of COVID-19. Others have found that early border closures can reduce exportation of cases and could have bought valuable weeks of preparation time if paired with further disease prevention measures [8, 12, 2228].

We conducted quasi-experimental analyses to determine whether and under what conditions national border closures affected the transmission of COVID-19 within and across 166 countries during the first 22 weeks of the pandemic. This critical period in the emergence of the pandemic saw the rapid implementation of national border closures impacting at least 95% of the world’s population, with reported global incidence eventually surpassing 30,000 cases per day (Fig 1). The remarkable speed and concomitance with which countries closed their borders means we may never have a better natural experiment to observe and measure the effects of this intervention. Rather than estimating the hypothetical effect of border closures in isolation of other control measures as in a mathematical modelling study, we conceptualize border closures as both a restriction on travel and a powerful social signal that potentially enhances the effect of complementary public health measures and posit that the real-world impact of these policies can never be fully disentangled from complementary measures (Fig A in S1 Text). Although data quality issues and concurrent implementation of various public health measures limit our ability to estimate a generalizable magnitude of effect, this impact evaluation study leverages an unprecedented natural experiment to produce a real-world assessment of whether and under what conditions national border closures may be effective in the early days of a pandemic. In doing so, this study also represents an important scientific advance in the use of quasi-experimental methods to better understand the impact of national public health interventions in a globalized world.

Fig 1. Global border closures and changes in COVID-19 Rt and incidence.

Fig 1

Stacked area plot of the world’s population living in countries with no border closures, targeted border closures, and total border closures. From left to right are the time-series trends of: i) global time-varying effective reproductive number (Rt) and number of global diagnostic tests; and ii) daily incidence and number of global diagnostic tests.

Methods

Our multi-method quasi-experimental evaluation of the effect of border closures on the transmission of COVID-19 triangulates results across interrupted time-series (ITS) analysis, coarsened exact matching (CEM), and meta-regression (Fig B in S1 Text). Detailed descriptions of these analyses can be found in the Supplementary Information.

We selected the instantaneous effective reproduction number (Rt) as the primary outcome to produce a balanced weighting of both the exponential spread of initial outbreaks and large absolute increases in case counts in later weeks. As a measure of the expected number of new infections caused by one infected individual, an Rt of less than one leads to a reduction in COVID-19 propagation, while an Rt of greater than one leads to expansion of the pandemic [29]. Country-level, global, and stratified Rt were independently calculated from daily incidence data, producing a stationary estimation of the transmission of COVID-19 during the first pandemic wave with limited serial correlation [30]. This means that longitudinal increases in testing could temporarily bias country-level Rt upward, while global and stratified Rt could be more sensitive to changes in incidence in countries with more robust testing regimes.

All countries for which Johns Hopkins University Center for Systems Science and Engineering (CSSE) COVID-19 incidence data and country-level covariates (Table A in S1 Text) could be obtained were included in analysis [31]. Border closure data for each country-pair (i.e. country implementing a border closure and each country targeted by the border closure) were obtained from the Oxford COVID-19 Government Response Tracker and recoded into matrix form for each date between the study period of January 1, 2020 to June 8, 2020 (S1 Data) [32]. The global intervention points of border closures were defined as the dates at which countries comprising at least 20% of the global population had implemented targeted border closures or total border closures, resulting in global intervention dates of February 5, 2020 for targeted closures and March 19, 2020 for total border closures. Detailed explanations on the selection of the primary outcome variable, quantitative methods, and scenario analyses are found in the Supplementary Information.

ITS analyses were conducted to evaluate the change in both level and slope of Rt after border closures were implemented using varying levels of lagged outcomes, with 5-day lagged Rt designated a priori as the primary measure [33]. We selected linear over exponential or logarithmic regression models to more conservatively compare outcomes between country- and global-level time-series without inappropriately smoothing real-world trends [34]. By fitting least squares regression lines to pre- and post-border closure data, the analyses identify statistically significant changes in COVID-19 transmission at both the country and global level assuming a constant underlying time trend in Rt. Meta-regression of ITS results were then conducted using ordered logistic regression to identify which a priori country-level factors hypothesized to be associated with effective national border closures based on published literature (Table A in S1 Text) were associated with positive border closure effects.

In a separate analysis to triangulate results, CEM was used to reduce the multivariate imbalance between countries without border closures (control group) and countries with a border closure (treatment group). Countries were assigned treatment status using two different approaches and three models of theoretically sampled coarsened covariates; an adjusted regression analysis using maximum likelihood estimation was then used to quantify the effect of border closures on Rt [35] This matching process improves estimates by reducing selection bias, resulting in an empirical distribution that is more representative to draw inferences of the effect of border closures on Rt [35, 36].

An extensive series of 328 robustness checks are detailed in the text of the Supplementary Information, including falsification tests using placebo intervention dates (Table B in S1 Text), aligning analysis by time of intervention (Tables C, D in S1 Text), censoring extreme values (Tables E, F in S1 Text), restricting pre- and post-intervention data points (Tables G, H in S1 Text), and stratifying analysis for travel quarantine-implementing countries (Tables I, J in S1 Text).

Results

Global-level border closure analyses

ITS analysis identifies a stable reduction in the additional number of global cases expected for each case of COVID-19 following the implementation of total border closures, whereas the use of targeted border closures did not lead to a reduction in the global transmission of COVID-19 (Fig 2). Both the level (2.36; CI: 1.18–3.53) and slope (0.10; CI: 0.04–0.16) of Rt significantly increased as compared to the underlying time trend after the first wave of targeted border closures on February 5, 2020 (Table 1). In contrast, there was a significant drop in the level (-0.62; CI: -1.05 –-0.19) of the global Rt following the wave of total border closures on March 19, 2020, as compared to the first wave of targeted closures. An alternate model aligning ITS analysis by intervention date for all countries that only implemented total border closures also indicates a statistically significant and visually apparent reversal in slope (-0.09; CI: -0.10 –-0.07) of the Rt (Fig 1; Tables C, D in S1 Text). Disaggregating analysis by high-income country (HIC) versus low- and middle-income country (LMIC) status did not reveal any major differences (Fig C in S1 Text; Tables K-P Tables in S1 Text).

Fig 2. Interrupted time-series analyses of global Rt, excluding China.

Fig 2

Time-series analyses of: i) impact of the first global intervention of targeted border closures on February 5, 2020, followed by the second global intervention of total border closures on March 19, 2020; ii) time-aligned analysis of the intervention date for all countries that only implemented total border closures; iii) impact of the global intervention of total border closures for countries that had not implemented quarantine measures for international travellers (March 18, 2020); and iv) impact of the global intervention of total border closures for countries that had implemented quarantine measures for international travellers (March 22, 2020).

Table 1. Global interrupted time-series results.

Analyses with two intervention points on February 5, 2020 and March 19, 2020, with lags from 0–15 days. Coefficients, lower 95% confidence interval (LCI), upper 95% confidence interval (UCI), and standard errors (SE) are provided for the underlying time trend, two slope and level changes, and a constant. Analyses exclude China.

0-day lag 1-day lag 2-day lag 3-day lag 4-day lag 5-day lag 6-day lag 7-day lag
Time -0.200*** -0.177*** -0.154*** -0.134*** -0.126*** -0.121*** -0.116*** -0.110***
LCI -0.258 -0.24 -0.218 -0.196 -0.179 -0.167 -0.157 -0.148
UCI -0.141 -0.114 -0.09 -0.0725 -0.073 -0.0743 -0.0751 -0.0715
SE 0.0296 0.0319 0.0324 0.0312 0.0269 0.0234 0.0208 0.0193
Feb 5 level change 1.776*** 1.866*** 1.911*** 1.951*** 2.139*** 2.359*** 2.593*** 2.786***
LCI 0.83 0.823 0.787 0.77 0.957 1.183 1.436 1.648
UCI 2.721 2.909 3.035 3.133 3.321 3.534 3.751 3.923
SE 0.478 0.527 0.568 0.597 0.598 0.594 0.585 0.575
Feb 5 slope change 0.205*** 0.177*** 0.150*** 0.125*** 0.110*** 0.0981*** 0.0866*** 0.0731***
LCI 0.141 0.109 0.0792 0.0554 0.0476 0.0403 0.0327 0.0214
UCI 0.268 0.246 0.22 0.194 0.173 0.156 0.14 0.125
SE 0.0321 0.0347 0.0357 0.0351 0.0317 0.0292 0.0272 0.0261
Mar 19 level change -1.014*** -0.958*** -0.894*** -0.815*** -0.718*** -0.620*** -0.523** -0.422*
LCI -1.38 -1.32 -1.268 -1.214 -1.135 -1.051 -0.961 -0.866
UCI -0.648 -0.596 -0.52 -0.415 -0.3 -0.189 -0.0851 0.0212
SE 0.185 0.183 0.189 0.202 0.211 0.218 0.221 0.224
Mar 19 slope change -0.01 -0.00472 0.00048 0.00587 0.0127 0.02 0.0277 0.0354**
LCI -0.035 -0.0318 -0.0289 -0.0259 -0.0208 -0.0145 -0.00716 0.00051
UCI 0.0149 0.0223 0.0298 0.0376 0.0461 0.0545 0.0626 0.0702
SE 0.0126 0.0137 0.0148 0.016 0.0169 0.0175 0.0176 0.0176
Constant 2.931*** 2.841*** 2.742*** 2.649*** 2.608*** 2.579*** 2.554*** 2.515***
LCI 2.441 2.331 2.215 2.112 2.09 2.076 2.065 2.029
UCI 3.422 3.35 3.269 3.187 3.127 3.082 3.043 3.001
SE 0.248 0.257 0.266 0.272 0.262 0.254 0.247 0.246
Observations 135 135 135 135 135 135 135 135
8-day lag 9-day lag 10-day lag 11-day lag 12-day lag 13-day lag 14-day lag 15-day lag
Time -0.097*** -0.082*** -0.070*** -0.065*** -0.062*** -0.046** -0.013 0.032
LCI -0.138 -0.126 -0.114 -0.104 -0.0974 -0.0886 -0.0821 -0.0673
UCI -0.0559 -0.0375 -0.0267 -0.0248 -0.0258 -0.0028 0.0555 0.132
SE 0.0207 0.0224 0.022 0.02 0.0181 0.0217 0.0348 0.0504
Feb 5 level change 2.840*** 2.817*** 2.828*** 2.951*** 3.135*** 2.939*** 2.180*** 0.855
LCI 1.675 1.608 1.621 1.811 2.119 1.845 0.683 -1.086
UCI 4.005 4.025 4.036 4.09 4.15 4.033 3.677 2.796
SE 0.589 0.611 0.611 0.576 0.513 0.553 0.757 0.981
Feb 5 slope change 0.0540* 0.0336 0.0161 0.00324 -0.00735 -0.026 -0.053 -0.0842
LCI -6.80E-05 -0.0237 -0.0407 -0.0496 -0.0547 -0.0789 -0.129 -0.186
UCI 0.108 0.0908 0.0728 0.056 0.04 0.0269 0.023 0.0178
SE 0.0273 0.0289 0.0287 0.0267 0.0239 0.0267 0.0384 0.0516
Mar 19 level change -0.312 -0.194 -0.0671 0.0736 0.22 0.294 0.25 0.0749
LCI -0.776 -0.684 -0.574 -0.427 -0.241 -0.176 -0.24 -0.255
UCI 0.151 0.295 0.44 0.574 0.681 0.765 0.739 0.405
SE 0.234 0.247 0.256 0.253 0.233 0.238 0.248 0.167
Mar 19 slope change 0.0420** 0.0478** 0.0539*** 0.0612*** 0.0693*** 0.0724*** 0.0673*** 0.0530***
LCI 0.00656 0.0116 0.0175 0.0263 0.0382 0.0414 0.0349 0.031
UCI 0.0774 0.084 0.0903 0.0961 0.1 0.103 0.0996 0.0749
SE 0.0179 0.0183 0.0184 0.0176 0.0157 0.0157 0.0164 0.0111
Constant 2.433*** 2.334*** 2.253*** 2.210*** 2.188*** 2.061*** 1.791*** 1.395**
LCI 1.921 1.788 1.693 1.66 1.652 1.463 0.986 0.298
UCI 2.945 2.88 2.813 2.761 2.724 2.658 2.595 2.491
SE 0.259 0.276 0.283 0.278 0.271 0.302 0.407 0.554
Observations 135 135 135 135 135 135 135 135

*** p < 0.01,

** p < 0.05,

* p < 0.10

Global results were robust to lagged effects up to 14 days for the first intervention and up to six days for the second intervention (Table Q in S1 Text) and were not affected by including China in the analysis (Tables R, S in S1 Text), by censoring extreme Rt values from February 18–21, 2020 (Tables E, F in S1 Text), or by restricting analysis to 45 days pre- and post-intervention for both targeted and total closures (Tables G, H in S1 Text). Further sensitivity checks addressing the potential confounding effect of the concurrent implementation of co-interventions (Fig 1; Tables I, J in S1 Text) resulted in nearly identical decreases in Rt following total border closures among countries that implemented travel quarantine measures (-0.82; SE = 0.21) and countries that had not implemented quarantine measures (-0.84; SE = 0.24).

Country-level border closure analyses

Country-level ITS results were highly heterogeneous, with beneficial (i.e., decreased Rt) and null effects generally more common than adverse (i.e., increased Rt) and mixed effects (Fig 3). Although total border closures were more likely to reduce COVID-19 transmission rates than targeted border closures, both interventions were marked by significant heterogeneity in their outcomes (Table T in S1 Text). Of the 34 targeted border closures that could be analyzed, countries were about as likely to experience beneficial effects (decreased Rt in 12 countries), adverse effects (increased Rt in 10 countries), or null or mixed effects (12 countries), while the 103 total border closures that could be analyzed resulted in more beneficial effects (41 countries) than adverse effects (28 countries), while 34 countries experienced null or mixed effects. Of the five analyzed countries that partially reopened from a total border closure to targeted border closures, two experienced increased COVID-19 transmission rates and three had null effects.

Fig 3. Country-specific ITS results for targeted and total border closures.

Fig 3

Map of targeted (top) and total (bottom) border closures that produced positive effects (i.e., decreased Rt) (green), negative effects (i.e., increased Rt) (red), and null or mixed effects (yellow) for all five-day lagged evaluations using ITS analysis. Map base layer from © OpenStreetMap can be accessed at https://www.openstreetmap.org.

Similar to global results, country-level effects were robust to varying lags in outcome measures (S2 Data). Falsification tests for both global- and country-level ITS analyses using placebo intervention dates for global and country-specific ITS analyses provide higher confidence that the observed effects were not due to chance, with the statistically significant change in the level of global transmission becoming statistically insignificant, the direction of country-specific time-series reversing from positive to negative for a majority of countries, and the magnitude of effect sizes decreasing by 56% (Table U in S1 Text).

Meta-regression analysis of country-level ITS results using a priori selected factors points to late implementation of border closures (after March 21) as the most consistently statistically significant adverse factor for both total and targeted border closures (Tables V, W in S1 Text). The majority of the 31 country-level factors tested, including economic indicators, gender parity, health metrics, domestic containment indicators, and border closure characteristics, had no statistically significant association with the likelihood of a national border closure having a beneficial effect. Factors associated with more effective total border closures were higher Global Health Security Index scores (-0.03, SE = 0.01), larger population (-0.29 (logged), SE = 0.12), and not being among the last third of countries to implement a border closure (1.48, SE = 0.46). Targeted border closures were less likely to have beneficial effects in countries with higher health expenditures (29.09, SE = 12.26).

Coarsened exact matching analyses

CEM results suggest that a synthetic country with socio-economic and political characteristics similar to the Philippines or Colombia implementing a total border closure could expect their Rt to decrease by 1.2 under conditions similar to COVID-19’s first pandemic wave (Table 2). Although this would imply a reduction in COVID-19 transmission of 51% for a country that had an average Rt of 2.4 on March 19, 2020, this estimated reduction in transmission is likely biased upward by an increase in testing capacity prior to this date [37, 38]. If this synthetic country were to implement a targeted border closure, it would likely experience a decrease in Rt of 0.8, with a greater probability of decreasing transmission by increasing the number of countries targeted, regardless of whether those countries were known to have high levels of COVID-19 incidence at that time.

Table 2. Coarsened exact matching results.

Maximum likelihood random-effects estimation for targeted and total border closures. Country-days are matched on coarsened GHSI score, logged GDP, gender parity score, emigrants per capita, democracy index, logged airline passengers, health expenditures, and proportion of female government ministers.

Targeted border closures
Dropping countries with total border closures Controlling for countries with total border closures Model using % of global population targeted Model using % of global cases targeted
Targeted closure (β) -0.73*** (0.06) -0.67*** (0.04)
Confidence interval [-0.84, -0.61] [-0.75, -0.59]
Total closure (β) -1.26*** (0.03)
Confidence interval [-1.33, -1.20]
% of global pop targeted (β) -1.30*** (0.09)
Confidence interval [-1.48, -1.12]
% of global cases targeted (β) -0.20*** (0.07)
Confidence interval [-0.35, -0.06]
Constant 2.38*** (0.05) 2.50*** (0.04) 2.27*** (0.04) 2.16*** (0.05)
Confidence interval [2.28, 2.48] [2.42, 2.59] [2.19, 2.36] [2.06, 2.26]
Observations 4,550 10,731 4,550 4,550
Countries 109 112 109 109
Total border closures
Primary Model Conservative Model
Dropping countries with targeted border closures Controlling for countries with targeted border closures Dropping countries with targeted border closures Controlling for countries with targeted border closures
Targeted closure (β) -0.85*** (0.06) -0.66*** (0.05)
Confidence interval [-0.96, -0.74] [-0.77, -0.56]
Total closure (β) -1.24*** (0.05) -1.35*** (0.05) -0.91*** (0.04) -0.94*** (0.04)
Confidence interval [-1.34, -1.15] [-1.45, -1.25] [-0.99, -0.83] [-1.03, -0.86]
Constant 2.34*** (0.05) 2.37*** (0.06) 2.31*** (0.04) 2.372*** (0.04)
Confidence interval [2.24, 2.44] [2.26, 2.49] [2.23, 2.38] [2.29, 2.46]
Observations 3,409 4,835 5,321 7,488
Countries 45 46 98 112

*** p < 0.01,

** p < 0.05,

* p < 0.10;

standard errors in parentheses

Multiple robustness checks were conducted, including varying the degree to which covariates were coarsened (Tables X, Y in S1 Text), using different combinations of coarsened covariates (Table Z in S1 Text), and restricting data points to 45 days or 60 days pre- and post-intervention (Tables AA, AB in S1 Text). Furthermore, scenario analyses splitting countries into high or low covariate distributions in social, economic, and political country-level factors prior to matching did not alter the statistically significant beneficial effects of both targeted and total border closures across all sets of analyses (Tables AC, AD in S1 Text). Finally, a sensitivity check matching countries on potentially confounding co-interventions, including workplace and public transit closures, stay at home orders, restrictions on public gatherings, and restrictions on internal movement did not significantly alter results (Tables AE, AG in S1 Text).

Discussion

Two consistent findings emerge from this quasi-experimental evaluation of the effect of national border closures on COVID-19 transmission. First, total border closures and (to a lesser extent) targeted border closures had some effect on temporarily slowing COVID-19 transmission. Second, while the global sum of targeted border closures implemented by February 5, 2020 were not sufficient to slow the COVID-19 pandemic, the global sum of total border closures implemented by March 19, 2020 did result in a statistically significant reduction in global COVID-19 transmission.

Although this study provides some evidence to support the use of national border closures to temporarily slow the first wave of a pandemic, much of their value will depend on how governments make use of the extra preparation time that these emergency interventions buy as weighed against their significant economic and social consequences [1, 2, 15]. More specifically, the potential for a moderate temporary reduction in domestic Rt must be weighed by governments against the considerable negative downstream consequences of border closures and the possibility that they may not work or may even increase transmission in some implementing countries. For example, there is evidence to suggest that increased repatriation of emigrants immediately following border closures may have temporarily increased transmission in some countries [39, 40]. These dynamics may have contributed to the absence of difference in border closure effectiveness between HIC and LMIC observed in our study, but the relatively even 60–75% reduction in airline travel across regions during the study period indicates that border closures were meaningfully enforced across all country income levels [41].

Less restrictive alternatives, such as mandatory quarantine for all incoming travellers, might prove to be equally effective and less harmful for those countries with the bureaucratic capacity and political will to fully implement and enforce them [42]. Nevertheless, border closures may be helpful in those rare cases when countries are unable to implement mandatory quarantines, are willing to adopt these measures early, and where the extra time bought by moderate temporary reductions in viral transmission is determined to be worth border closures’ significant trade-offs and consequences. With national border closures contributing to increases in unemployment [43], higher costs of goods and services [44], and a historic reduction in economic growth [45, 46] across the world, these consequences should not be taken lightly.

Globally, the cumulative impacts of total border closures appeared to reduce COVID-19 transmission more effectively than the cumulative impacts of targeted border closures. Indeed, this study’s CEM analysis provides evidence of a dose-response relationship in the percentage of the world’s population that targeted border closures affect, wherein the most effective targeted border closures were those that functionally approximated total border closures by limiting travel from nearly all countries. Although our findings run counter to null findings from a panel-matching analysis of border closures’ impacts on the global spread of COVID-19 [20], they do align with significant impacts of early and more comprehensive border closures from the largest systematic review of the subject [8]. These divergent findings can be attributed to a number of differences in model specification, data aggregation, covariate selection, and most notably, the use of smoothed per capita COVID-19 incidence as the primary outcome [20].

While border closures in the initial weeks of COVID-19 likely violated Article 43 of the legally-binding International Health Regulations because they were implemented without “available scientific evidence” [42, 47, 48], our study’s evidence of their potential effectiveness in very specific circumstances points toward the need to reconsider past blanket guidance against border closures and take a more nuanced approach to their potential deployment. Most specifically, with increasing evidence that border closures played a moderate role in slowing the initial spread of COVID-19 and buying some additional time to prepare for the oncoming pandemic [8], public health authorities should re-evaluate their guidance so that it is more context-specific and consider global mechanisms to coordinate national decisions on border closures. This increasing evidence about the moderate effectiveness of border closures should also be reflected in future revisions to the International Health Regulations and in negotiations towards a pandemic instrument [4951].

The numerous co-interventions, behavioural adaptations, and improvements in data quality occurring throughout the January 1-June 8, 2020 study period call for caution in the direct interpretation of point estimates of effect sizes. We attempted to minimize biases and reduce confounding by: evaluating at multiple levels (i.e., global, income group, and country); triangulating results from time-series and synthetic control quasi-experimental designs; and conducting an extensive series of falsification, robustness and sensitivity checks using alternative models, time frames and lags. Yet, the possibility of time-dependent misreporting, limited data availability, and persistent under-detection of COVID-19 incidence remain. Because of these unavoidable challenges with analyzing data from initial pandemic waves, in this article we emphasize the consistent directional findings of total border closures’ greater effects on COVID-19 transmission than targeted border closures, rather than potentially inaccurate point estimates of border closures’ impacts on Rt.

Nevertheless, if underreporting of cases within countries can be assumed to have been more prevalent in the initial stages of the pandemic, our findings of decreased propagation at the later stages of the study period can be considered conservative. In addition, the second global intervention evaluated (i.e., total border closures) was found to have a statistically significant protective effect in spite of late-adopting countries being less likely to effectively implement closures. Finally, it is important to note that this study focused on the implementation of border closures during the first phase of the COVID-19 pandemic, did not investigate the impact of maintaining, lifting or reimposing border closures when many countries faced subsequent pandemic waves, and may not be generalizable to other infectious diseases. Indeed, in the year following our study period, targeted border closures enacted in response to the emergence of the Omicron variant of COVID-19 failed to prevent its rapid global dissemination [52, 53].

Conclusions

This study leverages an unprecedented natural experiment to conduct quasi-experimental analyses of border closures’ impacts on global viral transmission. Analyses consistently point to stronger effects of total border closures over targeted border closures to reduce transmission levels of COVID-19 in the initial phases of the pandemic. Although this study identifies earlier adoption and a greater proportion of global population targeted as being important determinants of border closures’ effectiveness, it is difficult to offer concrete guidance for countries that hope to implement targeted border closures through proposed COVID-19 “travel corridors” or restricting travel to countries that have identified new SARS-CoV-2 variants of concern. Such guidance would need to be tailored to the specific country context, the threat being addressed, the feasibility of implementation, and the availability of less restrictive alternatives. The best available evidence on infectious disease border closures has changed as a result of the COVID-19 pandemic. Governments and international agencies should consider the implications of these findings for both their pandemic responses and in designing new global governance arrangements that structure them [54].

In the meantime, governments that were willing to endure the negative economic and social consequences of total or near-total border closures may have succeeded in temporarily slowing COVID-19 transmission in the first phase of the pandemic, which could have bought some countries additional time to implement more robust public health measures. However, unless governments made productive use of this extra preparation time, slowing the COVID-19 pandemic’s arrival might not have been worth the immense consequences of border closures. Also, future border closures are unlikely to impact the global transmission of a pandemic unless the unprecedented scale of these simultaneous border closures impacting over 95% of the world’s population can be repeated. Overall, border closures are not panaceas and should only be deployed in rare circumstances and with great caution.

Supporting information

S1 Text

(PDF)

S1 Data. Matrix of border-closure status by country-day.

Travel restriction status by country-day of every border closure included in the study analyses [available as csv on Scholars Portal].

(XLSX)

S2 Data. Country-specific interrupted time-series results.

Results presented for 0 to 15-day lags [available as csv on Scholars Portal].

(XLSX)

S3 Data. Analysis plan.

Ex ante analysis plan with changes to analytical approach noted [available as pdf on Scholars Portal].

(DOCX)

S4 Data. Global and country-specific interrupted time-series results.

Dickey-Fuller tests for unit roots, Cumby-Huizinga tests for autocorrelation, and results correcting for each lag found to have serial correlation present for all global and country interrupted time series [available as csv on Scholars Portal].

(XLSX)

Acknowledgments

We gratefully acknowledge Gary King for comments on methodological aspects of the manuscript, Michèle Palkovits and Isaac Weldon for their contributions to interpretation of results, as well as Tina Nanyangwe-Moyo and Zun Ge Mao for their contributions to literature review and manuscript revision.

Data Availability

All data, code, and results for analyses are either publicly available, as referenced in Supplementary Materials, or made available through Scholars Portal Dataverse at https://dataverse.scholarsportal.info/dataverse/CTR/.

Funding Statement

SJH is supported by the Canadian Institutes of Health Research (#172982). The funder had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Mateus AL, Otete HE, Beck CR, Dolan GP, Nguyen-Van-Tam JS. Effectiveness of travel restrictions in the rapid containment of human influenza: a systematic review. Bull World Health Organ. 2014;92: 868–880D. doi: 10.2471/BLT.14.135590 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Errett NA, Sauer LM, Rutkow L. An integrative review of the limited evidence on international travel bans as an emerging infectious disease disaster control measure. Journal of Emergency Management. 2020;18: 7–14. doi: 10.5055/jem.2020.0446 [DOI] [PubMed] [Google Scholar]
  • 3.Hoffman SJ. The evolution, etiology and eventualities of the global health security regime. Health Policy and Planning. 2010;25: 510–522. doi: 10.1093/heapol/czq037 [DOI] [PubMed] [Google Scholar]
  • 4.Wang X, Ferro EG, Zhou G, Hashimoto D, Bhatt DL. Association Between Universal Masking in a Health Care System and SARS-CoV-2 Positivity Among Health Care Workers. JAMA. 2020. doi: 10.1001/jama.2020.12897 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Zhang R, Li Y, Zhang AL, Wang Y, Molina MJ. Identifying airborne transmission as the dominant route for the spread of COVID-19. PNAS. 2020. doi: 10.1073/pnas.2009637117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Flaxman S, Mishra S, Gandy A, Unwin HJT, Mellan TA, Coupland H, et al. Estimating the effects of non-pharmaceutical interventions on COVID-19 in Europe. Nature. 2020; 1–8. doi: 10.1038/s41586-020-2405-7 [DOI] [PubMed] [Google Scholar]
  • 7.Hsiang S, Allen D, Annan-Phan S, Bell K, Bolliger I, Chong T, et al. The effect of large-scale anti-contagion policies on the COVID-19 pandemic. Nature. 2020; 1–9. doi: 10.1038/s41586-020-2404-8 [DOI] [PubMed] [Google Scholar]
  • 8.Grépin KA, Ho T-L, Liu Z, Marion S, Piper J, Worsnop CZ, et al. Evidence of the effectiveness of travel-related measures during the early phase of the COVID-19 pandemic: a rapid systematic review. BMJ Global Health. 2021;6: e004537. doi: 10.1136/bmjgh-2020-004537 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Hufnagel L, Brockmann D, Geisel T. Forecast and control of epidemics in a globalized world. Proc Natl Acad Sci. 2004;101: 15124–15129. doi: 10.1073/pnas.0308344101 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Tian H, Liu Y, Li Y, Wu C-H, Chen B, Kraemer MUG, et al. An investigation of transmission control measures during the first 50 days of the COVID-19 epidemic in China. Science. 2020;368: 638–642. doi: 10.1126/science.abb6105 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Zhao S, Zhuang Z, Cao P, Ran J, Gao D, Lou Y, et al. Quantifying the association between domestic travel and the exportation of novel coronavirus (2019-nCoV) cases from Wuhan, China in 2020: a correlational analysis. J Travel Med. 2020;27. doi: 10.1093/jtm/taaa022 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Linka K, Peirlinck M, Costabal FS, Kuhl E. Outbreak dynamics of COVID-19 in Europe and the effect of travel restrictions. Computer Methods in Biomechanics and Biomedical Engineering. 2020;0: 1–8. doi: 10.1080/10255842.2020.1759560 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Chinazzi M, Davis JT, Ajelli M, Gioannini C, Litvinova M, Merler S, et al. The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science. 2020;368: 395–400. doi: 10.1126/science.aba9757 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Davis JT, Chinazzi M, Perra N, Mu K, Piontti AP y, Ajelli M, et al. Estimating the establishment of local transmission and the cryptic phase of the COVID-19 pandemic in the USA. medRxiv. 2020; 2020.07.06.20140285. doi: 10.1101/2020.07.06.20140285 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Anzai A, Kobayashi T, Linton NM, Kinoshita R, Hayashi K, Suzuki A, et al. Assessing the Impact of Reduced Travel on Exportation Dynamics of Novel Coronavirus Infection (COVID-19). J Clin Med. 2020;9. doi: 10.3390/jcm9020601 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Shi S, Tanaka S, Ueno R, Gilmour S, Tanoue Y, Kawashima T, et al. Travel restrictions and SARS-CoV-2 transmission: an effective distance approach to estimate impact. Bull World Health Organ. 2020;98: 518–529. doi: 10.2471/BLT.20.255679 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Public Health Agency of Canada COVID-19 Surveillance and Epidemiology Team. A retrospective analysis of the start of the COVID-19 epidemic in Canada, January 15– March 12, 2020. CCDR. 2020;46: 236–241. doi: 10.14745/ccdr.v46i78a04 [DOI] [Google Scholar]
  • 18.Zhang C, Qian L-X, Hu J-Q. COVID-19 Pandemic with Human Mobility Across Countries. J Oper Res Soc China. 2021;9: 229–244. doi: 10.1007/s40305-020-00317-6 [DOI] [Google Scholar]
  • 19.Xiang Y, Jia Y, Chen L, Guo L, Shu B, Long E. COVID-19 epidemic prediction and the impact of public health interventions: A review of COVID-19 epidemic models. Infectious Disease Modelling. 2021;6: 324–342. doi: 10.1016/j.idm.2021.01.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Shiraef MA, Friesen P, Feddern L, Weiss MA. Did border closures slow SARS-CoV-2? Sci Rep. 2022;12: 1709. doi: 10.1038/s41598-022-05482-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Emeto TI, Alele FO, Ilesanmi OS. Evaluation of the effect of border closure on COVID-19 incidence rates across nine African countries: an interrupted time series study. Trans R Soc Trop Med Hyg. 2021;115: 1174–1183. doi: 10.1093/trstmh/trab033 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Wells CR, Sah P, Moghadas SM, Pandey A, Shoukat A, Wang Y, et al. Impact of international travel and border control measures on the global spread of the novel 2019 coronavirus outbreak. PNAS. 2020;117: 7504–7509. doi: 10.1073/pnas.2002616117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Kraemer MUG, Yang C-H, Gutierrez B, Wu C-H, Klein B, Pigott DM, et al. The effect of human mobility and control measures on the COVID-19 epidemic in China. Science. 2020;368: 493–497. doi: 10.1126/science.abb4218 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Adekunle A, Meehan M, Rojas-Alvarez D, Trauer J, McBryde E. Delaying the COVID-19 epidemic in Australia: evaluating the effectiveness of international travel bans. Australian and New Zealand Journal of Public Health. 2020;44: 257–259. doi: 10.1111/1753-6405.13016 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Russell TW, Wu JT, Clifford S, Edmunds WJ, Kucharski AJ, Jit M. Effect of internationally imported cases on internal spread of COVID-19: a mathematical modelling study. The Lancet Public Health. 2021;6: e12–e20. doi: 10.1016/S2468-2667(20)30263-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Koh WC, Naing L, Wong J. Estimating the impact of physical distancing measures in containing COVID-19: an empirical analysis. International Journal of Infectious Diseases. 2020;100: 42–49. doi: 10.1016/j.ijid.2020.08.026 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Utsunomiya YT, Utsunomiya ATH, Torrecilha RBP, Paulan S de C, Milanesi M, Garcia JF. Growth Rate and Acceleration Analysis of the COVID-19 Pandemic Reveals the Effect of Public Health Measures in Real Time. Frontiers in Medicine. 2020;7. Available: https://www.frontiersin.org/articles/10.3389/fmed.2020.00247 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Zhong L, Diagne M, Wang W, Gao J. Country distancing increase reveals the effectiveness of travel restrictions in stopping COVID-19 transmission. Commun Phys. 2021;4: 1–12. doi: 10.1038/s42005-021-00620-5 [DOI] [Google Scholar]
  • 29.Gostic KM, McGough L, Baskerville EB, Abbott S, Joshi K, Tedijanto C, et al. Practical considerations for measuring the effective reproductive number, Rt. medRxiv. 2020. doi: 10.1371/journal.pcbi.1008409 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Cori A, Ferguson NM, Fraser C, Cauchemez S. A New Framework and Software to Estimate Time-Varying Reproduction Numbers During Epidemics. Am J Epidemiol. 2013;178: 1505–1512. doi: 10.1093/aje/kwt133 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. The Lancet Infectious Diseases. 2020;20: 533–534. doi: 10.1016/S1473-3099(20)30120-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Hale T, Webster, Petherick A, Phillips T, Kira B. Oxford COVID-19 Government Response Tracker. Blavatnik School of Government; 2020. https://www.bsg.ox.ac.uk/research/research-projects/coronavirus-government-response-tracker [DOI] [PubMed]
  • 33.Bernal JL, Cummins S, Gasparrini A. Interrupted time series regression for the evaluation of public health interventions: a tutorial. Int J Epidemiol. 2017;46: 348–355. doi: 10.1093/ije/dyw098 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Lopez Bernal J, Soumerai S, Gasparrini A. A methodological framework for model selection in interrupted time series studies. Journal of Clinical Epidemiology. 2018;103: 82–91. doi: 10.1016/j.jclinepi.2018.05.026 [DOI] [PubMed] [Google Scholar]
  • 35.Bertoni D, Curzi D, Aletti G, Olper A. Estimating the effects of agri-enviornmental measures using difference-in-difference coarsened exact matching. 2020;90. [Google Scholar]
  • 36.Ripollone JE, Huybrechts KF, Rothman KJ, Ferguson RE, Franklin, Jessica M. Evaluating the Utility of Coarsened Exact Matching for Pharmacoepidemiology Using Real and Simulated Claims Data. American Journal of Epidemiology. 2019;189: 613–622. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Wu JT, Leung K, Leung GM. Nowcasting and forecasting the potential domestic and international spread of the 2019-nCoV outbreak originating in Wuhan, China: a modelling study. The Lancet. 2020;395: 689–697. doi: 10.1016/S0140-6736(20)30260-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Kucharski AJ, Russell TW, Diamond C, Liu Y, Edmunds J, Funk S, et al. Early dynamics of transmission and control of COVID-19: a mathematical modelling study. The Lancet Infectious Diseases. 2020;20: 553–558. doi: 10.1016/S1473-3099(20)30144-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Jarynowski A, Wójta-Kempa M, Płatek D, Krzowski Ł, Belik V. Spatial Diversity of COVID-19 Cases in Poland Explained by Mobility Patterns—Preliminary Results. Rochester, NY: Social Science Research Network; 2020 Jun. Report No.: ID 3621152.
  • 40.Ebrahim SH, Ali A, Koya SF, Abdulla M, Binub K, Haridasan RK, et al. Focus on international and domestic travellers are equally important for successful SARS-COV-2 mitigation: ecological comparison of emigrant and migrant travel patterns and COVID-19 trends in Kerala State, India. Journal of Travel Medicine. 2021. doi: 10.1093/jtm/taab003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.International Air Transport Association. World Air Transport Statistics, Plus Edition 2021. Montreal—Geneva; 2021. https://www.iata.org/contentassets/a686ff624550453e8bf0c9b3f7f0ab26/wats-2021-mediakit.pdf
  • 42.Hoffman SJ, Fafard P. Border Closures: A Pandemic of Symbolic Acts in the Time of COVID-19. Vulnerable: The Law, Policy and Ethics of COVID-19. 2020.
  • 43.International Labour Organization. World Employment and Social Outlook: Trends 2021. Geneva: International Labour Office; 2021. https://www.ilo.org/wcmsp5/groups/public/---dgreports/---dcomm/---publ/documents/publication/wcms_795453.pdf
  • 44.Arriola C, Kowalski P, van Tongeren F. Understanding structural effects of COVID-19 on the global economy: First steps | en | OECD. 6 May 2022 [cited 28 Jul 2022]. https://www.oecd.org/publications/understanding-structural-effects-of-covid-19-on-the-global-economy-f6a9ef88-en.htm
  • 45.International Monetary Fund. World Economic Outlook Update, June 2020: A Crisis Like No Other, An Uncertain Recovery. 2020 Jun. https://www.imf.org/en/Publications/WEO/Issues/2020/06/24/WEOUpdateJune2020
  • 46.Yeyati EL, Filippini F. Social and economic impact of COVID-19. Brookings Institution; 2021 Jun. Report No.: 158.
  • 47.World Health Organization. International health regulations. Geneva: World Health Organization; 2005. p. 74. [Google Scholar]
  • 48.Habibi R, Burci GL, de Campos TC, Chirwa D, Cinà M, Dagron S, et al. Do not violate the International Health Regulations during the COVID-19 outbreak. The Lancet. 2020;395: 664–666. doi: 10.1016/S0140-6736(20)30373-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Taylor AL, Habibi R, Burci GL, Dagron S, Eccleston-Turner M, Gostin LO, et al. Solidarity in the wake of COVID-19: reimagining the International Health Regulations. Lancet. 2020;396: 82–83. doi: 10.1016/S0140-6736(20)31417-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Habibi R, Hoffman SJ, Burci GL, de Campos TC, Chirwa D, Cinà M, et al. The Stellenbosch Consensus on Legal National Responses to Public Health Risks: Clarifying Article 43 of the International Health Regulations. International Organizations Law Review. 2020; 1–68. doi: 10.1163/15723747-2020023 [DOI] [Google Scholar]
  • 51.Cinà MM, Hoffman SJ, Burci GL, de Campos TC, Chirwa D, Dagron S, et al. The Stellenbosch Consensus on the International Legal Obligation to Collaborate and Assist in Addressing Pandemics: Clarifying Article 44 of the International Health Regulations. International Organizations Law Review. 2020; 1–30. doi: 10.1163/15723747-2020024 [DOI] [Google Scholar]
  • 52.Meier BM, Bueno de Mesquita J, Burci GL, Chirwa D, Dagron S, Eccleston-Turner M, et al. Travel restrictions and variants of concern: global health laws need to reflect evidence. Bull World Health Organ. 2022;100: 178–178A. doi: 10.2471/BLT.21.287735 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Our World in Data. Share of SARS-CoV-2 sequences that are the omicron variant. In: Our World in Data [Internet]. 2 Aug 2022 [cited 2 Aug 2022]. https://ourworldindata.org/grapher/covid-cases-omicron
  • 54.Nikogosian H, Kickbusch I. The case for an international pandemic treaty. BMJ. 2021;372: n527. doi: 10.1136/bmj.n527 [DOI] [PubMed] [Google Scholar]
PLOS Glob Public Health. doi: 10.1371/journal.pgph.0000980.r001

Decision Letter 0

Atanu Bhattacharjee

24 Jun 2022

PGPH-D-21-01124

Quasi-experimental evaluation of national border closures on COVID-19 transmission

PLOS Global Public Health

Dear Dr. Hoffman,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 23 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Atanu Bhattacharjee, Ph.D

Academic Editor

PLOS Global Public Health

Journal Requirements:

1. Please send a completed 'Competing Interests' statement, including any COIs declared by your co-authors. If you have no competing interests to declare, please state "The authors have declared that no competing interests exist". Otherwise please declare all competing interests beginning with the statement "I have read the journal's policy and the authors of this manuscript have the following competing interests:"

2. Please provide separate figure files in .tif or .eps format and removed from the manuscript file.

For more information about figure files please see our guidelines:

https://journals.plos.org/globalpublichealth/s/figures 

https://journals.plos.org/globalpublichealth/s/figures#loc-file-requirements 

3. Figure 3: please (a) provide a direct link to the base layer of the map used and ensure this is also included in the figure legend; (b) provide a link to the terms of use / license information for the base layer. We cannot publish proprietary or copyrighted maps (e.g. Google Maps, Mapquest) and the terms of use for your map base layer must be compatible with our CC-BY 4.0 license. 

If your map was obtained from a copyrighted source please amend the figure so that the base map used is from an openly available source. Alternatively, please provide explicit written permission from the copyright holder granting you the right to publish the material under our CC-BY 4.0 license.

Please note that the following CC BY licenses are compatible with PLOS license: CC BY 4.0, CC BY 2.0 and CC BY 3.0, meanwhile such licenses as CC BY-ND 3.0 and others are not compatible due to additional restrictions. 

If you are unsure whether you can use a map or not, please do reach out and we will be able to help you. The following websites are good examples of where you can source open access or public domain maps: 

* U.S. Geological Survey (USGS) - All maps are in the public domain. (http://www.usgs.gov

* PlaniGlobe - All maps are published under a Creative Commons license so please cite “PlaniGlobe, http://www.planiglobe.com, CC BY 2.0” in the image credit after the caption. (http://www.planiglobe.com/?lang=enl) 

* Natural Earth - All maps are public domain. (http://www.naturalearthdata.com/about/terms-of-use/)

Additional Editor Comments (if provided):

Authors are requested to modify the manuscript as suggested by the reviewers.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Comments:

This is an interesting piece using the quasi-experimental analysis to evaluate the impact on transmission of COVID-19 by closure of national borders. While not mentioned, it could also be noted that the piece is timely because with new emerging variants of COVID-19, global cases are still on the rise and proper measures and models for public health interventions are required. The authors have also factored in the biases for covid-19 transmission and border closure.

However, there are a few minor areas in which I feel the paper needs some revision:

1. Line 30, Consider removing ‘but no’ instead use “Still, no”.

2. Line 38. Replace ‘not sufficient’ with insufficient.

3. Line 47. Consider deleting ‘decisions on’.

4. The authors have talked about effective reproductive number. As per Cori et al 2013 and Fraser C 2007, the effective reproduction number can be defined in 2 ways: instantaneous reproductive number or as the case reproductive number. Kindly elaborate on which of the two you have considered. I believe that you are considering instantaneous reproductive number but mention this in the text as well.

5. Line 144: Figure 2 is cited before figure 1 (line 151). Kindly correct this.

6. Can you elaborate on the impact of international border closures for only the top 5 hit nations like USA, India, UK, France etc. in 2021 (the second wave) in a short paragraph in discussion?

7. What could be the reason that no major disparities were observed between high-income vs low- and middle-income countries? please shed some light on it.

8. Line 184-190- Out of the countries that had adverse effects of border closures, how frequent the travel is from and to these countries? also, were these countries showed similar outcomes in the following ravel bans in other covid-19 waves as well.

9. The biases involved with border closures and Rt has been mentioned properly in the text.

10. Lines 303-306. Consider rephrasing to “This study presents the first quasi-experimental analysis of border closures’ impacts on viral transmission during a pandemic, taking advantage of an unprecedented natural experiment.”

11. Lines 307-311- add ‘a’ before greater proportion.

12. Lines 311-313- add ‘the’ before ‘threat’, ‘feasibility’ and availability.

13. Line 317. Consider removing ‘that were’ after government.

Reviewer #2: The research work described in this paper is commendable considering the time, energy and quantum of work input in this work. The manuscript is technically sound, systematic and meet PGPH publication criteria. The analysis is sound and all needed supporting information have been made available. However, there are a few comments and questions to be attended to by the authors.

Introduction: Please kindly provide a global picture of COVID-19 within the first 22 weeks of the pandemic while supporting your literature with figures.

Methodology: Line 75. Please what criteria was used in the selection of the 166 countries? Please state the inclusion criteria in the main work. Any justification for limiting your quasi-experimental study to the first 22 weeks of the COVID-19 Pandemic?

What sampling method and technique informed your selection of the 166 countries? Please provide a justification for your choice of the sampling method.

Line 243-244: Please operationally define 'total' and 'targeted' at their first appearance in the text.

Line 240-246: Findings well discussed but please kindly relate your findings to the findings of other studies and determine whether they share similarities or dissimilarities.

Line 263- 264: Please kindly cite an intext reference for that statement since that doesn't seem to reflect a finding from your study.

Line 288: Please kindly check the font size used

Line 294: Please check and correct the font and size.

Results: Please kindly provide a caption or label for figure 1

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Rini Chaturvedi

Reviewer #2: Yes: Dorothy Serwaa Boakye

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0000980.r003

Decision Letter 1

Lorena G Barberia

17 Jan 2023

PGPH-D-21-01124R1

Quasi-experimental evaluation of national border closures on COVID-19 transmission

PLOS Global Public Health

Dear Dr. Hoffman,

Thank you for submitting your manuscript to PLOS Global Public Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Global Public Health’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

EDITOR: Please insert comments here and delete this placeholder text when finished. Be sure to:

  • Indicate which changes you require for acceptance versus which changes you recommend

  • Address any conflicts between the reviews so that it's clear which advice the authors should follow

  • Provide specific feedback from your evaluation of the manuscript

Please ensure that your decision is justified on PLOS Global Public Health’s publication criteria and not, for example, on novelty or perceived impact.

==============================

Please submit your revised manuscript by Feb 16 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at globalpubhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pgph/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Lorena G Barberia

Section Editor

PLOS Global Public Health

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Dear authors,

Thank you for submitting your research to PLOS Global Public Health. We requested an additional review of your revised manuscript that evaluates the impact of border-closure of 166 countries’ using multiple quasi-experimental methods.

We would like for you to revise the final version of your manuscript to address the following minor points in order to strengthen the manuscript prior to publication.

1. The role of mathematical models versus observational data.

As the reviewer notes, some of the statements made in the Abstract and Introduction section imply that results from mathematical models are somewhat limited in evaluating the impact of border closures. Please remove the reference to mathematical models in the abstract. It is not central to the contribution of the manuscript. In the introduction, it would be helpful if you could address the contributions of using real-world data, but also acknowledge that mathematical models can be valuable during the early stages of a public health event (especially when real-world data are scarce).

2. The dependent variable, Rt.

It would be helpful to note that different countries adopted different methodologies to count cases and testing supplies were limited early in the pandemic. Both of these issues affects the calculation of Rt. You note this in the discussion, but I think it could be acknowledged earlier on to address the validity of this variable as your preferred dependent variable.

3. Total border closures banning vs. targeted border closures banning travel from specific countries

A central contribution of the study is its capacity to show differences/tradeoffs from total border closures to targeted border closures, but as the study acknowledges total border closures only became more widespread after March 2020. The abstract states "Total border closures banning non-essential travel from all countries and (to a lesser extent) targeted border closures banning travel from specific countries had some effect on temporarily slowing COVID-19 transmission in those countries that implemented them." I think the abstract could emphasize the differences in the findings from both policies. The Oxford border closure data does not detail the target country for partial border closures. Given this data limitation, the manuscript could acknowledge that it is harder to evaluate the impact of targeted border closures, as they targeted different countries and these were not necessarily the countries where most cases were increasing. For example, Brazil singled out Venezuela for border closures in the early period of the pandemic. This is unlikely to be have been very effective.

4. Figure 1: shouldn’t the y axis be “% of world population impacted”?

5. Methods. Please explain why linear regression model provide more conservative and directly comparable outcomes compared to exponential or logarithmic regression models? An explanation or a relevant citation must be provided.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #3: (No Response)

**********

2. Does this manuscript meet PLOS Global Public Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #3: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #3: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Global Public Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #3: Thank you for the opportunity to review this manuscript of high-importance. This manuscript evaluated the impact of border-closure of 166 countries’ using multiple quasi-experimental methods. The results of the study indicate that total border closures had some effect on reducing COVID-19 transmission, and I agree with the recommendations that the authors have made. This manuscript is scientifically sound and well-written, yet there are some very minor points to address in order to strengthen the manuscript. I hope the authors well in their future research.

General points

Some of the statements made by the authors in the Introduction section imply that results from mathematical models are somewhat limited in evaluating the impact of border closures. While I agree real-world data provides better evidence for policy making, mathematical models are also highly valuable during the early stages of a public health event (especially when real-world data are scarce). This should be acknowledged.

Figure 1: shouldn’t the y axis be “% of world population impacted”?

Line 131: Why does the linear regression model provide more conservative and directly comparable outcomes compared to exponential or logarithmic regression models? An explanation or a relevant citation must be provided.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #3: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Glob Public Health. doi: 10.1371/journal.pgph.0000980.r005

Decision Letter 2

Lorena G Barberia

23 Jan 2023

Quasi-experimental evaluation of national border closures on COVID-19 transmission

PGPH-D-21-01124R2

Dear Dr. Hoffman,

We are pleased to inform you that your manuscript 'Quasi-experimental evaluation of national border closures on COVID-19 transmission' has been provisionally accepted for publication in PLOS Global Public Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow up email. A member of our team will be in touch with a set of requests.

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact globalpubhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Global Public Health.

Best regards,

Lorena G Barberia

Section Editor

PLOS Global Public Health

***********************************************************

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Text

    (PDF)

    S1 Data. Matrix of border-closure status by country-day.

    Travel restriction status by country-day of every border closure included in the study analyses [available as csv on Scholars Portal].

    (XLSX)

    S2 Data. Country-specific interrupted time-series results.

    Results presented for 0 to 15-day lags [available as csv on Scholars Portal].

    (XLSX)

    S3 Data. Analysis plan.

    Ex ante analysis plan with changes to analytical approach noted [available as pdf on Scholars Portal].

    (DOCX)

    S4 Data. Global and country-specific interrupted time-series results.

    Dickey-Fuller tests for unit roots, Cumby-Huizinga tests for autocorrelation, and results correcting for each lag found to have serial correlation present for all global and country interrupted time series [available as csv on Scholars Portal].

    (XLSX)

    Attachment

    Submitted filename: Response to reviewers (08-05-2022).pdf

    Attachment

    Submitted filename: Evaluation Manuscript R2 cover letter (2023-01-09).pdf

    Data Availability Statement

    All data, code, and results for analyses are either publicly available, as referenced in Supplementary Materials, or made available through Scholars Portal Dataverse at https://dataverse.scholarsportal.info/dataverse/CTR/.


    Articles from PLOS Global Public Health are provided here courtesy of PLOS

    RESOURCES