Skip to main content
PLOS Digital Health logoLink to PLOS Digital Health
. 2022 May 26;1(5):e0000035. doi: 10.1371/journal.pdig.0000035

Evidence of pandemic fatigue associated with stricter tiered COVID-19 restrictions

Federico Delussu 1, Michele Tizzoni 1,#, Laetitia Gauvin 1,*,#
Editor: Dylan A Mordaunt2
PMCID: PMC9931343  PMID: 36812519

Abstract

Despite the availability of effective vaccines against SARS-CoV-2, non-pharmaceutical interventions remain an important part of the effort to reduce viral circulation caused by emerging variants with the capability of evading vaccine-induced immunity. With the aim of striking a balance between effective mitigation and long-term sustainability, several governments worldwide have adopted systems of tiered interventions, of increasing stringency, that are calibrated according to periodic risk assessments. A key challenge remains in quantifying temporal changes in adherence to interventions, which can decrease over time due to pandemic fatigue, under such kind of multilevel strategies. Here, we examine whether there was a reduction in adherence to tiered restrictions that were imposed in Italy from November 2020 through May 2021, and in particular we assess whether temporal trends in adherence depended on the intensity of the restrictions adopted. We analyzed daily changes in movements and in residential time, combining mobility data with the restriction tier enforced in the Italian regions. Through mixed-effects regression models, we identified a general trend of reduction in adherence and an additional effect of faster waning associated with the most stringent tier. We estimated both effects being of the same order of magnitude, suggesting that adherence decreased twice as fast during the strictest tier as in the least stringent one. Our results provide a quantitative measure of behavioral responses to tiered interventions—a metric of pandemic fatigue—that can be integrated into mathematical models to evaluate future epidemic scenarios.

Author summary

Pandemic fatigue, the decreased motivation to adhere to social distancing measures and adopt health-protective behaviors, represents a significant concern for policymakers and health officials, as novel SARS-CoV-2 variants undermine the effects of vaccinations and non-pharmaceutical interventions become measures of last resort. Here, we investigate the effects of pandemic fatigue by measuring the temporal variation in adherence to mobility restrictions in Italy, during the period November 2020—May 2021, when a tiered restriction system was adopted to mitigate the spread of COVID-19. We measure such effect by analyzing large-scale mobility traces from Google and Facebook, in the Italian regions, through a statistical model that accounts for a global temporal trend and a local time trend, associated with the stringency of the interventions. Our results show that adherence to the restrictions decreased over time, and that it decreased faster when the strictest tier, the red one, was in place. Our study provides evidence that adherence to interventions can wane at different pace, depending on their stringency: such insight can help evaluating the interplay between mobility restrictions, behavior and disease dynamics in epidemic models.

Introduction

Since the beginning of November 2020, to fight COVID-19 Italy adopted a system of tiered social distancing measures based on 3 levels of increasingly stricter restrictions coded as yellow, orange, and red [1]. The system has remained in place since then, on a regional basis, and the activation of a specific tier is automatically enforced according to a weekly epidemiological risk assessment that takes into account healthcare capacity and local COVID-19 incidence. Although vaccination uptake has reached more than 80% of the eligible population in Italy, and booster doses have been administered since early October 2021, non-pharmaceutical interventions (NPIs) may still be needed to curb the rise of infections during winter months. Wider circulation of SARS-CoV-2 and the emergence of new variants of concern may require the enforcement of increasingly higher restriction tiers but a reduced motivation to comply, and lowered individual risk perception may decrease the adherence to a new wave of social distancing policies.

Temporal variations in adherence to protective behaviors against COVID-19 were observed during the first pandemic wave in different countries and they were characterized as a possible consequence of pandemic fatigue [2]. The concept of pandemic fatigue is loosely defined as a decreased motivation to adopt health-protective measures, and its existence has been hypothesized since the early phases of the COVID-19 pandemic [3]. According to the WHO, pandemic fatigue is the demotivation to follow recommended protective behaviours, emerging gradually over time and affected by a number of emotions, experiences and perceptions [4]. There has been substantial debate about the existence and quantifiability of such phenomenon, which has been harshly criticized when it was invoked as an argument against mitigation policies in the UK [5, 6]. However, previous studies have shown that individual willingness to comply with protective behaviors changed over time, and varied across kinds of behaviors and across personal psychological traits [7, 8]. During the first COVID-19 wave, reductions in adherence were found to be stronger for high-cost behaviors, such as physical distancing, while low-cost behaviors, such as mask adoption, did not change substantially from initial levels [2]. After the initial adoption of blanket lockdowns of January-March 2020, to face the following infection waves a few governments worldwide have resorted to staged restriction systems, where social distancing measures are calibrated according to local risk factors [9]. For instance, this happened in the UK [10], Italy [1], China [11] and California [12]. From a policy perspective, it is important to assess whether the previously observed effects of pandemic fatigue are also present and measurable when a tiered restriction system is in place. In principle, a more gradual tightening of NPIs may support higher levels of compliance, however, whether temporal trends in adherence are expected to remain constant for any degree of restrictions remains an open question. Evaluating the long-term sustainability of tiered NPIs, together with their effectiveness against the spread of SARS-CoV-2 [13, 14], is key to mount an effective response to the epidemic.

In this study, we investigated how adherence to mobility restrictions changed in time under a tiered system, over the course of 7 months in Italy, through the analysis of mobility indicators publicly available from Facebook and Google. Italy represents a peculiar case, since NPIs have been structured into a tiered system for more than one year and the system has been consistently enforced in all regions, in face of two consecutive waves of COVID-19 resurgence during the the Fall/Winter 2020–2021. By analyzing mobility data in the 20 Italian regions, we explored how changes in adherence to the restrictions varied over time, and whether such temporal variations were different by color tier. The main goal of our study was measuring behavioral patterns that could potentially hint at a reduced adherence, as an indicator of pandemic fatigue, and relate such patterns to the restriction tier in place.

Results

We gathered the daily relative change of individual mobility as measured by Facebook and Google (see Methods for more details on these indicators), in each of the 20 Italian regions, and we associated the relative change in mobility with the restriction tier that was in place each day. Fig 1 displays the daily percentage change in movement by Facebook users in the Italian regions between November 2020 and June 2021, where each data point is coloured according to the corresponding tier: yellow, orange or red. Data from Google of the same period are shown in S1 Fig. The two indicators capture two different and complementary aspects of mobility: while Facebook measures the change in the number of movements, Google estimates the change in time spent at home, thus providing an indicator of stillness.

Fig 1. Mobility changes and tiered restrictions.

Fig 1

Daily relative change of mobility—as measured by Facebook—with respect to the baseline in the Italian regions, ordered alphabetically from top to bottom. Color coding (yellow, orange, red) indicates the tier that was in place on a given day. Gray indicates the absence of tiered restrictions (only in Sardegna). For a detailed definition of this metric see the Methods section.

As it can be seen from Fig 1, every region experienced all the three restriction tiers in different non-consecutive periods. Each tier introduced specific mandates to limit individual movements and increase social distancing, ranging from a 10 PM—5 AM curfew in the yellow tier, up to a general stay-at-home mandate in the red tier. In the Methods, we provide a complete description of the measures introduced by each tier.

We characterized the trends in adherence to social distancing by adopting mixed-effects regression models to analyze the temporal evolution of the change in movement, or the change in time spent at home. To assess the presence of both a general time trend—that is, a global effect of fatigue—and a local time trend—that is a faster or slower change in adherence in presence of a specific tier—we compared the results of 5 different model specifications (see the Methods for a full definition). The most detailed model includes both a general time trend and a local time trend associated with each color tier, and a random intercept for each region and for each tier. The coefficient of the general time trend measures the overall trend in movement since the beginning of the restrictions, that is from November 6, 2020. The coefficients associated to the local time variable measure the trend of change in movement since the date of introduction of a new tier. To evaluate the relevance of a model that includes both a global time trend and a local time trend dependent on the tier, we introduced 3 simpler models and one model that controls for risk perception. The 3 simpler models are: one that includes only the global time trend, one that considers only the local time trend, independent of the tier, and finally a model that includes only a local time trend dependent on the tier. To control for risk perception, we add to the full model one epidemiological covariate to be used as a control variable. We consider three different variables to this end: the daily reported number of positive cases by region, the daily number of new hospitalizations and daily ICU admissions.

Tables 1 and 2 report the estimated coefficients for the first 4 models considered, for the relative change in movement and the change in residential time, respectively. Overall, we consistently found a global trend of increase in mobility (decrease in time spent at home, respectively) both when including or excluding the local time trends (γ1,0 of Models 1 and 4 in Tables 1 and 2). The two models performed best, when considering their fit to the data both in terms of their adjusted R2 and Akaike Information Criterion (AIC) values. This shows that change in movements effectively increased over the full period of study, an effect that can be interpreted as a general decrease in adherence to the restrictions. Models that included a local time effect only, either independent of the color tier (Model 2) or different by tier (Model 3), were characterized by a lower statistical performance. However, the inclusion of a different local trend by color was favored with respect to an equal effect by tier, as indicated by the difference of AIC, ΔAIC = 6 for Facebook data and ΔAIC = 20 for Google data. This indicates that the local trend was dependent on the color tier that was put in place. As can been seen from Tables 1 and 2, the full model (Model 4) that included both the global time trend and the local time trend by color tier, provided the best fit to the data (adj-R2 = 0.454 for Facebook data, adj-R2 = 0.707 for Google data) and it was the most likely according the AIC value.

Table 1. Model results for the relative change in movement as dependent variable.

Estimates of the regression coefficients and their standard error (in parenthesis). Each column corresponds to a different model.

Dependent variable:
Change in movement (%)
(1) (2) (3) (4)
Global time trend
γ 1,0 0.082*** 0.082***
(0.003) (0.003)
Local time trend
γ 2,0 0.116*** 0.255*** 0.155***
(0.017) (0.050) (0.045)
γ2,1 (orange) −0.183*** −0.149***
(0.058) (0.052)
γ2,1 (yellow) −0.135** −0.165***
(0.057) (0.051)
Intercept
γ 0,0 −39.339*** −32.202*** −33.626*** −41.047***
(0.862) (0.936) (1.073) (0.993)
γ0,1 (orange) 9.598*** 9.695*** 11.768*** 11.343***
(0.501) (0.561) (0.862) (0.770)
γ0,1 (yellow) 18.024*** 18.949*** 20.487*** 19.990***
(0.489) (0.547) (0.890) (0.794)
Observations 3,222 3,222 3,222 3,222
Adjusted R2 0.453 0.313 0.315 0.454
AIC 23,638 24,368 24,362 23,632

Note:

*p<0.1;

**p<0.05;

***p<0.01

Table 2. Model results for the relative change in residential time as dependent variable.

Estimates of the regression coefficients and their standard error (in parenthesis). Each column corresponds to a different model.

Dependent variable:
Change in residential time (%)
(1) (2) (3) (4)
Global time trend
γ 1,0 −0.040*** −0.039***
(0.001) (0.001)
Local time trend
γ 2,0 −0.057*** −0.092*** −0.045***
(0.005) (0.016) (0.011)
γ2,1 (orange) 0.066*** 0.051***
(0.018) (0.013)
γ2,1 (yellow) 0.017 0.028**
(0.018) (0.013)
Intercept
γ 0,0 18.814*** 15.312*** 15.592*** 19.225***
(0.218) (0.293) (0.335) (0.250)
γ0,1 (orange) −4.056*** −4.087*** −4.810*** −4.628***
(0.125) (0.173) (0.267) (0.193)
γ0,1 (yellow) −7.248*** −7.554*** −7.676*** −7.520***
(0.121) (0.169) (0.274) (0.198)
Observations 3,401 3,401 3,401 3,401
Adjusted R2 0.705 0.433 0.436 0.707
AIC 15,645 17,873 17,853 15,626

Note:

*p<0.1;

**p<0.05;

***p<0.01

Fig 2 displays the estimated coefficients’ values, and their associated error, using the relative change in movement as dependent variable of the full model. Overall, results suggest that adherence to the measures decreased over time, as indicated by a significant and positive trend of the mobility change during the study period (Fig 2, gray). Model’s coefficients estimated on the variation in residential time measured by Google provided a similar picture, as shown in Fig 3. Such effect was estimated to be equal to 0.08% daily increase in the relative change of movements and 0.04% increase in time spent outside home (which we interpret as the opposite of the change in residential time, see caption of Fig 3).

Fig 2. Model estimates for the relative change in mobility.

Fig 2

Estimates of the regression coefficients of the mixed-effects model when the daily relative change in mobility is the dependent variable. Point estimates are evaluated from Table 1. Error bars correspond to the Standard Error, colors indicate the associated tier.

Fig 3. Model estimates for the relative change in time spent outside home.

Fig 3

Estimates of the regression coefficients of the mixed-effects model when the daily change in residential time is the dependent variable. Point estimates are evaluated from Table 2. Error bars correspond to the Standard Error, colors indicate the associated tier. To ease a direct comparison with the results obtained with Facebook data, we reverted the sign of the dependent variable, so that it can be interpreted as the relative change in time spent outside home.

Furthermore, we found an additional effect that suggests a faster decline in adherence associated with the red tier. Indeed, after an introduction of the red tier, and before changing to a different color, individual mobility increased faster than the general time trend, with an additional increase in the relative mobility of 0.16% per day (Fig 2, red) and an additional decrease in residential time of 0.04% per day (Fig 3, red). On the other hand, movements during the orange and yellow tiers did not display a significant association with an additional decrease or increase in adherence (Fig 2) with respect to the general trend. When considering the residential data, the model did not find any statistically significant effect of the orange tier while each introduction of a yellow tier was characterized by a small yet significant reduction of the time spent at home, equal to a 0.02% daily decrease. To better contextualize our results, the estimated general time trend corresponds to more than 15% increase in the relative mobility change over the whole study period. Moreover, while 2 weeks under a yellow tier would lead to an average increase in movements of about 1%, 2 weeks under the red tier would lead to an average 3% increase in the relative mobility. Overall, the strictest tier led to a faster increase in the relative mobility and a faster decrease in the time spent at home.

Including an epidemiological covariate as a control variable (Model 5), marginally improved the model fit but it did not affect the results on the changes in adherence as shown in S3 and S4 Tables. The results were robust in all cases, either considering regional COVID-19 incidence, or hospitalizations, or ICU admissions, as a proxy for risk perception.

Discussion

In our study, we evaluated temporal trends in the adherence to mobility restrictions, under a tiered system. Our model highlighted the presence of a temporal variation in adherence to mobility restrictions, which can be broadly ascribed to the effect of pandemic fatigue [2]. In particular, our statistical analysis showed that changes in adherence were faster during periods characterized by the strictest level of restrictions (the red tier). Interestingly, the magnitude of the two effects—the decrease in adherence over time and specifically during the red tier—was of a similar order. This means, in practice, that the introduction of the red tier doubled the speed of reduction in adherence with respect to the adoption of the yellow tier only. The analysis of two complementary data sets led to the same result, although the effect measured with residential data was smaller than the one observed with movement data. This is not surprising, because variations in the daily time spent at home can not exceed the natural limit of 50% and they are usually much smaller. Indeed, we expect to see variations in the effect we measured, depending on the choice of the target mobility metric. Recently, Weill and collaborators [15] have shown that the choice of mobility measures can lead to different outcomes in studies aimed at assessing the impact of NPIs on human movements. It would be interesting to extend our work by investigating changes in adherence through other indicators that can be derived from mobile phone data, such as spatial proximity or the radius gyration [16, 17].

In a recent paper, analyzing 6 different mobility metrics from Italy over the period September 25—November 25, 2020, Manica and coauthors noticed a possible reduction in compliance during the red tier [1]. However, due to the short time frame under study, they could not derive any conclusion on this effect. Our study confirmed their early remark, through a robust statistical analysis, by considering the lift and the introduction of different tiers over a much longer time frame of 7 months.

Our results have important implications for modelling efforts aimed at assessing future epidemic scenarios under the adoption of different NPIs and vaccination strategies. A few authors incorporated changes in adherence in their modeling studies so far [1821], while models usually assumed a sustained adherence over time due to the lack of available data. According to the results of our analysis, when performing scenario analysis, epidemic modelers should incorporate a faster reduction in adherence in presence of stricter restrictions. It is important to note that our work does not allow to draw conclusions regarding the effectiveness of a specific set of NPIs against the spread of SARS-CoV-2. Despite the observed reduction in adherence over time, and its additional effects with and increased restriction tier, high intensity interventions, introduced for a relatively short period of time, may still be the best policy option to drastically curb the epidemic spread. A recent work by Di Domenico et al. [19] based on French data found that the loss of adherence occurred faster during the second lockdown than the first one. However, even when taking this effect into account, the authors have shown that milder interventions tend to be sub-optimal in the long run, due to the higher transmissibility of new variants and the sustained pressure on the healthcare system that inevitably follows large viral circulation.

Our work comes with a set of limitations. First, we derived our conclusions from observational data that are subject to biases. Mobility data from both Facebook and Google are collected from users who opted-in to share their location history and therefore may not be fully representative of the whole population. However, both data sources achieve a high spatial coverage in Italy, as discussed in previous studies [22, 23] and they have been extensively used to assess the impact of NPIs during the pandemic, worldwide [2427].

Another source of uncertainty is the observational nature of our study. Despite the consistent reduction in adherence we measured using two independent datasets, we can only speculate about the underlying causes. Additional research based on individual survey data is needed to untangle the psychological determinants of health-related behaviors and in particular of pandemic fatigue [2830]. Our analysis allowed us to measure changes in behaviors related to movements, however it does not provide insights into other types of behaviors, such as face masks wearing, hand hygiene or reduction in close-proximity contacts, which could exhibit different and even increasing adherence patterns [2]. Mobility, however, remains a reliable proxy to measure community transmission, in particular during periods of sustained viral circulation [26, 31, 32]. In our model we took into account regional differences by including a varying intercept, however it is important to observe that spatial heterogeneities in responses to restrictions can be partially explained by socio-economic determinants, such as the local structure of the labour force [33, 34] or wealth disparities [35]. Finally, the time frame of our study includes two important events, that could have affected the adherence to restrictions with two opposite effects. On the one hand, the beginning of the mass vaccination campaign in Italy, which may have affected the adherence to restrictions by inducing changes in risk perception [36]. The vaccination campaign in Italy officially started on December 27, 2020, however, it was not until April 2021 that vaccine administrations took off, reaching about 30% of the whole population by May 15 [37]. On the other hand, in the same period, a highly pathogenic pandemic wave caused by the Alpha variant hit the country [38], thus potentially leading to increase the adoption of health protecting behaviors. Untangling the combined effects of a high vaccination coverage and the emergence of new, more transmissible, variants on the behavioral responses to NPIs remains an open research question that will be important to address in future work.

In conclusion, we have shown that in a system of tiered restrictions, adherence can be difficult to sustain over time and more so when the most stringent measures are enforced. We focused on the specific case of Italy, due to the availability of relatively long time series, but our approach can be easily extended to other countries, in presence of a similar tiered intervention system. As NPIs remain an important tool against COVID-19 even with widespread vaccination coverage [39], our results will be useful to inform epidemic models in the design of optimal intervention policies for future pandemic waves.

Materials and methods

Mobility data

To evaluate time trends in mobility changes, we used two publicly available data sources. The first is the Movement Range Maps released by the Facebook Data for Good program and made publicly available through the Humanitarian Data Exchange platform at [40]. Our main quantity of interest is the Change in Movement metric, during the period starting from November 6, 2020—when the tiered restrictions were first adopted—until May 30, 2021 that is the last day of 2021 before at least one region removed all restrictions (entering the so-called white tier). This mobility metric relies on the number of 16-level Bing tiles (whose size is approximately 600×600 meters at the Equator) that are visited every day by Facebook users in the 20 Italian regions. The Change in Movement is then defined as the relative change in the average number of tiles visited by the users of a given region with respect to a baseline that predates the introduction of social distancing measures. Additional details on the metric definition can be found at [41].

The second data source are the COVID-19 Community Mobility Reports made publicly available by Google [42]. Since March 2020, Google provides daily time-series of mobility changes across different categories of places, such as retail and recreation, groceries and pharmacies, parks, transit, residential. Data is collected, aggregated and anonymized with differential privacy, from Android users who have opted-in to Location History [25, 43]. Mobility changes are computed with respect to a baseline that corresponds to mobility levels observed before the pandemic, between January and February 2020. In this study, our main quantity of interest is the relative mobility change in Residential category, defined as the relative change in total time spent by users in residential areas.

In the following, we will denote the relative change in movement, independently from the data source, as mr,t, where r stands for region and t for time, in days. However, it is important to note that the two quantities of interest are expected to vary along different directions, as a consequence of social distancing: the Change in Movement will decrease, taking negative percentage values, and the Residential movement will increase, taking positive percentage values.

Tiered restrictions

The system of three-tiers restrictions has been introduced in Italy on November 6, 2020. Each tier is associated with a color, according to increasing levels of restrictions: yellow, orange, red. Tiers are assigned on a regional basis, according to the epidemiological situation and, in particular, to a risk assessment based on several indicator, including the weekly COVID-19 incidence, the time-varying reproductive number and the proportion of occupied ICU beds, among others.

Independently from the tier, the following measures were always in place during the study period (November 6, 2020—May 30, 2021):

  • Mandatory face mask wearing in outdoor spaces.

  • Closure of all indoor recreational, sport and cultural venues.

  • 50% capacity reduction of all public transport services.

Moreover, the yellow tier introduced the additional measures:

  • Stay-at-home mandate between 10pm and 5am (except for work, health and other certified reasons).

  • Shopping malls closed during weekends and holidays (with the exception of essential retail & services).

  • Distance learning in high schools and universities.

  • No service in cafes, bars and restaurants after 6pm and take away allowed until 10pm.

The orange tier introduces stricter measures as follows:

  • Stay-at-home mandate between 10pm and 5am and ban on movements between municipalities and to/from other regions (except for work, health and other certified reasons).

  • Shopping malls closed during weekends and holidays (with the exception of essential retail & services).

  • Distance learning in high schools and universities.

  • Closure of all cafes, bars and restaurants. Take away allowed until 10pm.

Social distancing measures in red tier were:

  • Stay-at-home mandate and ban on movements between municipalities and to/from other regions (except for work, health and other certified reasons).

  • Closure of all shops (with the exception of essential retail & services).

  • Distance learning in second and third grade of middle schools, in all grades of high schools and universities.

  • Closure of all cafes, bars and restaurants. Take away allowed until 10pm.

Statistical model

To estimate time trends in the evolution of the movement relative change across regions, we run a time series regression with mixed-effects, with mr,t as the dependent variable. To measure the time trend both globally, i.e. over the period of tiered restrictions, and locally, i.e. over each new period of a given tier, we introduced two independent variables: the time since the beginning of the tiered restrictions, t, and the time since the last change of tier Δt. To control for level of perceived risk associated with the infection, we included epidemiological covariates, e(r, t), at regional level. Such covariates are: the daily number of confirmed COVID-19 cases, the daily number of hospitalizations, the daily number of ICU admissions. The general equation for the models we fit is given by:

mr,t=β0,r(color)+β1*time+β2,t(color)*Δt+β3*e(r,t) (1)

where:

β0,r=γ0,0+γ0,1(color)+γ0,2(region)β1=γ1,0β2,t=γ2,0+γ2,1(color)β3=γ3,0 (2)

We compare the results of different model specifications, by fitting 5 versions of the model defined above:

  1. the model only considers the global time trend, estimating the intercepts β0,r(color) and β1;

  2. the model only considers the local trend, i.e. the trend after each change of tier independently on the tier color, by setting all the coefficients equal to 0 except for β0,r(color) and γ2,0;

  3. we consider the local trend, taking in consideration the color, looking for β0,r(color) and β2,t(color);

  4. we consider both the global and the local trends, measuring β0,r, β1, and β2,t.

  5. we consider both the global and the local trends, and we control for risk perception through β3, searching for all the coefficients.

We used the function lm() of the R stats package to fit the 5 models [44].

In our analysis, we excluded data from the period from December 15, 2020 to January 10, 2021 as most of those days were calendar holidays that strongly affected individual mobility, an effect that could bias the final results. Sardinia is the only region that experienced a short period of white tier (indicating no restrictions) in March, much earlier than all other regions, and for this reason we excluded Sardinia from the analysis. Moreover, in the case of Trentino Alto Adige, the spatial area considered by Facebook to compute the mobility changes and the definition of region for the tier assignment do not match. For this reason we excluded Trentino Alto Adige from the analysis of Facebook data. Overall, both regions represent less than 3% of the Italian population.

We present the results of the first 4 models in Tables 1 and 2, for the two datasets under study. We provide the intercept values for the regions in S1 and S2 Tables of the Supporting Information.

Results of model 5, evaluated with 3 different epidemiological covariates, are presented in S3 and S4 Tables.

The coefficient values have to be interpreted with respect to a reference value. In our case, the Abruzzo region and red were taken as references for region and tier color, respectively. To be more precise, the value of γ0,0 corresponds the mean movement relative change during the red zone in the region of Abruzzo. The same coefficient for another region is obtained by summing γ0,0 and the intercept value of that region given in S1 or S2 Tables. The slope of the local trend during a period of orange (resp. yellow) tier (independently on the region) is given by the sum of γ2,0 and γ2,1(orange) (respectively, γ2,1(yellow)). Figs 2 and 3 report the total effects, that is the sums of the estimated coefficients and their reference for an ease of interpretation.

Supporting information

S1 Fig. Changes in residential mobility and tiered restrictions.

Daily relative change in the residential time—as measured by Google—with respect to baseline, in the Italian regions ordered alphabetically from top to bottom. Color coding indicates the tier that was in place each day. Gray indicates the absence of restrictions.

(PDF)

S1 Table. Model intercepts by region for the relative change in movement as dependent variable.

(PDF)

S2 Table. Model intercepts by region for the relative change in residential time as dependent variable.

(PDF)

S3 Table. Model results for the relative change in movement as dependent variable, controlling for risk perception.

(PDF)

S4 Table. Model results for the relative change in residential time as dependent variable, controlling for risk perception.

(PDF)

S1 Data. Daily values of COVID-19 incidence, hospitalization, ICU admission and tier by region.

(CSV)

Acknowledgments

We gratefully acknowledge Lorenzo Ruffino for his help collecting data about the timeline of restrictions.

Data Availability

Movement data used in this study are publicly available at: https://data.humdata.org/dataset/movement-range-maps and https://www.google.com/covid19/mobility/. All other data is provided as a Supplementary File to the manuscript.

Funding Statement

The study was partially supported by the Lagrange Project of the ISI Foundation funded by the CRT Foundation. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1. Manica M, Guzzetta G, Riccardo F, Valenti A, Poletti P, Marziano V, et al. Impact of tiered restrictions on human activities and the epidemiology of the second wave of COVID-19 in Italy. Nature Communications. 2021;12 (4570). doi: 10.1038/s41467-021-24832-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Petherick A, Goldszmidt R, Andrade EB, Furst R, Hale T, Pott A, et al. A worldwide assessment of changes in adherence to COVID-19 protective behaviours and hypothesized pandemic fatigue. Nature Human Behaviour. 2021;5(9):1145–1160. doi: 10.1038/s41562-021-01181-x [DOI] [PubMed] [Google Scholar]
  • 3. Michie S, West R, Harvey N. The concept of “fatigue” in tackling covid-19. BMJ. 2020;371. [DOI] [PubMed] [Google Scholar]
  • 4.WHO. Pandemic Fatigue. Reinvigorating the Public to Prevent COVID-19. Policy framework for supporting pandemic prevention and management. 2020.
  • 5. Abbasi K. Behavioural fatigue: a flawed idea central to a flawed pandemic response. BMJ. 2020;370(m3093). [Google Scholar]
  • 6. Harvey N. Behavioral fatigue: real phenomenon, naïve construct, or policy contrivance? Frontiers in Psychology. 2020;11:2960. doi: 10.3389/fpsyg.2020.589892 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Wright L, Steptoe A, Fancourt D. Patterns of compliance with COVID-19 preventive behaviours: a latent class analysis of 20 000 UK adults. J Epidemiol Community Health. 2022. Mar 1;76(3):247–53. doi: 10.1136/jech-2021-216876 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Lilleholt L, Zettler I, Betsch C, Böhm R. Pandemic Fatigue: Measurement, Correlates, and Consequences. Preprint at PsyArxiv. 2020.
  • 9. Phillips T, Zhang Y, Petherick A. A year of living distantly: global trends in the use of stay-at-home orders over the first 12 months of the COVID-19 pandemic. Interface Focus. 2021;11(6):20210041. doi: 10.1098/rsfs.2021.0041 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Zhang X, Owen G, Green M, Buchan I, Barr B. Evaluating the impacts of tiered restrictions introduced in England, during October and December 2020 on COVID-19 cases: A synthetic control study. medRxiv. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11. Ge J, He D, Lin Z, Zhu H, Zhuang Z. Four-tier response system and spatial propagation of COVID-19 in China by a network model. Mathematical Biosciences. 2020;330:108484. doi: 10.1016/j.mbs.2020.108484 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12. Schwarz EL, Schwarz L, Teyton A, Crist K, Benmarhnia T. The Role of the California Tier System in Controlling Population Mobility During the COVID-19 Pandemic. Research Square. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Brauner JM, Mindermann S, Sharma M, Johnston D, Salvatier J, Gavenčiak T, et al. Inferring the effectiveness of government interventions against COVID-19. Science. 2021;371 (6531). doi: 10.1126/science.abd9338 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Haug N, Geyrhofer L, Londei A, Dervic E, Desvars-Larrive A, Loreto V, et al. Ranking the effectiveness of worldwide COVID-19 government interventions. Nature Human Behaviour. 2020;4(12):1303–1312. doi: 10.1038/s41562-020-01009-0 [DOI] [PubMed] [Google Scholar]
  • 15.Weill JA, Stigler M, Deschenes O, Springborn MR. Researchers’ Degrees-of-Flexibility and the Credibility of Difference-in-Differences Estimates: Evidence From the Pandemic Policy Evaluations. National Bureau of Economic Research; 2021.
  • 16. Pepe E, Bajardi P, Gauvin L, Privitera F, Lake B, Cattuto C, et al. COVID-19 outbreak response, a dataset to assess mobility changes in Italy following national lockdown. Scientific Data. 2020;7(1):1–7. doi: 10.1038/s41597-020-00575-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Crawford FW, Jones SA, Cartter M, Dean SG, Warren JL, Li ZR, et al. Impact of close interpersonal contact on COVID-19 incidence: Evidence from 1 year of mobile device data. Science Advances. 2022;8(1):eabi5499. doi: 10.1126/sciadv.abi5499 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Weitz JS, Beckett SJ, Coenen AR, Demory D, Dominguez-Mirazo M, Dushoff J, et al. Modeling shield immunity to reduce COVID-19 epidemic spread. Nature Medicine. 2020;26(6):849–854. doi: 10.1038/s41591-020-0895-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19. Di Domenico L, Sabbatini CE, Boëlle PY, Poletto C, Crépey P, Paireau J, et al. Adherence and sustainability of interventions informing optimal control against COVID-19 pandemic. Communications Medicine. 2021;1(57). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20. Behring BM, Rizzo A, Porfiri M. How adherence to public health measures shapes epidemic spreading: A temporal network model. Chaos: An Interdisciplinary Journal of Nonlinear Science. 2021;31(4):043115. doi: 10.1063/5.0041993 [DOI] [PubMed] [Google Scholar]
  • 21. De Meijere G, Colizza V, Valdano E, Castellano C. The effect of delayed awareness and fatigue on the efficacy of self-isolation in epidemic control. Physical Review E. 2021;104:044316. doi: 10.1103/PhysRevE.104.044316 [DOI] [PubMed] [Google Scholar]
  • 22. Bonaccorsi G, Pierri F, Cinelli M, Flori A, Galeazzi A, Porcelli F, et al. Economic and social consequences of human mobility restrictions under COVID-19. Proceedings of the National Academy of Sciences. 2020;117(27):15530–15535. doi: 10.1073/pnas.2007658117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23. Kraemer MU, Sadilek A, Zhang Q, Marchal NA, Tuli G, Cohn EL, et al. Mapping global variation in human mobility. Nature Human Behaviour. 2020;4(8):800–810. doi: 10.1038/s41562-020-0875-0 [DOI] [PubMed] [Google Scholar]
  • 24. Shepherd HE, Atherden FS, Chan HMT, Loveridge A, Tatem AJ. Domestic and international mobility trends in the United Kingdom during the COVID-19 pandemic: An analysis of Facebook data. International Journal of Health Geographics. 2021;20(1):1–13. doi: 10.1186/s12942-021-00299-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25. Wellenius GA, Vispute S, Espinosa V, Fabrikant A, Tsai TC, Hennessy J, et al. Impacts of social distancing policies on mobility and COVID-19 case growth in the US. Nature Communications. 2021;12(1):1–7. doi: 10.1038/s41467-021-23404-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26. Kishore N, Taylor AR, Jacob PE, Vembar N, Cohen T, Buckee CO, et al. Evaluating the reliability of mobility metrics from aggregated mobile phone data as proxies for SARS-CoV-2 transmission in the USA: a population-based study. The Lancet Digital Health. 2021. doi: 10.1016/S2589-7500(21)00214-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27. Perra N. Non-pharmaceutical interventions during the COVID-19 pandemic: A review. Physics Reports. 2021. doi: 10.1016/j.physrep.2021.02.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28. Jørgensen F, Bor A, Petersen MB. Compliance without fear: Individual-level protective behaviour during the first wave of the COVID-19 pandemic. British Journal of Health Psychology. 2021;26(2):679–696. doi: 10.1111/bjhp.12519 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29. Schneider CR, Dryhurst S, Kerr J, Freeman AL, Recchia G, Spiegelhalter D, et al. COVID-19 risk perception: a longitudinal analysis of its predictors and associations with health protective behaviours in the United Kingdom. Journal of Risk Research. 2021;24(3-4):294–313. doi: 10.1080/13669877.2021.1890637 [DOI] [Google Scholar]
  • 30.Perrotta D, Del Fava E, Zagheni E. The role of vulnerability in mediating the relationship between threat perception and the use of face masks in the context of COVID-19. In: Workshop Proceedings of the 15th International AAAI Conference on Web and Social Media; 2021.
  • 31. Nouvellet P, Bhatia S, Cori A, Ainslie KE, Baguelin M, Bhatt S, et al. Reduction in mobility and COVID-19 transmission. Nature Communications. 2021;12(1):1–9. doi: 10.1038/s41467-021-21358-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32. Badr HS, Du H, Marshall M, Dong E, Squire MM, Gardner LM. Association between mobility patterns and COVID-19 transmission in the USA: a mathematical modelling study. The Lancet Infectious Diseases. 2020;20(11):1247–1254. doi: 10.1016/S1473-3099(20)30553-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33. Gauvin L, Bajardi P, Pepe E, Lake B, Privitera F, Tizzoni M. Socio-economic determinants of mobility responses during the first wave of covid-19 in italy: from provinces to neighbourhoods. Journal of the Royal Society Interface. 2021;18(20210092). doi: 10.1098/rsif.2021.0092 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34. Valdano E, Lee J, Bansal S, Rubrichi S, Colizza V. Highlighting socio-economic constraints on mobility reductions during COVID-19 restrictions in France can inform effective and equitable pandemic response. Journal of Travel Medicine. 2021;28(4):taab045. doi: 10.1093/jtm/taab045 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35. Weill JA, Stigler M, Deschenes O, Springborn MR. Social distancing responses to COVID-19 emergency declarations strongly differentiated by income. Proceedings of the National Academy of Sciences. 2020;117(33):19658–19660. doi: 10.1073/pnas.2009412117 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36. Gozzi N, Bajardi P, Perra N. The importance of non-pharmaceutical interventions during the COVID-19 vaccine rollout. PLOS Computational Biology. 2021;17(9):e1009346. doi: 10.1371/journal.pcbi.1009346 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37. Gozzi N, Chinazzi M, Davis JT, Mu K, y Piontti AP, Ajelli M, et al. Anatomy of the first six months of COVID-19 Vaccination Campaign in Italy. medRxiv. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38. Marziano V, Guzzetta G, Mammone A, Riccardo F, Poletti P, Trentini F, et al. The effect of COVID-19 vaccination in Italy and perspectives for living with the virus. Nature Communications. 2021;12 (7272). doi: 10.1038/s41467-021-27532-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39. Yang J, Marziano V, Deng X, Guzzetta G, Zhang J, Trentini F, et al. Despite vaccination, China needs non-pharmaceutical interventions to prevent widespread outbreaks of COVID-19 in 2021. Nature Human Behaviour. 2021; p. 1–12. doi: 10.1038/s41562-021-01155-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Facebook Data for Good. Movement Range Maps; 2020. https://data.humdata.org/dataset/movement-range-maps.
  • 41.Herdağdelen A, Dow A, State B, Mohassel P, Pompe A. Protecting privacy in Facebook mobility data during the COVID-19 response; 2020. https://research.fb.com/blog/2020/06/protecting-privacy-in-facebook-mobility-data-during-the-covid-19-response/
  • 42.Google. COVID-19 Community Mobility Reports; 2020. https://www.google.com/covid19/mobility/.
  • 43. Woskie LR, Hennessy J, Espinosa V, Tsai TC, Vispute S, Jacobson BH, et al. Early social distancing policies in Europe, changes in mobility & COVID-19 case trajectories: Insights from Spring 2020. Plos one. 2021;16(6):e0253071. doi: 10.1371/journal.pone.0253071 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.R Core Team. R: A Language and Environment for Statistical Computing; 2013. Available from: http://www.R-project.org/.
PLOS Digit Health. doi: 10.1371/journal.pdig.0000035.r001

Decision Letter 0

Dylan A Mordaunt, Laura Sbaffi

15 Mar 2022

PDIG-D-21-00142

Evidence of pandemic fatigue associated with stricter tiered COVID-19 restrictions

PLOS Digital Health

Dear Dr. Gauvin,

Thank you for submitting your manuscript to PLOS Digital Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Digital Health's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 14 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at digitalhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pdig/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

We look forward to receiving your revised manuscript.

Kind regards,

Dylan A Mordaunt, MB ChB, MPH, MHLM, FRACP, FAIDH

Academic Editor

PLOS Digital Health

Journal Requirements:

1. Please amend your detailed Financial Disclosure statement. This is published with the article, therefore should be completed in full sentences and contain the exact wording you wish to be published.

State what role the funders took in the study. If the funders had no role in your study, please state: “The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.”

2. Please update your Competing Interests statement. If you have no competing interests to declare, please state: “The authors have declared that no competing interests exist.”

3. Please provide a complete Data Availability Statement in the submission form, ensuring you include all necessary access information or a reason for why you are unable to make your data freely accessible. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. Any potentially identifying patient information must be fully anonymized.

If your research concerns only data provided within your submission, please write “All data are in the manuscript and/or supporting information files.” as your Data Availability Statement.

4. We ask that a manuscript source file is provided at Revision. Please upload your manuscript file as a .doc, .docx, .rtf or .tex. If you are providing a .tex file, please upload it under the item type ‘LaTeX Source File’ and leave your .pdf version as the item type ‘Manuscript’.

5. Please provide separate figure files in .tif or .eps format only, and remove any figures embedded in your manuscript file. If you are using LaTeX, you do not need to remove embedded figures.

Please also ensure that all files are under our size limit of 20MB.

For more information about how to convert your figure files please see our guidelines: https://journals.plos.org/digitalhealth/s/figures

6. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article's retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

Thank you for your submission. We received reviews from both epidemiologists and an economist. Reviewer 1 summarises this very well, the underlying question being whether the effectiveness of public health restrictions has a temporal dimension. The study is original in approach and relevant to the digital health community for the combination of public health analytics and the novel use of public data sources. With respect to the criteria for publication:

1) The study appears to be original work.

2) This issue is of high importance, with broad interest to the community of researchers, engineers and clinicians working in the field of digital health and indeed population health, economics and the broader social sciences.

3) The study demonstrates high methodological rigor and ethical standards. Reviewer 1 raises some issues that should be addressed/responded to, though some of these may appropriately be addressed in post-publication review. I will leave it to the authors to respond as they feel appropriate.

4) Substantial evidence for its conclusions.

5) Clearly outlined utility and accessibility for the broader community.

6) Follow appropriate standards and practice of open science.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Does this manuscript meet PLOS Digital Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

--------------------

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

--------------------

3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

--------------------

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Digital Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

--------------------

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I like this paper. It asks a critically important question: does compliance with public health measures wane with time and with the stringency of the measures. If it does, then public health measures need to take account of waning. If it doesn't, then officials who sometimes hold fire for fear of waning effects could be more confident in setting restrictions where appropriate.

The authors use daily mobility as measured by Facebook and Google as measure of compliance with public health orders during different tiers of restrictions.

I will refrain from going too deeply into the finer points on statistical methods - my concern is a bit broader.

Mobility will depend not only on the level of restrictions in place but also on how dangerous things look outside. Imagine that the governments implemented zero public health restrictions. If there were a lot of Covid around, a lot of people would just decide to stay home all on their own, even without being ordered to do so. And once things looked safe again, they'd start going outside again. So the mobility data would show a pattern that varied over time with the level of Covid in the community. It's why economist Josh Gans has argued that, over the longer term, R0 tends to 1: people go out when it feels safe, increasing R past one. Then it starts looking dangerous so they stay home, and R declines to below one, making it look safer again.

Covid restrictions are themselves endogenous to actual Covid levels. So when things start looking dangerous, the restrictions come in. When they start looking safe again, restrictions ease. But restrictions are a discrete value and the amount of Covid in the community is continuous. People will have *started* taking their own protective measures ahead of the restrictions, and will have *started* taking fewer precautions before the restrictions are eased. On the downside of that curve, are we seeing waning compliance with the measure because they're sick of the measures? Or are we seeing waning compliance because people are judging the world to look less risky and that, in their view, the measures are now less warranted? It will be a mix of the two. Disentangling it requires having some measure of the perceived riskiness of the environment.

I think the statistical model needs to incorporate actual Covid prevalence in each place over time as a control - unless actual Covid levels in each region were the same at each point in time and only the restrictions varied. If that's the case, then regional variation in restrictions could identify. But I rather strongly suspect that regional restrictiveness will depend on regional Covid levels.

If measures like number of positive tests or proportion of positive tests aren't available at the finer-grained local level, the local hospital burden could be a pretty good proxy. If the hospitals are overflowing, I'm staying home regardless of restrictions. Once the hospitals are running normally again, I'll be less inclined to comply with restrictions - nothing to do with frustration about restrictions, just that "Don't swim in the river" signs are superfluous when the river is a raging torrent, but are likely to be ignored on a hot day by a calm and beautiful swimming spot. Changing levels of compliance with the "Do Not Swim" sign in that case have nothing to do with waning support for the sign's restrictions as people become frustrated with it and everything to do with people's own assessment of whether the sign's warning is reasonable in the circumstances.

The second concern probably cannot easily be addressed but should be listed as a potential limitation of the work. There was a thoroughly depressing paper published in the NBER working paper series in December on the use of mobility data in exactly this kind of work. See Weill, J, M Stigler, O Deschenes and M Springborn. 2021. "Researchers' Degrees-of-Flexibility and the credibility of Difference-in-Differences Estimates: Evidence from the Pandemic Policy Evaluations", NBER Working Paper 29550. https://www.nber.org/papers/w29550 . They show that the American literature on the effects of lockdowns on mobility is, in short, a mess. There are tons of ways of measuring mobility, and they don't correlate well with each other. They point to this as introducing huge researcher degrees of freedom: basically, motivated researchers can pick the result they want by choosing the mobility measure that gives them that result. I have absolutely no reason to expect that this has happened in this paper. But it points to a danger in this work: none of the mobility measures are themselves very good if the choice of measure winds up substantially influencing whether restrictions work or not. To my mind, that argues for using a broad set of mobility measures, running a principal components analysis through it, seeing whether there's some underlying measure on which they all load, and use that factor as the measure of mobility. That would be a ridiculous amount of work here, and I do not know whether those additional measures are even available for Italy. But readers should be given a pretty strong warning that, in the American literature, choice of mobility measure can prove strongly influential on the results and that the work should be replicated using other mobility measures to check consistency. I also note that the NBER work uses a much broader array of controls looking at effects on mobility: precipitation, snowfall, mean temperatures. The paper is really worth going through closely.

Reviewer #2: I appreciate the authors for the analysis performed and the manuscript is well written.

The statistical methodology used in this study are appropriate.

The results are found to be satisfactory.

I would recommend to check for the grammatical errors and rephrasing few sentences.

Reviewer #3: The study “Evidence of pandemic fatigue associated with stricter tiered COVID-19 restrictions” uses mobility data to parameterize adherence to tiered interventions over time in Italy accounting for social distancing measures that were in place in every region each day. Results of the study are of interest to public health and can be integrated into mathematical models to evaluate optimal intervention policies for future epidemics. Methods are sound, results adequately described and limitations acknowledged.

Tables and figures should be self-explanatory. Please explain coefficients’ labels in the first column of tables 1 and 2.

--------------------

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: Eric Crampton

Reviewer #2: No

Reviewer #3: No

--------------------

Comments to the Author

1. Does this manuscript meet PLOS Digital Health’s publication criteria? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.

Reviewer #3: Yes

--------------------

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLOS Digit Health. doi: 10.1371/journal.pdig.0000035.r003

Decision Letter 1

Dylan A Mordaunt, Laura Sbaffi

4 Apr 2022

Evidence of pandemic fatigue associated with stricter tiered COVID-19 restrictions

PDIG-D-21-00142R1

Dear Dr. Gauvin,

We are pleased to inform you that your manuscript 'Evidence of pandemic fatigue associated with stricter tiered COVID-19 restrictions' has been provisionally accepted for publication in PLOS Digital Health.

Before your manuscript can be formally accepted you will need to complete some formatting changes, which you will receive in a follow-up email from a member of our team. 

Please note that your manuscript will not be scheduled for publication until you have made the required changes, so a swift response is appreciated.

IMPORTANT: The editorial review process is now complete. PLOS will only permit corrections to spelling, formatting or significant scientific errors from this point onwards. Requests for major changes, or any which affect the scientific understanding of your work, will cause delays to the publication date of your manuscript.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact digitalhealth@plos.org.

Thank you again for supporting Open Access publishing; we are looking forward to publishing your work in PLOS Digital Health.

Best regards,

Dylan A Mordaunt

Academic Editor

PLOS Digital Health

***********************************************************

Thank you for your submission, this now meets the criteria for publication.

Reviewer Comments (if any, and for reference):

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Fig. Changes in residential mobility and tiered restrictions.

    Daily relative change in the residential time—as measured by Google—with respect to baseline, in the Italian regions ordered alphabetically from top to bottom. Color coding indicates the tier that was in place each day. Gray indicates the absence of restrictions.

    (PDF)

    S1 Table. Model intercepts by region for the relative change in movement as dependent variable.

    (PDF)

    S2 Table. Model intercepts by region for the relative change in residential time as dependent variable.

    (PDF)

    S3 Table. Model results for the relative change in movement as dependent variable, controlling for risk perception.

    (PDF)

    S4 Table. Model results for the relative change in residential time as dependent variable, controlling for risk perception.

    (PDF)

    S1 Data. Daily values of COVID-19 incidence, hospitalization, ICU admission and tier by region.

    (CSV)

    Attachment

    Submitted filename: Response_reviewers.pdf

    Data Availability Statement

    Movement data used in this study are publicly available at: https://data.humdata.org/dataset/movement-range-maps and https://www.google.com/covid19/mobility/. All other data is provided as a Supplementary File to the manuscript.


    Articles from PLOS Digital Health are provided here courtesy of PLOS

    RESOURCES