Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Mar 15;16(3):e0248221. doi: 10.1371/journal.pone.0248221

Social distancing compliance: A video observational analysis

Evelien M Hoeben 1,*, Wim Bernasco 1,2, Lasse Suonperä Liebst 3, Carlijn van Baak 1, Marie Rosenkrantz Lindegaard 1,2,4
Editor: Holly Seale5
PMCID: PMC7959357  PMID: 33720951

Abstract

Purpose

Virus epidemics may be mitigated if people comply with directives to stay at home and keep their distance from strangers in public. As such, there is a public health interest in social distancing compliance. The available evidence on distancing practices in public space is limited, however, by the lack of observational data. Here, we apply video observation as a method to examine to what extent members of the public comply with social distancing directives.

Data

Closed Circuit Television (CCTV) footage of interactions in public was collected in inner-city Amsterdam, the Netherlands. From the footage, we observed instances of people violating the 1.5-meter distance directives in the weeks before, during, and after these directives were introduced to mitigate the COVID-19 pandemic.

Results

We find that people complied with the 1.5-meter distance directives when these directives were first introduced, but that the level of compliance started to decline soon after. We also find that violation of the 1.5-meter distance directives is strongly associated with the number of people observed on the street and with non-compliance to stay-at-home directives, operationalized with large-scale aggregated location data from cell phones. All three measures correlate to a varying extent with temporal patterns in the transmission of the COVID-19 virus, temperature, COVID-19 related Google search queries, and media attention to the topic.

Conclusion

Compliance with 1.5 meter distance directives is short-lived and coincides with the number of people on the street and with compliance to stay-at-home directives. Potential implications of these findings are that keep- distance directives may work best in combination with stay-at-home directives and place-specific crowd-control strategies, and that the number of people on the street and community-wide mobility as captured with cell phone data offer easily measurable proxies for the extent to which people keep sufficient physical distance from others at specific times and locations.

Introduction

Social distancing has been a critical non-pharmaceutical measure to slow the spread of the COVID-19 coronavirus. The World Health Organization recommends social distancing as a most effective anti-pandemic measure [1]. Historical pandemics are a case in point, including the Spanish 1918 flu pandemic, in which cities implementing social distancing faced lower death rates [2]. Similarly, in the ongoing COVID-19 pandemic, geographical differences in transmission rates and death rates appear to be linked to how firmly social distancing is implemented [35]. While the effectiveness of social distancing hinges on the cooperation of the public [6], it may be challenged by the human compulsion for engaging in proximate face-to-face interactions [7]. Therefore, policy-makers need evidence of social distancing compliance to inform policy decisions on whether to implement rules on a voluntary or compulsory basis. So far, however, little is known about the extent to which people keep physical distance from others in everyday practice, not only in the ongoing crisis but during pandemics in general.

The current study aims to provide empirical evidence of compliance with social distancing directives in the weeks after their introduction. Particularly, the study focuses on the extent to which people keep 1.5 meter physical distance from strangers in public space. Of the various social distancing practices (e.g., staying at home, preventive quarantine, avoiding crowds), keeping a physical distance from others is the most directly related to disease transmission. After all, exposure to the virus occurs if people are in physical proximity to a COVID-19 positive individual. Other social distancing measures, such as avoiding non-essential trips outdoors, will only indirectly affect the risk of transmission, because they prevent or reduce the likelyhood of physical proximity between people. Yet, with some exceptions [8, 9], the extant research on social distancing has not been able to directly evaluate whether people keep their distance. Instead, a growing body of work relies on aggregated location data from cell phones to determine adherence to stay-at-home directives [1014] or on people’s self-reports about their willingness to comply with a wide variety of social distancing directives [1517]. Neither of these approaches are suitable to assess whether people comply to 1.5 meter distance guidelines, because they are insufficiently accurate in determining proximity or because they do not provide objective information on people’s behavior. Exceptions are studies that apply Bluetooth technology [9], pedestrian tracking sensors [8] or other methodology to precisely pinpoint the proximity between people.

The current study relies on observations of real-life behavior in public spaces, as captured by Closed Circuit Televison (CCTV) clips. Real-life behavioral data of this kind provide ecologically valid evidence on variation in social distancing non-compliance [18]. Furthermore, our observational approach addresses a call within epidemiology for quantitative research on disease-behavior interactions [6]. Specifically, real-life behavioral observation is, as stressed by Verelst et al. “desperately needed” [19 p. 12] for the validation and parametrization of disease simulation models, which have been instrumental in shaping policy responses to the coronavirus pandemic.

Scholars have explicitly called for research describing how individuals change their everyday behavior during pandemics and in the face of the threat of disease [6, 20]. Evidence on compliance during the COVID-19 pandemic [21], society-wide non-infectious emergencies (e.g., terrorist attacks; [22]) and medical adherence to long-term treatment [23] shows that people’s responses tend to go through transient phases—with major initial changes in activities being followed by a gradual return to everyday routines. Based on this earlier work, we expect to find that people will comply with regulations in the immediate period after such regulations have been introduced, but that their compliance will decrease gradually in the following period.

In addition to examining temporal variation in social distancing compliance, we also investigate factors that might explain such variation. First, we examine the role of a purely situational constraint: the number of people present on the street. As the number of people on the street increases, it may simply be more difficult for people to keep the described distance from others. The number of people on the street may also have a psychological effect on people: Relatively empty areas provide a visual reminder that a crisis is at hand, which might affect people’s awareness of their own behavior and that of others [24, 25]. Second, we expect that patterns in compliance to keep-distance directives will co-occur with community-wide adherence to stay-at-home directives, as indicated by large-scale cell phone data on the time that people spent at non-residential locations. This measure not only reflects temporal variation in general compliance to governmental regulations, but it is expected to also affect the number of people on the street and, thereby, the likelihood of social distancing violations. Third, we expect that non-compliance will align with the increasing temperatures that mark the start of Spring in The Netherlands, since improved weather conditions allow for more outdoor socializing [26]. Thus, we expect that temperatures affect the number of people on the street and, in turn, people’s compliance to keep-distance directives. Fourth, we expect that non-compliance trends may unfold as the perceived urgency of the problem decreases, as indicated by the number of registered transmissions and deaths. Survey research shows that people’s willingness to comply is strongly driven by fear and anxiety related to the virus [27]. Fifth, we expect that patterns of non-compliance can be explained with collective attention to the COVID-19 pandemic. When a dramatic incident occurs, all members of the collective are emotionally affected. Such shared trauma leads to feelings of connectedness and stimulates cohesion [22]. In this context, compliance to guidelines for collective well-being, such as preventive social distancing directives, is likely to be socially rewarded, whereas non-compliance is likely to be met with strong disapproval or even hostility. As the collective attention wears off, the potential social benefits of compliance decrease, leading people to return to their routines. Generally, we expect compliance with social distancing to be positively related to the salience of COVID-19 related concerns in society, as reflected by the content of traditional media and topic searches on the internet.

Materials and methods

Our data on social distancing compliance are derived from CCTV clips of public behavior, captured by municipal surveillance cameras in inner-city Amsterdam, the Netherlands. These recordings were collected over the course of 10 weeks during the COVID-19 outbreak, from February 29th to May 2nd 2020, and were provided by the Amsterdam police and municipality. Access was provided under the condition that the data would be securely stored, not be publicly shared, and that the identity of the individuals visible in the footage would be protected. The project has been approved by the Ministry of Internal Affairs (PaG/BJZ/49986). We do not have personal informed consent from the persons recorded and it is not practically possible to obtain such consent, nor would it be ethically responsible for us to attempt to obtain such consent. However, the Ministry of Internal Affairs provided the consent to use CCTV footage on behalf of the individuals recorded by the surveillance cameras in public. The project as well as this consent procedure have been approved by the Ethics Committee for Legal and Criminological Research (CERCO) at the Vrije Universiteit Amsterdam.

Recordings were sampled from 3 cameras, located in relatively busy areas in the city near the central train station and around shopping areas. We sampled one weekday (Thursday) and one weekend day (Saturday) per week. To assess the potential impact of the social distancing directives, we included the weeks during which the social distancing directives were announced as well as the weeks before and after this period. Due to technical issues in 2 of the 10 weeks, the footage was available for only one of the selected days. In total, we included footage from 18 days, of which we selected the 5-minute period from 16:00 to 16:05 (4:00 pm to 4:05 pm). This time slot was chosen because it reflected a busy time of day (e.g., opening hours of the shopping areas and commuting around the central station). The resulting 54 5-minute clips are a subset of the more than 20,000 hours of recordings captured by 55 surveillance cameras. We coded only a small subset of the available data, because manual coding of video behavioral data is very labor-intensive [28].

The 5-minute clips were coded for instances where people were within 1.5 meters proximity of each other or formed a group of more than three individuals. These behavioral definitions align with the official Dutch social distancing regulations [29]. The coder played back the video (if necessary in slow motion and repeatedly) and registered every social distancing violance observed, marking the time point. We acknowledge that our distance measures are not perfect. In particular, human judgement of distance can be affected by the focal length of the camera. With increasing focal length (zooming out) the same distance appears larger. However, all coded CCTV clips were recorded in dense urban environments where, throughout the camera viewshed, various objects were available to serve as reliable reference objects for length estimation, including sidewalk tiles, benches, trash cans, and bikes.

For each observed social distance violation (i.e., 1.5-meter proximity and group formation), the coder judged whether the people involved were members from the same household and, as such, were exempt from the social distancing regulation. People were considered to belong to the same household when they were observed to make physical contact (e.g., holding hands). This assessment was based on evidence suggesting that relationship ties may be inferred from visual behavioral information (known as “tie-signs” [24, 30, 31]). In the current study, we only present social distancing violations that were presumably by non-family members. We established a correlation of 0.99 between the measures corrected and uncorrected for household membership. Analyses (trends, de-trended bivariate correlations, and trivariate regression models) with counts uncorrected for household membership showed similar findings.

The CCTV-clips were also used for counting the number of people present on the street. Since here we were not interested in specific behavior but in the average number of people present over the 5-minute sample, we used a slightly different coding procedure. While playing the 5-minute clips, the video was halted 5 times (at 16:00, 16:01, 16:02, 16:03, and 16:04) and the number of people in the still picture was counted. The measure of the number of people on the street is the mean of these five measurements per clip. For the coding of the number of people on the street as well as of the social distancing violations, two researchers observed and discussed a subset of the clips together, discussed agreements, and altered operational definitions of behaviors accordingly [32]. The resulting codebook is provided in the S1 Appendix.

We made minor corrections to the observed data due to incidental changes in camera zoom levels. On three days, one of the cameras recorded with a higher zoom level than on other days, which affected the amount of space covered in the viewshed and, thereby, reduced the number of violations that could be detected. In an attempt to correct for this bias, on April 4th, we replaced the 16:00 (4 pm) observations by observations from 13:00 (1 pm). On March 26th and March 28th, one camera was zoomed in all day. The observations from that one camera for those days were discarded and imputed with OLS-based predicted values based on the observed values of the other two cameras. The regression equation across the whole study period (all dates except March 26th and March 28th) has an explained variance (R2) of 0.73. This procedure increased the number of violations on March 26th from 80 to 90 and on March 28th from 79 to 114. The same approach was used to correct the measure of the number of people on the street. The explained variance of the respective regression equation (R2) was 0.52. The Figures with the corrected measurements are provided and discussed in the main text. The Figures with the uncorrected unimputed measurements are presented in the S2 Appendix. The Figures show similar patterns of social distancing violations over time.

To contextualize the temporal patterns of observed social distancing violations, we collected information from various sources. Except for the media data, these sources are publicly available without restrictions. (1) We constructed a timeline of the implementation of the social distancing regulations in The Netherlands based on official information of the government [33] as well as timelines published in news media [34, 35]. (2) We collected records of the COVID-19 transmission in The Netherlands, as expressed by the absolute number of deaths and the absolute number of new transmissions over time. This information was registered by the National Institute for Public Health and the Environment (RIVM) and included in the global database of John Hopkins University. The data were downloaded on May 3rd from tinyurl.com/ya9yywoj [36]. (3) Compliance to stay-at-home directives was operationalized with data from Google’s COVID-19 Community Mobility Reports, which is based on cell phone location and movement information collected from users who opted-in to Location History for their Google Account. These data capture relative changes in the number of visits and length of stay at (a) parks, (b) retail and recreation, (c) grocery and pharmacy, (d) transit stations, and (e) workplaces. The data represent changes compared to a baseline, which is the median value for the corresponding day of the week during the 5-week period from January 3rd to February 6th in 2020. Because the baseline is specific to the day of the week, these data have already been corrected for weekly periodicity (unlike the data from other sources that we apply). We used data specific to Amsterdam and created a combination score that is the average percentage change across the five categories of non-residential places. The data were downloaded on August 31st from Google [37]. (4) Daily temperatures at 16:00 (4 pm) were obtained from the hourly weather database of the Royal Netherlands Meteorological Institute (KNMI). We used measures from weather station Schiphol Airport, located a few kilometers south of Amsterdam. The data were downloaded on May 5th from tinyurl.com/yb2mjwaw [38]https://projects.knmi.nl/klimatologie/uurgegevens/selectie.cgi. (5) Collective attention to the pandemic was assessed with two measures. First, internet search queries in The Netherlands were captured with Google Trend data for the search terms ‘corona’ and ‘COVID-19’ (downloaded on May 6th from trends.google.com [39]). Google Trend offers an index of how widely search queries are used in certain regions—with a score of 100 representing the peak popularity for a search term and a score of 50 indexing half the popularity. Second, media attention was captured with data from the largest news agency company in The Netherlands, Algemeen Nederlands Persbureau (ANP). This agency provides various news media channels with fact-checked information, among which newspapers, radio, and television. Data include the number of messages from their newsstream Medianet and topic-specific newsfeed Buzz that include the terms ‘COVID-19,’ ‘corona,’ and derivatives of the term ‘corona’ (e.g., coronavirus).

The covariation between the number of social distancing violations, the number of people on the street, compliance with stay-at-home-directives (Google mobility), temperature, COVID-19 transmissions and deaths, Google search scores, and media items was further examined by analyzing bivariate correlations and trivariate regression models. When examining covariation among trended time series, one needs to account for autocorrelation (i.e., correlation between values within the same variable that are k time periods apart) and for common dependence on time [40]. For more information about the extent of the autocorrelation and cross-correlations among the investigated variables (i.e., correlations between a measure of variable X at time t+k with k being the lag and a measure of variable Y at time t), see the S3 Appendix. Please note that the bivariate correlations and trivariate regressions are used to examine contemporaneous effects.

To examine covariation among the time series, we de-trended the variables prior to the calculation of the bivariate correlations and the trivariate regression models. The ten variables in the analysis do not necessarily follow a common trend, and some are likely to display weekly periodicity in addition to a linear or curvilinear trend. In line with the approach advocated in the literature on estimating relationships between time series [41], trend and periodicity were removed from each of the variables separately by regressing them on time (days since start of the series), time squared, and a dummy variable indicating whether the measure was from a Saturday as opposed to from a Thursday (to account for weekly periodicity). The residuals of these models represent their variation with trend and periodicity removed. Upon request by one of the reviewers, for the purpose of providing a complete description of the relations between the variables before detrending, we present the bivariate correlations and trivariate regression models as calculated with the raw data in S4 Appendix. The details of the detrending procedure are described in S5 Appendix.

All analyses were executed with version 4.0.0 of the R package for Statistical Computing [42]. The coding of the CCTV-clips was done in Microsoft Excel. The R code and the data files with the coded observations of the CCTV-clips are accessible through an OSF depository (osf.io/59tnu).

Results

The first case of COVID-19 in The Netherlands was confirmed on February 27th 2020 and case number 100 was confirmed 11 days later. The virus progressed rapidly through the community, peaked mid-April, and then declined—as indicated by the number of new transmissions and related deaths presented in Fig 1A and 1B.

Fig 1. Covariates over time.

Fig 1

The panels display time trends in (A) COVID-19 deaths, (B) COVID-19 transmissions, (C, D) media items, (E, F) Google search scores, (G) compliance with stay-at-home-directives (Google mobility), (H) temperature, and (I) the number of people on the street.

In response to the outbreak, the Dutch government implemented a series of social distancing regulations—as summarized in the timeline, Fig 2. The outbreak in the Netherlands started in the province of North-Brabant and, therefore, the first regulations were focused on this subregion (March 6th). Directives for the entire country soon followed (March 9th, March 12th). On March 15th, the government first mentioned 1.5 meter as a reference distance [43]. The official lockdown was announced in a press conference on March 23rd. In addition to previous directives, the government introduced fines for the violation of the social distancing regulations. In this press conference, the government restated the explicit rule of keeping 1.5-meter distance and also prohibited group gatherings, defined as the co-presence of three or more people who do not keep a 1.5-meter distance from each other. This included coincidental group gatherings. Members from the same households and children under the age of 12 were exempted from these rules [29].

Fig 2. Timeline of the COVID-19 outbreak and the implementation of social distancing directives in The Netherlands.

Fig 2

Compliance to 1.5-meter distance and stay-at-home directives over time

Fig 3 displays the number of observed social distancing violations (i.e., < 1.5-meter proximity by people not sharing the same household) from February 29th to May 2nd. Note that we refer to ‘social distancing violations’ throughout, even though the period covered includes weeks before the social distancing directives were made explicit and before their violation was legally enforced.

Fig 3. Observed social distancing violations (i.e., < 1.5 meter proximity by non-household members) from CCTV clips.

Fig 3

As can be seen in Fig 3, there is a decline in the number of violations between March 7th and March 21st, which coincides with the first announcements of social distancing directives on March 9th, March 12th, and March 15th. Note that these announcements regarded general social distancing directives (e.g., avoid shaking hands, work from home), but that the 1.5-meter distance directive was not mentioned until March 15th and not sanctioned until March 23rd. On March 23rd, the government announced explicit rules related to keeping 1.5-meter distance and avoiding crowding (> 3 people) in public spaces. On this date, the government also installed fines for rule violators. The number of violations appeared to be lowest between March 19th and April 2nd. From April 2nd onwards, a steady increase in the number of social distancing violations is visible, especially on the weekend days (April 4th, April 11th, April 18th, and April 25th are Saturdays).

To statistically examine the time trend in the number of social distancing violations, we conducted Ordinary Least Squares regression models with the number of violations regressed on linear time, quadratic time, and periodicity due to the data being collected on Thursdays and Saturdays. The outcomes of these models are presented in Table 1. The findings show that the linear model does not provide a good fit to the data (i.e., the coefficient for linear time is not significant, R2 = 0.05), that the quadratic model provides a much better fit (i.e., the coefficients for time and time squared are significant and the R2 of 0.53 is much higher compared to that of the linear model), and that the quadratic model that includes a control for periodicity fits even better (i.e., the coefficient of the dummy variable for weekday is significant, the R2 is 0.72). The predicted values from these three models are plotted against the observed values in Fig 4. Fig 4 shows that, for both U-curves (based on the quadratic model and the quadratic model corrected for periodicity), the inflection point occurs in early April, about 1.5 week after the introduction of the social distancing directives. Thus, we detect a trend in the number of social distancing violations over time, in which this number decreased between late February and early April, but increased from early April to early May.

Table 1. Number of social distancing violations regressed on linear time, quadratic time, and periodicity.

Model 1: Model 2: Model 3:
Linear Quadratic Quadratic +
periodicity
Intercept 188.71*** 280.65*** 243.44***
(33.35) (33.91) (29.57)
Time -0.79 -9.77*** -9.06***
(0.87) (2.40) (1.92)
Time squared 0.14** 0.13***
(0.04) (0.03)
Saturday (0/1) 60.65**
(19.55)
R2 0.05 0.53 0.72
N 18 18 18

***p < 0.001

**p < 0.01, *p < 0.05.

Estimates from OLS regression models. Standard errors in parentheses. Time = number of days since February 29, 2020.

Fig 4. Social distancing violations as a function of time.

Fig 4

Observed values (in red), and fitted values of a linear model (Model 1 in Table 1; in black), a quadratic model (Model 2 in Table 1; in blue), and a quadratic model that corrects for periodicity due to weekday (Model 3 in Table 1; in green).

At first glance, this pattern of violations roughly coincides with the plateau of the spread of COVID-19 in the Netherlands; the number of new transmissions is highest from April 9th to 11th and then starts to go down (Fig 1B). The correlations between the number of violations, on the one hand, and the number of new deaths and infections, on the other hand, are visualized in Fig 5A and 5B. After correcting for trend and periodicity in the time series (i.e., detrending the data), we find a weak correlation between the number of social distancing violations and the number of new cases, and a moderate positive correlation between the number of social distancing violations and the number of new deaths (Fig 6). This means that, in contrast to what we would expect, the number of social distancing violations increases as the number of new deaths increases. This could be an indication that people’s willingness to comply is not as strongly driven by fear and anxiety related to the virus as has been suggested in survey research [27]. Note, however, that we did not establish any significant effects between these factors and the number of social distancing violations after controlling for the number of people on the street (Table 2).

Fig 5. Correlations between the number of observed social distancing violations and the covariates.

Fig 5

The panels display the correlations between, on the one hand, the number of observed social distancing violations and, on the other hand, the (A) COVID-19 deaths, (B) COVID-19 transmissions, (C, D) media items, (E, F) Google search scores, (G) compliance with stay-at-home-directives (Google mobility), (H) temperature, and (I) the number of people on the street.

Fig 6. Correlation coefficients between de-trended variables.

Fig 6

All variables were de-trended prior to including them in the analyses by taking residuals after OLS-regressing them on time, time squared, and periodicity due to weekday. Time points are Thursdays and Saturdays between Saturday February 29th, 2020 and Saturday May 2nd, 2020.

Table 2. Number of social distancing violations regressed on the number of people on the street and each of the other variables.

Model 1 Model 2 Model 3 Model 4 Model 5 Model 6 Model 7 Model 8
Intercept -0.00 -0.00 -0.00 -0.00 -0.00 -0.00 -0.00 -0.00
(3.74) (5.43) (5.21) (5.44) (5.28) (5.43) (5.45) (5.21)
People on the 1.24*** 1.74*** 1.68*** 1.83*** 1.63*** 1.81*** 1.79*** 1.64***
street (0.27) (0.38) (0.34) (0.34) (0.37) (0.33) (0.40) (0.35)
Google 1.98***
mobility (0.48)
Temperature 0.80
(1.95)
COVID-19 0.21
deaths (0.18)
COVID-19 -0.01
transmissions (0.03)
Corona -0.22
media items (0.22)
COVID-19 -0.66
media items (1.69)
Corona -0.05
Google scores (0.49)
COVID-19 -0.54
Google scores (0.46)
R2 0.84 0.66 0.69 0.66 0.68 0.66 0.66 0.69
N 18 18 18 18 18 18 18 18

***p < 0.001, **p < 0.01, *p < 0.05.

Estimates from trivariate OLS regression models. All variables were de-trended prior to including them in the models by taking residuals after OLS-regressing them on time, time squared, and periodicity due to weekday. Standard errors in parentheses.

To measure the overall number of people on the street we used the same sample of the CCTV footage that was used to measure social distancing violations. Fig 1I shows the number of people on the street in the weeks prior to the introduction of the social distancing directives (February 29th to March 7th), the weeks in which new directives were introduced (March 12th to April 2nd), and the first weeks after their implementation (April 4th to May 2nd). There is a strong similarity in the temporal patterns of the number of social distancing violations (i.e., < 1.5-meter proximity by people not sharing the same household) and the number of people on the street. When the first social distancing directives were implemented, fewer people were visible in public space, but over time this number increased. The number of people on the street was higher on the weekend than on weekdays, which is also in line with the patterns observed for social distancing violations. Fig 5I displays the relationship between the number of people on the street and social distancing violations, which is positive and quite strong (R = 0.81, R2 = 0.66 after detrending the time series, see Fig 6).

Fig 1G displays the changes in daily time spent at non-residential places (i.e., parks, retail and recreation, grocery and pharmacy, transit stations, and workplaces) in Amsterdam in the period from February 29th to May 2nd compared to a baseline value for the corresponding day of the week during the period of January 3rd to February 6th 2020. We see that, until approximately March 12th, the mobility patterns are similar to those in the preceding period (i.e., small variation around the baseline). In the week of March 12th to March 19th, there is a sharp decline visible in the time that was spent at non-residential locations. This relative time spent away from the home remained low until approximately April 4th, after which it slowly started to increase (with the exception of Easter Monday on April 13, which is a national holiday). The temporal patterns in community-wide mobility are similar to those in the number of social distancing violations, as visualized in Fig 5G and by the established bivariate correlation of 0.78 (R2 = 0.61; Fig 6) with the de-trended data. Interestingly, this relationship between mobility and the number of social distancing violations remains significant after controlling for the number of people on the street (Table 2).

Contextualizing social distancing compliance: Temperature and collective attention

Of the covariates that we examined, social distancing violations appear most strongly related to the number of people on the street (R = 0.81, R2 = 0.66) and mobility (R = 0.78, R2 = 0.61). We find substantively weaker correlations with all the other variables (Fig 6, bottom row).

Specifically, we find a moderate positive correlation between the number of violations and temperature. Although we cannot establish causality, we suggest that the temperature affects the number of people that are outdoors [26], which, in turn, may affect people’s ability to keep the prescribed distance. In line with this suggestion, we find that temperature does not remain a significant covariate of the number of social distancing violations after controlling for the number of people on the street (Table 2).

Further, we find a weak correlation between the number of violations and the number of ‘COVID-19’ media messages, and a moderate negative correlation with the number of ‘Corona’ media messages: As the number of media messages on this topic decreases, the number of social distancing violations increases. These covariates were not significantly related to the number of social distancing violations after we accounted for the number of people on the street (Table 2).

Finally, we find moderate negative correlations between Google search behavior and the number of social distancing violations that do no longer reach conventional levels of significance after controlling for the number of people on the street (Table 2).

Table 2 shows that, after controlling for the number of people on the street, only mobility remains a significant predictor of the number of social distancing violations (b = 1.98, p < 0.001).

Discussion

To slow down epidemic outbreaks, it is essential that people comply with social distancing directives [44]. However, it has proven difficult to assess the extent of people’s compliance with such directives due to a lack of suitable data. To understand how members of the public comply with COVID-19 mitigation measures, recent studies have, for example, examined how compliance levels vary between and within countries [45] and how individual differences in compliance are related to personality, political orientation, and demographics [1517]. What these studies have in common is a reliance on people’s self-reports, which are limited by social desirability and recall bias. As such, prior work in this area captures people’s intentions to comply with directives, rather than their actual compliance behaviors. Several attempts have been made to more objectively capture behavioral patterns using aggregated mobile phone location data [1014]. This work has proven useful to assess community levels of compliance to stay-at-home directives, but these methods do not enable a fine-grained examination of the physical distance between people. Even though such physical distance is, ultimately, how social distancing measures help to prevent the virus from spreading [46]. Therefore, in the current study, novel techniques for systematic observation based on CCTV clips [47] have been applied to provide an objective overview of trends in people’s physical proximity to others.

The study has four key findings. First, the study shows that people started to keep physical distance from each other in public spaces even before the social distancing directives were officially implemented. This is in line with recent work, which shows that during the COVID-19 pandemic, changes in economic activity [48] and adherence to stay-at-home directives [10] preceded formal regulations by the authorities. This speaks to the central function of voluntary action as opposed to governmental interference (e.g., school closures, general lockdowns) for the succes of non-pharmaceutical measures in reducing transmission rates [49, 50], at least during the first stages of a pandemic.

Second, the current study showed that, even though people complied with the social distancing directives prior to and immediately after these were first implemented, compliance started to decline gradually in the following weeks. This decline occurred despite repeated calls from government officials to continue keeping distance. The observed pattern of declining compliance to social distancing directives is in line with findings from other studies on the COVID-19 pandemic [8, 21] and mirrors patterns observed in studies on medical adherence outside the pandemic context [23, 51], which found that rapid declines in compliance occurred even in the first five to ten days of treatment [52, 53]. In a report in 2003, the World Health Organization concludes that a substantial number of patients do not adhere to their doctors’ directives and that such poor adherence increases with the duration of the treatment regiments. Patterns of poor adherence were found across a range of conditions, including life-threatening diseases such as diabetes and HIV/AIDS [23]. Thus, in general, people tend to find it challenging to change their routines and lifestyles, even if it is paramount to their own health and well-being.

The third key finding concerns the strong correlation between the number of people on the street and the number of social distancing violations, which is in line with findings from at least one other study [8]. The correlation could be an indication of causality, such that the number of people on the street would affect people’s willingness or their ability to keep distance. In narrow passage-ways (e.g., tunnels, bridges) and other spaces that impose physical constraints on people’s movements, it might be more difficult for people to keep their distance when it is busy. In such locations, violation of social distancing directives may not (only) reflect people’s willingness to comply, but their ability to succeed in doing so. It is unclear to what extent this opportunity argument is applicable to the observed social distancing violations in the current study. The three selected locations were large open areas with a few bottlenecks around entrances of shops and public transportation facilities.

An alternative explanation for the established correlation could be that the number of people on the street has a psychological effect on people’s behavior. Relatively empty streets in otherwise busy areas might serve as visual cues that something is wrong [24, 25]. Such disruptions in social order could remind people to stay alert and could make them more aware of their own behavior. When the setting turns back to normal as more people are out in public space, there are fewer visible warning signs to remind individuals to keep their distance. Again, it is unclear to which extent this argument applies to our findings. At each of the locations, there were on average 25 people present in the time-periods selected for observation.

The fourth key finding concerns the relationship between our indicator of compliance to stay-at-home directives (i.e., Google Mobility data on time spent at non-residential locations) and our indicator of compliance to keep-distance directives (i.e., violations as observed from the CCTV footage) that persisted after accounting for the number of people on the street. In other words, we found that on days at which more time was spent at non-residential locations, people were less inclined to keep their distance irrespective of the number of people on the street. The established relationship might reflect an underlying sentiment toward government regulations, which changes from day-to-day due to external events such as riots, inspirational community initiatives, and speeches from central political figures.

An important implication of our findings is that keep-distance directives may only work in combination with stay-at-home directives and with avoid-busy-places directives. It appears that when people do not comply with stay-at-home directives, they also do not comply with 1.5-meter distancing directives. This means that the physical distancing violations are likely to increase as soon as the government relaxes the preventive measures and allows for schools, restaurants, and similar venues to reopen. It also means that policy-makers cannot rely on people keeping the 1.5-meter distance from others in public while allowing for relaxation of stay-at-home directives. The conclusions of the study provide support for policies that account for the areal surface and the temporal patterns in visitor density to establish the number of people who are allowed in a specific location. Examples of such place-specific crowd-control policies are the allowance of a maximum number of people in stores and the closure of public spaces (e.g., parks, playgrounds, shopping streets) at times that they are expected to become too crowded.

A related implication is that indicators of community-wide mobility (e.g., as captured with cell phone location data) and of the number of people on the street might be used as proxies to determine compliance with directives about keeping physical distance. Although our study did not address people’s engagement in other protective behaviors (e.g., wearing facemasks, increasing frequency of handwashing), it is possible that indicators of community-wide mobility and the number of people on the street could form proxies for such behaviors as well. Research suggests that individuals who perceived one type of protective behavior to be effective (e.g., wearing facemasks, home disinfection) are more likely to engage in other types of protective behaviors [54]. This would be good news for policy-makers, because it is easier to determine when locations are too crowded than it is to establish whether people are violating specific directives such as keeping their 1.5-meter distance. Such a proxy would be useful, for example, to determine if it is time for the installment of additional measures to ensure compliance such as stricter sanctioning (e.g., fines, forced stay-at-home) or efforts to increase awareness among the public about advisable behavior [55, 56].

In addition to examining the role of the number of people on the street and community-wide mobility, we also looked into other factors that could potentially explain compliance to keep-distance directives; the transmission of COVID-19 in the Netherlands, the temperature, and collective attention to COVID-19 as indicated by internet search behavior and media attention. We did not establish any contemporaneous significant effects between these factors and the number of social distancing violations after controlling for the number of people on the street, illustrating again the importance of the latter factor for people to keep physical distance from each other.

That said, the limited number of observations (N = 18) will likely have restricted our ability to detect effects of small to moderate effect sizes. Also, both proxy measures of collective attention are limited to some extent. The necessity to search for information about a virus on the internet may decrease as its’ spread progresses through the community, and as people become informed through media or individual experience. The media data only provide insight into how many news messages were produced and not into how many of those were read. An alternative way to operationalize collective attention could be through survey research, questioning nationally representative samples on multiple occasions about cohesion and trust [17]. Also, more details are warranted on the affective language in the media messages to assess, for example, whether the messages reflect skepticism toward social distancing guidelines. This could involve a discourse analysis of media content [57]. Finally, the data in the current study are not suitable to address the motivations behind individuals’ decision-making, even though these are likely predictors of individuals’ behavioral compliance. Survey studies suggest that people’s willingness to comply with social distancing directives is associated with, for example, their perception of the disease as a threat, their perception of other people’s compliance, and their trust in the authorities [1517].

Replication of this study in a larger area, in an international context, and over more extended periods is warranted. Our findings are based on a study in the city of Amsterdam in the Netherlands. It is possible that the findings have a limited generalizability to other contexts owing to, for example, national differences in attitudes toward government intervention [58, 59] or cultural differences in personal space boundaries [60]. Also, other countries have adopted different approaches in their social distancing policies and decided on distances of, for example, 1 meter (Austria), 1.8 meters (6 feet; USA), or 2 meters (Denmark). There are also substantial international differences in penalties for violations. Whereas violations in some countries are punished with fines (EUR 390 in the Netherlands during the study period), other countries have presented the social distancing directives as ‘adviced behavior’ rather than as regulation (e.g., Sweden). Due to the labor-intensive nature of systematic observation, we limited the period of our study to the first weeks after the implementation of the social distancing directives. It is unclear if the observed increase in non-compliance will persist in the post-events of the COVID-19 outbreak. Further, we selected cameras, days, and timeslots for coding rather than coding all available footage. We selected cameras at busy locations where the risk of social distancing directives is arguably highest, which may have inflated the violation rate. To enable the collection and processing of data about physical proximity between people on a larger scale, promising technologies are ultra-wideband, Bluetooth, pedestrian tracking sensors, and machine learning [8, 9, 61, 62].

Finally, we note that the current study concentrates on one aspect of social distancing: keeping physical distance from strangers in public places. Other measures, such as preventive quarantine, proactive tracing of potential positive cases, and the protection of professionals exposed to the public, will also aid in mitigating the spread of contagious diseases [20]. The assessment of compliance with these measures is beyond the scope of the current study, but also in dire need of exploration.

Conclusion

The current study applied a novel approach of analyzing CCTV clips to assess people’s behavior in public spaces. We conclude that compliance with social distancing directives appears to decline in the weeks after initial implementation. We further established strong correlations between, on the one hand, the number of observed physical distancing violations and, on the other hand, the number of people on the street and community-wide mobility. The findings imply that directives about keeping distance may work best in combination with stay-at-home directives and place-specific crowd-control strategies and, as such, policy-makers should not rely on people keeping the 1.5-meter distance from others in public while allowing for relaxation of stay-at-home directives. The findings also imply that indicators of community-wide mobility (such as captured with cell phone data) and of the number of people on the street might be used as proxies to assess whether people keep sufficient physical distance from each other at specific times and locations.

Supporting information

S1 Appendix. Codebook.

(PDF)

S2 Appendix. Coded violations and number of people on the street with unimputed data.

(PDF)

S3 Appendix. Time series analyses.

(PDF)

S4 Appendix. Bivariate correlations and trivariate regression models with raw data.

(PDF)

S5 Appendix. Detrending procedure.

(PDF)

Acknowledgments

We would like to thank Lisa van Reemst and Josephine Thomas for being involved in data descriptions, and the Amsterdam Police and Municipality of Amsterdam for facilitating the data collection. We are particularly grateful to Maikel van Scheppingen.We would also like to thank the Algemeen Nederlands Persbureau (ANP) for sharing their data on the number of COVID-19 related media messages.

Data Availability

The data on social distancing regulations and the COVID-19 transmission in the Netherlands from the National Institute for Public Health and the Environment (RIVM; tinyurl.com/ya9yywoj), the data on temperatures from the Royal Netherlands Meteorological Institute (KNMI; tinyurl.com/yb2mjwaw), the data on internet search queries from Google Trends (trends.google.com), and the data from Google’s COVID-19 Community Mobility Reports (google.com/covid19/mobility/) are publicly available without restrictions. The media data from the ANP have been deposited to OSF (osf.io/59tnu). Access to the raw CCTV footage data will be granted by signing an agreement stating that the applicant (1) will use the data only for scientific purposes, (2) will not make the data accessible to third parties, and (3) will not publish results that will disclose the identity of the subjects in the data. To request access to the raw footage files or inquire about the conditions, please contact Thomas Hoogeboom, datamanager at the Netherlands Institute for the Study of Crime and Law Enforcement (NSCR), at email address nscr@nscr.nl. The analyzed data file with coded observations of the CCTV clips has been deposited to OSF (osf.io/59tnu). DOI of all deposited data for this project: 10.17605/OSF.IO/59TNU. These datasets allow readers to replicate the analytical parts of our research.

Funding Statement

This project was supported by the Netherlands Institute for the Study of Crime and Law Enforcement (NSCR, www.nscr.nl) and by a grant from The Netherlands Organisation for Health Research and Development (ZonMw, www.zonmw.nl; project nr. 10430022010017), awarded to MRL, WB, and EH. NSCR and ZonMw had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.World Health Organization [Internet]. Pandemic influenza prevention and mitigation in low resource communities [posted 2009 May, cited 2020 Mar 29]. Available from: https://www.who.int/csr/resources/publications/swineflu/PI_summary_low_resource_02_052009.pdf?ua=1
  • 2.Bootsma MC, Ferguson NM. The effect of public health measures on the 1918 influenza pandemic in US cities. Proceedings of the National Academy of Sciences. 2007;104(18):7588–7593. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Courtemanche C, Garuccio J, Le A, Pinkston J, Yelowitz A. Strong social distancing measures in the United States reduced the COVID-19 growth rate. Health Affairs. 2020; 39(7):e1–e8. 10.1377/hlthaff.2020.00608 [DOI] [PubMed] [Google Scholar]
  • 4.Islam N, Sharp SJ, Chowell G, Shabnam S, Kawachi I, Lacey B, et al. Physical distancing interventions and incidence of coronavirus disease 2019: Natural experiment in 149 countries. BMJ. 2020; 370:m2743. 10.1136/bmj.m2743 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Pisano GP, Sadun R, Zan M. Lessons from Italy’s Response to Coronavirus. Harv Bus Rev [Internet]. 2020. March 27 [cited 2020 Jun 5]. Available from: https://hbr.org/2020/03/lessons-from-italys-response-to-coronavirus [Google Scholar]
  • 6.Bauch CT, Galvani AP. Social factors in epidemiology. Science. 2013; 342(6154): 47–49. 10.1126/science.1244492 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Boden D, Molotch H. The compulsion of proximity. In: Friedland R, Boden D, editors. NowHere: Space, time and modernity. Berkeley: University of California Press; 1994. pp. 253–285. [Google Scholar]
  • 8.Pouw CAS, Toschi F, Van Schadewijk F, Corbetta A. Monitoring physical distancing for crowd management: Real-time trajectory and group analysis. PLoS ONE. 2020; e0240963. 10.1371/journal.pone.0240963 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Sun S, Folarin AA, Ranjan Y, Rashid Z, Conde P, Stewart C, et al. Using smartphones and wearable devices to monitor behavioral changes during COVID-19. Journal of Medical Internet Research. 2020; 22(9):e19992. 10.2196/19992 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Allcott H, Boxell L, Conway J, Ferguson B, Gentzkow M, Goldman B. What explains temporal and geographic variation in the early US Coronavirus pandemic? SSRN 3610422 [Preprint] [posted 2020 May 25, revised 2021 Jan 29, cited February 5]: [54p.]. Available from: 10.2139/ssrn.3610422 [DOI] [Google Scholar]
  • 11.Bonato P, Cintia P, Fabbri F, Fadda D, Giannotti F, Lopalco PL, et al. Mobile phone data analytics against the COVID-19 epidemics in Italy: Flow diversity and local job markets during the national lockdown. arXiv:2004.11278v1 [Preprint]. 2020. [cited 2020 Jun 5]. Available from: https://arxiv.org/abs/2004.11278 [Google Scholar]
  • 12.Gao S, Rao J, Kang Y, Liang Y, Kruse J, Doepfer D, et al. Mobile phone location data reveal the effect and geographic variation of social distancing on the spread of the COVID-19 epidemic. arXiv:2004.11430v1 [Preprint]. 2020. [cited 2020 Sep 4]. Available from: https://arxiv.org/abs/2004.11430 [Google Scholar]
  • 13.Gollwitzer A, Martel C, Marshall J, Höhs JM, Bargh JA. Connecting self-reported social distancing to real-world behavior at the individual and U.S. state level. PsyArXiv [Preprint]. 2020. PsyArXiv 10.31234/osf.io/kvnwp [posted 2020 May 6, revised 2020 Oct 1, cited 2021 Feb 5]:[37 p.]. Available from: https://psyarxiv.com/kvnwp/. [DOI] [Google Scholar]
  • 14.Pepe E, Bajardi P, Gauvin L, Privitera F, Lake B, Cattuto C, et al. COVID-19 outbreak response, a dataset to assess mobility changes in Italy following national lockdown. Scientific Data. 2020; 7(230): 10.1038/s41597-020-00575-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Olsen AL, Hjorth F. Willingness to distance in the COVID-19 pandemic. OSF [Preprint]. 2020. OSF xpwg2 [posted 2020 Mar 30, cited 2020 May 5]: [22 p.]. Available from: osf.io/xpwg2. [Google Scholar]
  • 16.Seale H, Heywood AE, Leask J, Sheel M, Thomas S, Durrheim DN, et al. COVID-19 is rapidly changing: Examining public perceptions and behaviors in response to this evolving pandemic. PLoS ONE. 2020; 15(6):e0235112. 10.1371/journal.pone.0235112 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Van Rooij B, de Bruijn AL, Reinders Folmer C, Kooistra E, Kuiper ME, Brownlee M, et al. Compliance with COVID-19 mitigation measures in the United States. SSRN 3582626 [Preprint] [posted 2020 May 1, revised 2020 Sep 3, cited 2021 Feb 5]: [40p.]. Available from: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3582626 [Google Scholar]
  • 18.Gilmore RO, Adolph KE. Video can make behavioural science more reproducible. Nat Hum Behav. 2017; 1(7): 0128. 10.1038/s41562-017-0128 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Verelst F, Willem L, Beutels P. Behavioural change models for infectious disease transmission: A systematic review (2010–2015). J R Soc. Interface. 2016; 13(125):20160820. 10.1098/rsif.2016.0820 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Fong MW, Gao H, Wong JY, Xiao J, Shiu EY, Ryu S, et al. Nonpharmaceutical measures for pandemic influenza in nonhealthcare settings: Social distancing measures. Emerg Infec Dis. 2020; 26(5):976–984. 10.3201/eid2605.190995 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Moraes RF de. Determinants of physical distancing during the COVID-19 epidemic in Brazil: Effects from mandatory rules, numbers of cases and duration of rules. SciELO Public Health. 2020; 25(9):3393–3400. 10.1590/1413-81232020259.21892020 [DOI] [PubMed] [Google Scholar]
  • 22.Collins R. Rituals of solidarity and security in the wake of terrorist attack. Sociological Theory. 2004; 22(1):53–87. [Google Scholar]
  • 23.World Health Organization [Internet]. Adherence to long-term therapies: Evidence for action [posted 2003 Jan, cited 2020 May 5]. Available from: https://www.who.int/chp/knowledge/publications/adherence_full_report.pdf?ua=1
  • 24.Goffman E. Relations in public. Microstudies of the public order. New York: Basic Books; 1971. 10.1038/229103a0 [DOI] [Google Scholar]
  • 25.Innes M. Signal crimes and signal disorders: Notes on deviance as communicative action. Br J Sociol. 2004; 55(3):335–355. 10.1111/j.1468-4446.2004.00023.x [DOI] [PubMed] [Google Scholar]
  • 26.Mauss M. Seasonal variations of the Eskimo: A study in social morphology. London: Routledge; 1979. [Google Scholar]
  • 27.Harper CA, Satchell LP, Fido D, Latzman RD. Functional fear predicts public health compliance in the COVID-19 pandemic. Int JMent Health Addict. 2020. 10.1007/s11469-020-00281-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Philpot R, Liebst LS, Møller KK, Lindegaard MR, Levine M. Capturing violence in the night-time economy: A review of established and emerging methodologies. Aggress Violent Behav. 2019; 46;56–65. [Google Scholar]
  • 29.Rijksoverheid [Internet]. Aanvullende maatregelen 23 maart [posted 2020 Mar 24, cited 2020 May 5]. Available from: https://www.rijksoverheid.nl/actueel/nieuws/2020/03/24/aanvullendemaatregelen-23-maart.
  • 30.Afifi WA, Johnson ML. The nature and function of tie-signs. In: Manusov VL, editor. The sourcebook of nonverbal measures: Going beyond words. New Jersey: Psychology Press; 2005. pp. 189–98. [Google Scholar]
  • 31.Suvilehto JT, Glerean E, Dunbar RI, Hari R, Nummenmaa L. Topography of social touching depends on emotional bonds between humans. Proc Natl Acad Sc. 2015; 112(45):13811–13816. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Reiss AJ. Systematic observation of natural social phenomena. Sociol Methodol. 1971; 3:3–33. [Google Scholar]
  • 33.Government of the Netherlands. 2020. [cited May 5 2020]. In: Government of the Netherlands [Internet]. The Hague: Government of the Netherlands. Available from http://www.government.nl. [Google Scholar]
  • 34.NRC Handelsblad. 2020. [cited May 5 2020]. In: NRC.nl [Internet]. Amsterdam: NRC Handelsblad. Available from http://www.nrc.nl. [Google Scholar]
  • 35.NU.nl. 2020. [cited May 5 2020]. In: NU.nl [Internet]. Hoofddorp: NU.nl. Available from http://www.nu.nl. [Google Scholar]
  • 36.John Hopkins University & Medicine.2020. [cited May 3 2020]. In: Maps & trends: Follow global cases and trends [Internet]. Baltimore: John Hopkins University. Available from https://coronavirus.jhu.edu/data. [Google Scholar]
  • 37.Google LLC [cited Sep 4 2020]. In: Google COVID-19 Community Mobility Reports [Internet]. Mountain View: Google. Available from https://www.google.com/covid19/mobility/.
  • 38.Koninklijk Nederlands Meteorologisch Instituut.2020. [cited May 3 2020]. In: Klimatologie: Uurgegevens van het weer in Nederland [Internet]. De Bilt: Koninklijk Nederlands Meteorologisch Instituut. Available from https://projects.knmi.nl/klimatologie/uurgegevens/selectie.cgi. [Google Scholar]
  • 39.Google Trends. 2020. [cited May 6 2020]. In: Google Trends [Internet]. Mountain View: Google. Available from https://trends.google.com/trends/explore. [Google Scholar]
  • 40.Farnum NR, Stanton LW. Quantitative forecasting methods. Boston: PWS Publishers; 1989. [Google Scholar]
  • 41.Civettini AJ. Detrending. In: Lewis-Beck MS, Bryman A, Futing Liao T, editors. The SAGE encyclopedia of social science research methods. Thousand Oaks: SAGE Publications; 2004. Pp. 258–259. [Google Scholar]
  • 42.R Core Team. R: A language and environment for statistical computing. Vienna: R Foundation for Statistical Computing; 2020. Available from https://www.R-project.org/. [Google Scholar]
  • 43.Rijksoverheid [Internet]. Letterlijke tekst persconferentie ministers Bruins en Slob over aanvullende maatregelen coronavirus [posted 2020 Mar 15, cited 2020 May 5]. Available from: https://www.rijksoverheid.nl/documenten/mediateksten/2020/03/15/persconferentieminister-bruins-en-slob-over-aanvullende-maatregelen-coronavirus
  • 44.Reluga TC. Game theory of social distancing in response to an epidemic. PLoS Comput Biol. 2010; 6(5):e1–e9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Fetzer TR., Witte M, Hensel L, Jachimowicz J, Haushofer J, Ivchenko A, et al. Global behaviors and perceptions at the onset of the COVID-19 pandemic. NBER: w27082 [Preprint]. 2020. [cited 2020 June 18]. Available from: https://www.nber.org/papers/w27082. [Google Scholar]
  • 46.Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, Schünemann HJ. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: A systematic review and meta-analysis. The Lancet. 2020; 395:1973–1987. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Lindegaard MR, Bernasco W. Lessons learned from crime caught on camera. J Res Crime Delinq. 2018; 55(1):155–186. 10.1177/0022427817727830 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Chetty R, Friedman JN, Hendren N, Stepner M. How did COVID-19 and stabilization policies affect spending and employment? A new real-time economic tracker based on private sector data. NBER 27431 [Preprint] [posted 2020 June, revised 2020 Nov, cited 2021 Feb 5]: [109p.]. Available from: http://www.nber.org/papers/w27431.pdf [Google Scholar]
  • 49.Brezinski A, Deiana G, Valentin K, Van Dijcke D. The COVID-19 pandemic: Government vs. community action across the United States. INET Oxford 2020–06 [Preprint] [posted April 18, cited September 2]: [43p.] Available from: https://www.inet.ox.ac.uk/files/BrzezinskiKechtDeianaVanDijcke_18042020_CEPR_2.pdf [Google Scholar]
  • 50.Ghader S, Zhao J, Lee M, Zhou W, Zhao G, Zhang L. Observed mobility behavior data reveal “Social distancing inertia”. arXiv:2004.14748v1 [Preprint]. 2020. [cited 2020 Sep 4]. Available from https://arxiv.org/abs/2004.14748. [Google Scholar]
  • 51.Conn VS, Ruppar TM, Chan KC, Dunbar-Jacob J, Pepper GA, De Geest S. Packaging interventions to increase medication adherence: Systematic review and meta-analysis. Current Medical Research and Opinion. 2015; 31(1):145–160. 10.1185/03007995.2014.978939 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Griffith S. A review of the factors associated with patient compliance and the taking of prescribed medicines. Br J Gen Pract. 1990; 40(332):114–116. [PMC free article] [PubMed] [Google Scholar]
  • 53.Stockwell Morris L, Schulz RM. Patient compliance: An overview. J Clin Pharm Ther. 1992; 17(5):283–295. 10.1111/j.1365-2710.1992.tb01306.x [DOI] [PubMed] [Google Scholar]
  • 54.Lau JT, Kim JH, Tsui HY, Griffiths S. Anticipated and current preventive behaviors in response to an anticipated human-to-human H5N1 epidemic in the Hong Kong Chinese general population. BMC Infec Dis. 2007; 7(1):e1–e12. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Cialdini RB, Demaine LJ, Sagarin BJ, Barrett DW, Rhoads K, Winter PL. Managing social norms for persuasive impact. Social Influence. 2006; 1(1):3–15. [Google Scholar]
  • 56.Cialdini RB, Goldstein NJ. Social influence: Compliance and conformity. Annu Rev Psychol. 2004; 55:591–621. 10.1146/annurev.psych.55.090902.142015 [DOI] [PubMed] [Google Scholar]
  • 57.De Vreese CH. The effects of frames in political television news on issue interpretation and frame salience. Journal Mass Commun Q. 2004;81(1): 36–52. [Google Scholar]
  • 58.Kikuzawa S, Olafsdottir S, Pescosolido BA. Similar pressures, different contexts: Public attitudes toward government intervention for health care in 21 nations. J Health Soc Behav. 2008; 49(4):385–399. 10.1177/002214650804900402 [DOI] [PubMed] [Google Scholar]
  • 59.Painter MO, Qiu T. Political beliefs affect compliance with COVID-19 social distancing orders. SSRN 3569098 [Preprint] [posted 2020 Apr 6, revised 2020 July 3, cited 2021 Feb 5]: [32 p.]. Available from: https://ssrn.com/abstract=3569098 [Google Scholar]
  • 60.Sorokowska A, Sorokowski P, Hilpert P, Cantarero K, Frackowiak T, Ahmadi K. et al. Preferred interpersonal distances: A global comparison. J Cross Cult Psychol. 2017; 48(4): 577–592. [Google Scholar]
  • 61.Nguyen CT, Saputra YM, Huynh NV, Nguyen N-T, Khoa TV, Tuan BM, et al. A comprehensive survey of enabling and emerging technologies for social distancing–Part I: Fundamentals and enabling technologies. IEEE Access. 2020; 8: 153479–153507. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Nguyen CT, Saputra YM, Huynh NV, Nguyen N-T, Khoa TV, Tuan BM, et al. A comprehensive survey of enabling and emerging technologies for social distancing–Part II: Emerging technologies and open issues. IEEE Access. 2020; 8: 154209–154236. [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Holly Seale

1 Aug 2020

PONE-D-20-19629

Social distancing compliance: A video observational analysis

PLOS ONE

Dear Dr. Hoeben,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Both of the reviewers have indicated concerns with the approach taken to analyse the data and the possible limitations in the data. It is important, that these concerns are addressed and if needed, a statistician sought to assist with updating the analysis.

==============================

Please submit your revised manuscript by Sep 15 2020 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Holly Seale

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2.We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. We note that you have stated that you will provide repository information for your data at acceptance. Should your manuscript be accepted for publication, we will hold it until you provide the relevant accession numbers or DOIs necessary to access your data. If you wish to make changes to your Data Availability statement, please describe these changes in your cover letter and we will update your Data Availability statement to reflect the information you provide.

Additional Editor Comments (if provided):

Both of the reviewers have indicated concerns with the approach taken to analyse the data and the possible limitations in the data. It is important, that these concerns are addressed and if needed, a statistician sought to assist with updating the analysis.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: No

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Overall, I was excited to read this paper that uses video data to measure social distancing compliance. This is an important source of data to complement the more prevalent uses of cell phone data.

I have the following concerns/comments:

1. The authors should clarify how 1.5m is measured in the videos. It is well known that a lot of media images showing beaches are misleading because of the focal points --- is this an issue here?

2. It looks like most of the change in 1.5m compliance occurred prior to the national mandate. This is consistent with previous work showing the importance of voluntary measures in the US. E.g.,

- Chetty, Raj, John N. Friedman, Nathaniel Hendren, and Michael Stepner. 2020. Real-Time Economics: A New Platform to Track the Impacts of COVID-19 on People, Businesses, and

Communities Using Private Sector Data.

- Allcott, Hunt, Levi Boxell, Jacob Conway, Billy Ferguson, Matthew Gentzkow, and Benny Goldman.

2020. Economic and Health Impacts of Social Distancing Policies during the Coronavirus Pandemic.

In general, it would also be good to make sure the literature review is up to date when published.

3. In a lot of the correlations, the authors detrend the data. I'm not sure that is what you want to do. E.g., When examining the relationship between covid cases and social distancing behaviors, most people are going to be making inferences about the trends --- not deviations from those trends. It would be good to visualize the correlations both ways.

4. I'd maybe suggest removing the time series analysis section and placing it in a supplementary appendix. It's hard to know what inferences to make from these. I'd be interested in seeing a multivariate regression analysis looking at what predicts violations (e.g., cases, deaths, temperature, media mentions, etc).

5. I'm a bit concerned that the rise in 1.5m violations is purely mechanically related to the number of people in the video. I think it is important to try to distinguish between (a) 1.5m violations increasing purely because the # of people out is increasing vs (b) 1.5 m violations increasing because people are being less careful conditional on being outside. The correlation plot suggests a lot of this could be driven by (a).

Two ways I can think of addressing this:

- Compare the relationship between 1.5m violations and distancing in a placebo time peirod (e.g., a month or two before Covid or during the same period in 2019).

- Compute the expected number of violations if people were placed randomly in the video screen. (This isn't ideal, but could still be suggestive of how much of this is mechanical.)

Other points not required for revision, but would be great to see addressed if possible:

6. I was disappointed with the limited scope of the data actually analyzed. I was hoping machine learning was used to identify violations which would have allowed a minute-by-minute overview of these patterns across time and much richer analysis. The study as-is is still useful, but not to the same degree.

7. It would be great to compare the video violations to cell phone distancing behavior --- since that was part of the motivation for the paper.

8. It would be nice if the violations were also coded by demographics. E.g., Were 50% of all people on the video male, but males composed 70% of the violations?

Reviewer #2: This paper studies an important and timely question: examining whether citizens are adhering to social distancing practice set by the government, and whether such adherence last over time is critical to inform how we project the effectiveness of such policies. This study uses a novel measure of social distancing behaviors from CCTV camera footage in Amsterdam, a measure that is rare in the existing literature.

With this said, I think the paper’s analyses have a number of important limitations.

1. The authors do not perform any rigorous statistical tests, and hence it is impossible to tell whether there indeed is an upward trend of social distancing violation over time. With the current number of observations in the analyses, I do not think the authors have sufficient statistical power to draw any conclusions.

2. The primary outcome of interest is the total level of social distancing violation. This is very difficult to interpret, since as the authors show, the total number of people shown on the street is also increasing over time. Hence, it is not clear whether the rate of social distancing violation actually increases, which I believe is what the authors ultimately are interested in. Moreover, I do not think the current evidence can substantiate the claim that social distancing compliance and stay-at-home compliance coincide. One could mechanically result in the other: the absolute number of social distancing violation would go up (even if the compliance rate remains constant) if people are less likely to stay at home.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Holly Seale

4 Jan 2021

PONE-D-20-19629R1

Social distancing compliance: A video observational analysis

PLOS ONE

Dear Dr. Hoeben,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

Based on these reports, and my own assessment, I am pleased to inform you that it is potentially acceptable for publication, however, it is critical that you carry out the essential revisions suggested by our reviewers. Two of the reviewers have raised concerns that their previous suggestions have not been adequately addressed. Can I please ask that you ensure that you consider each of the suggested revisions and provide some dialogue around how the revision has been addressed (if appropriate). 

==============================

Please submit your revised manuscript by Feb 18 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

We look forward to receiving your revised manuscript.

Kind regards,

Holly Seale

Academic Editor

PLOS ONE

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: (No Response)

Reviewer #3: (No Response)

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Partly

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: No

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: (No Response)

Reviewer #3: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I found the revised manuscript more suitable for publication. I view the main contribution to be demonstrated in Figure 10 and Table 2--- the correlation between 1.5m violations, people on the street, mobility patterns, and covid-19 searches. It is important to show the extent to which different measures of social distancing are correlated, and this paper provides new evidence on this for 1.5m violations in public. I think this meets criteria for publication in PLOS One.

The manner in which the authors detrend each series separately is not standard procedure in the social science background I come from. Furthermore, if the main point is to show that different measures of social distancing are correlated, then you are interested in both the correlations in the trend and in the deviations from that trend. This isn't a causal question where you try to remove confounds, it is purely a descriptive question. For these reasons, I'd like to see, at least, a version of Figure 10 that shows the correlations of the raw data.

The authors could probably also shorten the discussion of some of the other aspects of the paper. I think less is more in this context given data limitations.

My only other comment is that there are a lot of figures in this paper. The authors could probably combine the plots with the violations on the Y-axis and the covariats on the x-axis into a single figure with multiple panels. And then a similar plot with the covariates on the Y-axis and the date on the x-axis into a single figure with multiple panels (possibly in the appendix).

Reviewer #2: I do not think the author has satisfyingly addressed my second comment from the previous review. In particular, the author should put "people on the street" used in Table 2, or just simply counting the number of people on the street from the CCTV camera stream, on the RHS in Table 1. Without doing so, the conclusion "directives about keeping distance may work best in combination with stay directives" is not substantiated, as it is impossible to tell whether the lack of social distancing on the street is simply due to an increase in total number of people showing up on the street in the first place.

Reviewer #3: I enjoyed reading this well-written article and the use of novel data sources to study human behavior. As the authors point out, manually coding hours of video footage can be labor intensive, which might limit the full potential that such data source represents. I would also argue that having two researchers to watch and manually code hours of video footage increases the risk of biases and errors. Have the authors considered using a machine learning approach instead? Alternatively, could the authors employ incentivized subjects (e.g. MTurk or students) to review the footage? This could help minimize errors and perhaps also use longer hours of footage (increasing the sample size).

The authors also use new deaths and infections as a control. Would the same results hold if the authors only used deaths and cases within a smaller Km radius around the footage locations? Also, are deaths and cases considered as a percentage of the population? Another interesting test could be to use new COVID-19 cases between the previous week and the week of the footage, which might help control for saliency of infections.

The authors also argue that their data source is more reliable than other studies using mobile data because they can better assess social proximity. However, most studies that use mobile data can measure proximity, for instance generating a measure of gyration (see Pepe et al. 2020, Scientific Data 7, 230). If the data allows, the authors could consider creating similar index of proximity and compare it with their footage data. If this is not possible, the authors should at least revise such statements from the manuscript.

Can the authors add some screenshots of the footage in an Appendix, perhaps blurring faces to preserve anonymity of passengers? This would help the readers contextualize how different the streets looked between crowded and less crowded days. Also, from the footage, can the authors see whether or not passengers were wearing a mask? Was there any notable change in mask-waring behaviors over time and between mask-wearing and distancing?

The authors should support with further tests and regressions their choice of the polynomial function, especially to test the null hypothesis of linearity, against the alternative that the regression is quadratic and/or cubic (e.g. a simple t-test should suffice). This can help control for whether differences between models are partly driven by outliers, which can be a problem in quadratic regression functions.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Mar 15;16(3):e0248221. doi: 10.1371/journal.pone.0248221.r004

Author response to Decision Letter 1


15 Feb 2021

*This text was copy-pasted from the document 'Response to Reviewers', which is also enclosed*

Dear Editor,

We thank you for the opportunity to revise and resubmit our manuscript. We value the reviewers’ feedback and appreciate the time they have spent on reading our work.

In the remainder of this memo, we explain how we have addressed the suggested revisions.

With kind regards,

The authors

Comments from the Editor

Based on these reports, and my own assessment, I am pleased to inform you that it is potentially acceptable for publication, however, it is critical that you carry out the essential revisions suggested by our reviewers. Two of the reviewers have raised concerns that their previous suggestions have not been adequately addressed. Can I please ask that you ensure that you consider each of the suggested revisions and provide some dialogue around how the revision has been addressed (if appropriate).

In response to the reviewers’ comments, we have conducted additional analyses and a new literature search, added Appendices S4 and S5, and substantially shortened the discussion of the results.

Comments from Reviewer #1

The manner in which the authors detrend each series separately is not standard procedure in the social science background I come from. Furthermore, if the main point is to show that different measures of social distancing are correlated, then you are interested in both the correlations in the trend and in the deviations from that trend. This isn't a causal question where you try to remove confounds, it is purely a descriptive question. For these reasons, I'd like to see, at least, a version of Figure 10 that shows the correlations of the raw data.

We have calculated the bivariate correlations (Fig 6, which was Fig 10 in the previous version) and trivariate regression models (Table 1 and 2) with raw data, and added these as supplemental materials (Appendix S4). We refer to these materials on page 12, line 254.

The authors could probably also shorten the discussion of some of the other aspects of the paper. I think less is more in this context given data limitations.

We have substantially shortened the discussion of the results with respect to the covariates temperature, media items, and Google search scores.

My only other comment is that there are a lot of figures in this paper. The authors could probably combine the plots with the violations on the Y-axis and the covariates on the x-axis into a single figure with multiple panels. And then a similar plot with the covariates on the Y-axis and the date on the x-axis into a single figure with multiple panels (possibly in the appendix).

We followed the suggestion of the reviewer by combining the left panels of former Figures 1, 5, 6, 7, 8, and 9 into the new Figure 1 and the right panels of these former Figures into the new Figure 5.

Comments from Reviewer #2

I do not think the author has satisfyingly addressed my second comment from the previous review. In particular, the author should put "people on the street" used in Table 2, or just simply counting the number of people on the street from the CCTV camera stream, on the RHS in Table 1. Without doing so, the conclusion "directives about keeping distance may work best in combination with stay directives" is not substantiated, as it is impossible to tell whether the lack of social distancing on the street is simply due to an increase in total number of people showing up on the street in the first place.

We do not share the view of Reviewer #2 that taking the ratio of the number of violations by the number of people on the street as the dependent variable would offer an improvement to our study. Most importantly because it would not allow us to examine the effect of the number of people on the street on the number of violations. As we show with the analyses presented in Table 2, this is a non-trivial effect that explains away the effects of most but not all of the other covariates.

As discussed on pages 18-19 of the paper (and Table 2), we find that people’s overall mobility, as captured with cellphone information from Google’s Community Mobility Reports, affects the number of social distancing violations even after correcting for the number of people on the street. This, in our opinion, substantiates our conclusion that directives about keeping distance may work best in combination with stay-at-home directives.

Comments from Reviewer #3

Have the authors considered using a machine learning approach instead? Alternatively, could the authors employ incentivized subjects (e.g. MTurk or students) to review the footage? This could help minimize errors and perhaps also use longer hours of footage (increasing the sample size).

We agree with the reviewer that a machine learning approach would offer a time-efficient way of analyzing CCTV footage. We explicitly mention this as a promising venue for future research (page 26, line 548). In fact, we are currently working on a project to apply machine learning to automatically detect social distance violations from CCTV footage. However, this is a comprehensive undertaking that we consider to be beyond the scope of the current study.

The authors also use new deaths and infections as a control. Would the same results hold if the authors only used deaths and cases within a smaller Km radius around the footage locations? Also, are deaths and cases considered as a percentage of the population?

The COVID-19 transmissions and deaths are included as absolute numbers. We added text to page 9, line 203 to make this explicit. If the population is stable over the examined period, which we expect it to be during such a small time-window (Feb 29th to May 2nd; it is not likely that a substantial number of people will die, be born, move in, or move away in that time-frame), it will not matter whether we include absolute numbers or percentages.

We feel that our current approach, in which we use national-level data on COVID-19 transmissions and deaths, is preferred over including regional-level data. We theorized that individuals would be affected in their distancing behavior by the perceived urgency of the problem, as operationalized by the number of transmissions and deaths. Of course, people will only be affected in their behavior to the extent that they are aware of these numbers of transmissions and deaths. The Dutch media published these numbers at a national level. Therefore, it makes more sense to include national-level information on transmissions and deaths than information on transmissions and deaths that occurred at a small radius around the footage locations.

Another interesting test could be to use new COVID-19 cases between the previous week and the week of the footage, which might help control for saliency of infections.

We agree with the reviewer that this would be an interesting test. In the supplemental materials (Appendix S3), we present the cross-correlation function (CCF) between the number of violations on the one hand and the other variables (including new COVID-19 transmissions) on the other hand. Figure S3.2D shows that this correlation is slightly stronger negative in the two weeks prior (lag = -1 and lag = -2), compared to in the week itself (lag = 0). This means that the number of violations is slightly stronger associated with the number of new COVID-19 transmissions in the prior weeks than with the number of transmissions in the same week. We see a similar pattern for the number of COVID-19 deaths (Fig S3.2C).

The authors also argue that their data source is more reliable than other studies using mobile data because they can better assess social proximity. However, most studies that use mobile data can measure proximity, for instance generating a measure of gyration (see Pepe et al. 2020, Scientific Data 7, 230). If the data allows, the authors could consider creating similar index of proximity and compare it with their footage data. If this is not possible, the authors should at least revise such statements from the manuscript.

It is correct that other studies have measured proximity, however, not at the level of detail that our study does. To take the study of Pepe et al. (2020) as an example, they determine the location of respondents with a 10-meter accuracy margin (p.2) and respondents’ proximity to others based on 50-meter radiuses (p.3). Pepe et al. (2020, p.4) even explicitly state that “It is important to remark that this is not a close-range contact network.” By using video images, we can assess whether people are within 1.5 meter of each other, which is far more detailed than what mobile data, such as applied in the study by Pepe et al. (2020), allow for.

Given the rapid growth of COVID-19 related research, we conducted a new literature search to look for studies on time trends in social distancing violations, which apply methods that (theoretically) assess physical proximity with a comparable level of accuracy. We found two studies that were published after our previous resubmission on Sep 12 (Sun et al., 2020, on Sep 25, and Pouw et al., 2020, on Oct 29). Sun et al. (2020) found that, among 1062 respondents from five European countries, the number of detected nearby Bluetooth-enabled devices was significantly lower during the lockdown compared to in the pre-lockdown period. Note, however, that the study does not specify within what range these devices could be detected. Pouw et al. (2020) apply pedestrian tracking sensors on crowds in a large train station. Their method is able to assess physical proximity quite accurately. They found a pattern in social distancing violations that is similar to the one we found, in that people complied with the guidelines in the beginning of the outbreak, but that the number of violations increased soon after.

We recognize the potential of Bluetooth and pedestrian tracking sensors as venues for future research (page 26, line 548) and have included references to the studies by Sun et al. (2020), Pouw et al. (2020) and Pepe et al. (2020). We stand by our argument that our data source offers a more “fine-grained examination of the physical distance between people” compared to the use of aggregated mobile phone location data (page 20, lines 427-428), but we did revise our statement on page 4 to make more explicit how our study contributes to existing studies using mobile phone data.

Can the authors add some screenshots of the footage in an Appendix, perhaps blurring faces to preserve anonymity of passengers? This would help the readers contextualize how different the streets looked between crowded and less crowded days.

This will not be possible due to the conditions under which the data were provided to us. Access to the CCTV footage data was provided by the Amsterdam police and municipality under the condition that data would be securely stored, not be publicly shared, and that the identity of the individuals visible in the footage would be protected. Even if we would blurr their faces, depicted individuals might be identified through their clothes and their presence at a specific location and time.

Also, from the footage, can the authors see whether or not passengers were wearing a mask? Was there any notable change in mask-waring behaviors over time and between mask-wearing and distancing?

During the time period covered in our study (Feb 29th-May 2nd 2020), facemask wearing was not common in The Netherlands, so few (if any) of the depicted individuals were wearing them. Formal mandates to wear face-masks in The Netherlands were not issued until August 2020 (regions Amsterdam and Rotterdam) and December 2020 (entire country).

The authors should support with further tests and regressions their choice of the polynomial function, especially to test the null hypothesis of linearity, against the alternative that the regression is quadratic and/or cubic (e.g. a simple t-test should suffice). This can help control for whether differences between models are partly driven by outliers, which can be a problem in quadratic regression functions.

We elaborated on the details of the detrending procedure in the main text (pages 11-12) and in the supplemental materials (Appendix S5). Specifically, we now present R2 and Bayesian Information Criterion measures as indicators of model fit as well as T-tests and likelihood ratio tests to compare each of the models against a more restricted version (also in Appendix S5). We explain how we decided on the polynomial function based on these measures.

Attachment

Submitted filename: Response to Reviewers21-02-15.docx

Decision Letter 2

Holly Seale

23 Feb 2021

Social distancing compliance: A video observational analysis

PONE-D-20-19629R2

Dear Dr. Hoeben,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Holly Seale

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Holly Seale

5 Mar 2021

PONE-D-20-19629R2

Social distancing compliance: A video observational analysis

Dear Dr. Hoeben:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Holly Seale

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Appendix. Codebook.

    (PDF)

    S2 Appendix. Coded violations and number of people on the street with unimputed data.

    (PDF)

    S3 Appendix. Time series analyses.

    (PDF)

    S4 Appendix. Bivariate correlations and trivariate regression models with raw data.

    (PDF)

    S5 Appendix. Detrending procedure.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers20-09-11.docx

    Attachment

    Submitted filename: Response to Reviewers21-02-15.docx

    Data Availability Statement

    The data on social distancing regulations and the COVID-19 transmission in the Netherlands from the National Institute for Public Health and the Environment (RIVM; tinyurl.com/ya9yywoj), the data on temperatures from the Royal Netherlands Meteorological Institute (KNMI; tinyurl.com/yb2mjwaw), the data on internet search queries from Google Trends (trends.google.com), and the data from Google’s COVID-19 Community Mobility Reports (google.com/covid19/mobility/) are publicly available without restrictions. The media data from the ANP have been deposited to OSF (osf.io/59tnu). Access to the raw CCTV footage data will be granted by signing an agreement stating that the applicant (1) will use the data only for scientific purposes, (2) will not make the data accessible to third parties, and (3) will not publish results that will disclose the identity of the subjects in the data. To request access to the raw footage files or inquire about the conditions, please contact Thomas Hoogeboom, datamanager at the Netherlands Institute for the Study of Crime and Law Enforcement (NSCR), at email address nscr@nscr.nl. The analyzed data file with coded observations of the CCTV clips has been deposited to OSF (osf.io/59tnu). DOI of all deposited data for this project: 10.17605/OSF.IO/59TNU. These datasets allow readers to replicate the analytical parts of our research.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES