Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Apr 22;16(4):e0250433. doi: 10.1371/journal.pone.0250433

Temporal clustering of disorder events during the COVID-19 pandemic

Gian Maria Campedelli 1,*, Maria R D’Orsogna 2,3
Editor: Chad M Topaz4
PMCID: PMC8062074  PMID: 33886656

Abstract

The COVID-19 pandemic has unleashed multiple public health, socio-economic, and institutional crises. Measures taken to slow the spread of the virus have fostered significant strain between authorities and citizens, leading to waves of social unrest and anti-government demonstrations. We study the temporal nature of pandemic-related disorder events as tallied by the “COVID-19 Disorder Tracker” initiative by focusing on the three countries with the largest number of incidents, India, Israel, and Mexico. By fitting Poisson and Hawkes processes to the stream of data, we find that disorder events are inter-dependent and self-excite in all three countries. Geographic clustering confirms these features at the subnational level, indicating that nationwide disorders emerge as the convergence of meso-scale patterns of self-excitation. Considerable diversity is observed among countries when computing correlations of events between subnational clusters; these are discussed in the context of specific political, societal and geographic characteristics. Israel, the most territorially compact and where large scale protests were coordinated in response to government lockdowns, displays the largest reactivity and the shortest period of influence following an event, as well as the strongest nationwide synchrony. In Mexico, where complete lockdown orders were never mandated, reactivity and nationwide synchrony are lowest. Our work highlights the need for authorities to promote local information campaigns to ensure that livelihoods and virus containment policies are not perceived as mutually exclusive.

1 Introduction

On March 11, 2020, the World Health Organization declared the coronavirus outbreak a global pandemic. No country has been spared from the far-reaching impacts of the ensuing viral disease, termed COVID-19, which touched and transformed most, if not all, aspects of societal living. In the absence of a widely available vaccine, and in light of the many unknowns posed by the pandemic, governments responded with a wide array of measures aimed at avoiding large scale public health crises with varying degrees of resources, capacity, and resolve. These included restrictions on travel and mobility, social distancing and quarantine requirements, imposing school and business closures, implementing large scale testing, prohibiting large crowd gatherings. Periods of more or less stringent orders alternated depending on the local ebbs and flows of the pandemic. In parallel, governments also increased spending to reduce the risk of permanent damage to their economies and to alleviate unemployment and poverty. Policymakers have been confronted with philosophical and moral questions centered on how to balance individual freedoms and preserving the economy while protecting the lives of vulnerable populations, and on whether utilitarian-outcome or kantian-deontological approaches should be taken [1]. In addition, especially at the onset of the pandemic, different jurisdictions adopted different strategies due to the limited scientific understanding of COVID-19, and without being able to fully anticipate the medium-term health, social and political implications of their decisions. Sweden for example chose not to enter a lockdown while the rest of Europe did; in the US emergency orders were implemented after non-uniform threshold levels were met across the country, resulting in significant variability from county to county [2]. Similarly, the recent announcement of the development of effective vaccines is marked by questions not only on how to optimally scale up production but also how to distribute vaccines in an ethical manner [3, 4].

While not perfect and difficult to evaluate, the above interventions for the most part helped prevent more widespread transmission and buffer worse economic fallouts [57]. By the same token, they have provoked concerns over becoming drivers of economic uncertainty and deprivation [8], reinforcing economic inequality [9, 10], engendering political distrust [11], and leading to long-term mental health consequences as a result of prolonged physical isolation and reduced human interaction [12]. Ultimately COVID-19 has caused what are poised to be long-lasting economic, financial, and social crises worldwide.

Traditional and social media have played a significant role in disseminating COVID-19 related information [13, 14]. They have helped turn best practices into habits, and offered personalized networking opportunities in times of solitude. However, politicization of the pandemic, the sharing of non-vetted yet sensational or controversial findings or hypothesis, and algorithmic manipulation by platform hosts, have allowed for conspiracy theories and misinformation to spread, causing anxiety and discontent [1517].

All these ingredients—the emergence of a pandemic most were not prepared for, the difficulty for policymakers in make clear-sighted decisions that could be well received by a diverse set of stakeholders, the online spread of distorted information, personal fears and the need to connect to others—have arguably combined to spark pandemic-related social unrest throughout the globe as manifest by the numerous protests, riots and disorders recorded in many countries. Although these events have attracted media attention and ignited public debate, their characteristics and timing are poorly understood. Protests ignited by past outbreaks offer little insight into current societal unrest due to their comparatively limited spatio-temporal scope, and the lack of accurate data collection at the time they occurred.

In this paper we investigate the temporal distribution of civil disorders directly attributable to the 2020 coronavirus pandemic and, specifically, the temporal clustering and self-excitability of events. These “contagion” trends are recurrent in human activity and have been observed in criminal behavior [18, 19], terrorist attacks [20, 21], political shocks [22, 23], violent conflicts [24, 25] and collective protesting and rioting [2628]. We hypothesize they also characterize the current COVID-19 protests worldwide.

Our analyses focus on the three countries that were most hit by protests, riots, and violent events directly related to the COVID-19 pandemic, namely India, Israel, and Mexico, as per data made available through the “COVID-19 Disorder Tracker” (CDT) initiative [29] curated by the “Armed Conflict Location & Event Data Project” (ACLED) [30]. While we recognize that peaceful protests are distinct from riots or episodes of violence against civilians, and that they carry different features and theoretical implications [31], we do not discriminate among them in our analyses due to their shared, high-level etiological trigger: the COVID-19 pandemic. Note that concurrent with the unfolding of the COVID-19 crisis are other episodes of civil unrest whose primary source is not pandemic-related, most notably the Lives Matter protests that originated in Minneapolis in late May 2020 in the wake of George Floyd’s murder and that persist at this time of writing. ACLED does not tally these events, and we do not include them in our work as these demonstrations arise primarily in response to racial injustice, although racial disparities in COVID-19 cases may have contributed to the unrest.

For each of the three countries we focus on, we study the temporal clustering and self-excitability of pandemic-related demonstrations on the national and subnational scales. We assume all events recorded by ACLED in a given country are part of the same underlying stream of events, whereas on the local level we construct mutually exclusive geographical clusters through k-means clustering. Temporal self-excitation is studied by applying the Hawkes process [32], a stochastic point process initially used to understand aftershocks in the vicinity of an earthquake epicenter, and later adapted to finance, cell signaling, and disease-spread. In relation to social phenomena, Hawkes process have also been applied to describe and analyze the distribution of violent events, such as terrorist attacks [33], gun violence [34], and gang-related crimes [35]. Hawkes processes are non-Markovian extensions of Poisson processes. The latter are memory-less with events following a random temporal distribution, whereas the likelihood of an event in a Hawkes process depends on past ones, leading to clustering, memory effects, and self-excitability. These features are well-suited to study human behaviors that appear to be patterned in time. We fit both Poisson and Hawkes processes to data within each cluster to verify if and how temporal clustering emerges at various subnational scales.

Our analysis reveals that temporal clustering of pandemic-related demonstrations is a common feature in all three countries. Despite variations in the temporal distribution of events and in the magnitude of self-excitability and reactivity across the three different contexts, Hawkes processes better capture the underlying dynamics present in the data compared to Poisson processes. Furthermore, we find that self-excitability at the national level appears to emerge as the convergence of subnational, cluster-based self-excitatory events, rather than as the result of a meso-level stream of events. Our results highlight the interplay between the national and subnational socio-political discourse in the emergence of large-scale disorders that may erupt in response to centralized decisions, with information easily channeled through social media and other communication networks, but may also manifest locally, with the global source of discontent becoming particularized to local grievances and sources of tension.

The remainder of this paper is organized as follows. In the Background section we briefly review the protesting and rioting literature in other contexts. We also provide a synthetic account of the evolution of the pandemic in each of the three countries under investigation. In the Materials and Methods section will describe the ACLED data we utilize and outline our methodology. The statistical outcomes of our inferential models, along with additional analyses on the temporal characteristics of events in each country and cluster, are presented in the Results section. Finally, in the Discussion and Conclusion section we discuss the relevance of our results and their broader significance.

2 Background

COVID-19-related social unrest has been observed in several countries in the form of protests, riots, and other demonstrations, often in response to virus-containment decisions imposed by governments. These decisions may have seemed too onerous, unfair, or the root cause of economic uncertainty. It is important to understand the characteristics of this unrest for two reasons: one is preventative, as demonstrations always carry the risk of widespread contagion, given their often chaotic and crowded nature, and of devolving into uncontrolled, violent clashes with authorities and/or among protesters and counter-protesters. The other is more introspective, as these protests may be manifestations of latent societal discontent, predating the pandemic, invigorated by newly mandated restrictive policies.

Though unique in its global reach, the current pandemic does not represent a unicum in terms of the social unrest it has caused. History has repeatedly been marked by uprising and protests in response to social, political, and economic crises. In recent decades, social movements and collective action have mobilized citizens in demanding changes to political regimes, economic policies, and more respect for human rights. A vast academic literature has emerged as a result, to study why, how, when large scale peaceful and violent demonstrations occur and what their repercussions may be [36]. Sociological and social movement studies [37] have been central in describing various theoretical frameworks underlying social unrest. Political science studies have helped dissect the political conditions in which riots and protests flourish and anticipate possible micro– and macro–consequences such as conflicts, regime changes, and revolutions [38]. Criminological studies have concentrated on understanding how deviant behavior can emerge in non-peaceful assemblies and in outlining related policing strategies [39, 40]. Psychological studies have helped unveil the behavioral and cognitive mechanisms occurring in individuals when engaged in collective action [41, 42].

The last decades have also witnessed the increased use of quantitative methodologies to study disorder events of various nature that have been used across disciplines and that have helped uncover consistent patterns. At the end of the 1970s, T.J. Sullivan [26] and M.I. Midlarsky [27], while belonging to distinct academic fields (social psychology and political science, respectively), highlighted “universal” features in the size distribution and dynamical evolution of crowds. M.I. Midlarsky, in particular, emerged as a strong advocate for the incorporation of quantitative frameworks within the study of collective social phenomena. In one of his seminal works, he demonstrated the presence of two underlying processes driving the urban disorders of 1966-67 in several US cities, diffusion and contagion, at a time when neither had been proven. The same empirical techniques were later applied to the study of transnational terrorism [43].

The greater availability of data in recent years has vastly improved our understanding of societal unrest and has led to refined statistical and computational approaches. Sources include law enforcement and institutional organizations, social media platforms and news agencies [4446]. Among the most investigated scenarios are the 2005 Paris riots [47, 48], the 2011 London riots [49, 50], political protests in Latin America [51] and the Arab Spring [52]. In all cases non-random behaviors were detected such as clustering processes, cascading dynamics, and self-excitability. Complementary theoretical propositions helped diagnose the causal mechanisms of the inferred patterns and include hierarchical patterns [53, 54], rational choice [50], identity theory [55].

In the spirit of expanding the extant literature on human dynamics during disorders, we focus on pandemic-related demonstrations in the three nations that exhibit the greatest number of events, India, Israel and Mexico. Although these countries vary greatly in terms of geographical, socio-political, and economic fabric, our data-driven study will show that self-excitability and clustering emerge across all three as fundamental features of pandemic-related protests and riots.

2.1 Overview of the pandemic in select countries

2.1.1 India

Currently, India is the country with the second-highest recorded number of COVID-19 cases worldwide, with more than 10 million infections, corresponding to roughly 12% of the global count [56]. The first case to be confirmed was a medical student returning from Wuhan, China to the state of Kerala who tested positive on January 30th 2020 [57]. India’s first fatality was reported on March 12th, amidst growing numbers of infections. On March 22nd, Prime Minister Narendra Modi called for a 14-hour voluntary national lockdown, which became mandatory three days later, when only essential services were allowed to remain open. On April 14th the lockdown was extended to May 3rd and on April 29th India’s death toll reached one thousand. On May 1st, the lockdown was extended for two more weeks although some flexibility was allowed, depending on the local spread of the virus. Other economic, financial and social measures were introduced as lockdown restrictions were extended through the end of May. Starting in June, containment policies were progressively eased. On August 30th, the country recorded the highest number of new cases worldwide, in excess of 78,000 [58]; this record was shattered on September 12th when India tallied more than 95,000 infections. Schools were partially reopened at the end of summer and on September 30th states and Union Territories were allowed local autonomy on certain pandemic-related matters.

Protests against the government’s management of the COVID-19 crisis have been widespread and sustained. Migrant workers unable to return home due to lockdown orders staged protests at railway stations, health workers went on strike over the lack of protective equipment and adequate pay, agricultural workers demanded payment of lockdown wages and protested the lack of aid despite government promises, students demonstrated against holding University admission exams and requested they be deferred due to infection risks and the difficulty of reaching exam centers. General strikes were organized to rally against poverty and unemployment triggered by COVID-19. On some occasions, episodes of state repression and violent enforcement of lockdown orders occurred as an attempt to quell these disorders. Long standing conflicts tied to identity politics, immigration, secessionist movements and boundary disputes have also been impacted by COVID-19. Massive protests had engulfed the country in 2019 and early 2020 in response to the Citizenship Amendment Act (CAA) which would grant citizenship rights on the basis of religion [59]. Political and separatist demonstrations, including those related to the CAA, declined following lockdown orders but reignited in June as restrictions eased, adding to pandemic-related disorders. In India 50% of the total population had internet access in 2020 [60].

2.1.2 Israel

Israel recorded its first confirmed COVID-19 case on February 21st 2020, after the return of a female citizen quarantined on the Diamond Princess in Japan [61]. Authorities soon issued a 14-day isolation policy for citizens who had visited South Korea or Japan; social distancing and related measures were imposed on March 11th, a ban on public gatherings of more than 10 people followed on March 15th. Finally, on March 19th, a state of emergency was declared and a national lockdown imposed. A contact-tracing program was approved on March 16th, allowing the Israeli Security Agency to track the mobility of individuals through mobile phone data. The program quickly sparked controversy and nationwide protests over the invasion of privacy and the overreaching surveillance of citizens. It was halted at the end of April. Additional restrictions were imposed between the end of March, in anticipation of the Passover Seder festivity on April 8th including a travel ban and the creation of a restricted zone in Bnei Brak, an ultra-Orthodox town east of Tel Aviv with one of the highest rates of coronavirus cases in the country. Restrictions were eased between the end of April and the beginning of May. Retail stores were allowed to open on April 24th; school reopenings took place between May 3rd and May 19th. In July, in response to steadily increasing “second wave” infections, the Knesset reauthorized the contact-tracing program, once more igniting civil liberties organizations; new social distancing rules were also imposed. A “traffic light” monitoring plan was announced on August 31st whereby a color representative of risk levels would be assigned to all Israeli cities [62]. Each color would be associated to more or less restrictive rules. On September 6th schools were closed and night-time curfews were imposed on forty high risk communities, including nine in Jerusalem, affecting approximately 1.3 million people. A new national lockdown was issued for September 18th, concurrent with the Jewish High Holy Days, and further restrictions announced on September 23rd. On October 18th some restrictions were lifted, with further reopenings announced throughout November 2020, although some high impacted communities remained under lockdown. Finally, a “third wave” of infections was accompanied by a third nationwide lockdown imposed on December 27th.

Protests in Israel have been common throughout the pandemic, with demonstrations against the government’s handling of the crisis, and the alleged corruption of Prime Minister Benjamin Netanyahu. After restrictions were placed to curb demonstrations, nationwide protests were held on October 3rd. Clashes with police, rock-throwing and confrontations between protesters and anti-protesters were recorded [63]. In Israel 84% of the total population had internet access in 2020 [64].

2.1.3 Mexico

On February 28th 2020, Mexico confirmed its first COVID-19 cases as three men who had traveled to Bergamo, Italy; the first COVID-19 related death was recorded on March 18th. On March 23rd President Andrès López Obrador unveiled a national campaign to promote social distancing, self-isolation, and other measures to contain the spread of the virus. On March 30th, Mexico declared a state of health emergency, suspending all nonessential activities for a month. Plans for gradual reopening were announced on May 18th, with the mayor of Mexico City presenting a blueprint for a “new normality” in the capital on May 20th. On June 1st the government imposed a traffic light monitoring plan at the state level, similar to the one described for Israel. Cases steadily increased starting from the end of May leading to overcrowded hospitals. On July 30th it was announced that governors who altered the traffic light status of their states would face criminal sanctions. Record new cases of more than 10,000 new infections were recorded on November 25th.

A few weeks into the pandemic, several media outlets began reporting that drug cartels were distributing food and medical supplies to citizens; over time criticisms mounted on government’s handling of the pandemic, the too modest spending on public heath and measures to help the economy, the many deaths in Mexico City, inadequate testing, medical personnel, waste disposal, and possible concealment of the real number of COVID-19 cases and fatalities. The president has been accused of having resisted full lockdown measures despite rising cases, to keep the economy open, drawing criticism from the WHO and the IMF. At this time of writing, Mexico is still among the most affected countries, with more than one fifth concentrated in its capital.

Labor groups have protested the government’s inadequate support of the population during the pandemic, including those who work in the informal economy; citizen groups demanded the resignation of President López Obrador for his handling of the pandemic. Other forms of pandemic-related disorders include street vendors protesting closures of their businesses, residents protesting over unsubstantiated rumors of COVID-19 inducing substances being spread by drones, against checkpoints that limited access to certain cities, and over mask-wearing.

Similarly as to India, conflicts pre-dating the pandemic were paused in the early months of COVID-19 only to later intensify. Most notably, gang violence and drug cartel battles increased during the summer, as travel restrictions were lifted and the drug trade reorganized itself to adapt to the new circumstances [65]. Mexico has also witnessed a large increase in murders and especially femicides as COVID-19 restrictions have made women more vulnerable to domestic violence [66]. Despite the pandemic, demonstrations calling for the safety of women have continued. In Mexico 71% of the total population had internet access in January 2021 [67]. Fig 1 synthetizes the most important events in the unfolding of the pandemic in India, Israel and Mexico.

Fig 1. Timeline of main COVID-19-related events in India, Israel and Mexico (January 2020-December 2020).

Fig 1

3 Materials and methods

3.1 Data

Our analyses are based on data obtained from the COVID-19 Disorder Tracker (CDT) initiative of the Armed Conflict Location & Event Data Project (ACLED) [29]. ACLED is a well-known open-source data collection organization cataloguing global crises and conflicts, created to facilitate the study of political violence and social unrest. Its recent CDT initiative records events that are directly related to COVID-19 and excludes disorders that may temporally overlap with the pandemic but that are not directly related to it, such as conflicts between armed militias over a disputed territory (see [68]). The dataset includes, for example, protests against governments in response to COVID-19 decisions, attacks against COVID-19 healthcare workers, or against individuals who may allegedly spread the virus to others. Events are labeled as one of six types: violence against civilians, riots, protests, explosions, battles, and strategic developments. We exclude the strategic development category as it lists contextually relevant episodes that are not political violence but that may trigger, lessen or explain them. These are typically tactical changes by one of the relevant actors, such a government announcing a state of emergency or the easing of lockdown restrictions. In addition to type, the dataset records date and location of the event, the subjects involved, reported fatalities. Data is collected from governmental institutions, news media, humanitarian agencies, and research publications. The database is updated every week; in this work we included events occurring between January 3rd to December 12th 2020. Within this interval, a total of 20,135 disorder events were recorded worldwide. When considering weekly averages we will consider Sunday as the first day of the week and Saturday as the last. Hence, weekly averages will be conducted over the period January 5th to December 12th 2020, yielding weeks 2 to 50 of the year 2020. Week 1 of 2020 is the period between December 29th 2019 and January 4th 2020. Since disorder events were first recorded on January 3rd 2020 we assume all prior dates in week 1 carry zero events.

Table 1 lists the ten countries with the highest number of incidents; we focus on the first three: India, Israel and Mexico. These countries alone account for almost 40% of all the events included in the CDT dataset. Fig 2 shows the distribution of event type per country. As can be seen, most are protests, with a smaller number of riots (mostly in India and to a lesser degree in Mexico), a marginal presence of violence against civilians, and an almost negligible number of battles. No explosions were recorded in any of the countries of interest, leaving only four relevant categories as detailed in the S1.1 section in S1 File.

Table 1. Distribution of disorder events (violence against civilians, riots, protests, battles) across the top 10 countries as tallied by ACLED between January 3rd and December 12th 2020.

The countries considered in this study, India, Israel and Mexico are italicized, and account for almost 40% of the world total. At this time of writing, ACLED does not report data for the US.

Country Recorded Events %
Israel 3,531 18.2
India 2,910 15.0
Mexico 1,276 6.6
Argentina 988 5.1
Brazil 920 4.7
Pakistan 588 3.0
South Korea 525 2.7
Chile 466 2.4
Peru 460 2.4
Morocco 429 2.2
Other (128 countries) 7,318 37.7

Fig 2. Event type distribution across India, Israel and Mexico as tallied from January 3rd to December 12th, 2020.

Fig 2

“Violence a.c.” stands for “Violence against civilians”. The majority of events are protests, followed in smaller percentage by riots, violence against civilians, and battles respectively. ACLED also lists explosions, which are not reported in any of the countries under investigation.

Fig 3 displays the time-series of all types of events for the countries we investigate. As can be seen, trends differ due to the different political timelines. In India, the first pandemic-related event was recorded in January 2020, but was followed by only five others over the first two months of the year. Most disorders in India occurred in April (431 events, 14.8% of the countrywide total), May (592 events, 20.3% of the countrywide total), and June (481 events, 16.5% of the countrywide total). On June 29th 123 protests were tallied nationwide, the largest number during the period of interest and corresponding to 4.2% of the total number of events in India. These protests were promoted by Congress in opposition to increasing fuel prices despite economic hardships due to the coronavirus crisis. In Israel disorders first emerged in March 2020, however the greatest number of demonstrations occurred in October (1,427 events, 40.4% of the countrywide total) and in November (1,037 events 29.4% of the countrywide total). The dramatic spikes observed in this period overlap with the lockdown orders announced at the onset of the second wave of infections; the Flag Movement promoted nationwide demonstrations. In Mexico, disorders also first appeared in March 2020. However, the distribution of events here seems to be more uniform than in India and Israel; this may be due to Mexico never having imposed a complete, countrywide lockdown. The highest recorded number of disorders in the country were tallied on March 30th (36 events) when health workers protested against the lack of medical supplies and equipment, and on April 27th (28 events) and May 25th (32 events) when citizens demanded better economic and financial aid. Overall, the most demonstrations took place in April (289 events, 22.7% of the countrywide total) and in May (275 events 21.6% of the countrywide total).

Fig 3. Time series of nationwide disorder events (protests, riots, violence against civilians, battles) in India, Israel and Mexico, from January 3rd to December 12th 2020.

Fig 3

Note the relatively more uniform distribution in Mexico, compared to the more structured ones in India and especially in Israel.

3.1.1 Spatial clustering

Spatial-temporal concentration is a well-known signature of social phenomena, including disorder events [50, 69]. To examine the spatial distribution of disorders as listed in the CDT dataset for the three countries of interest, we first identify subnational geographic areas where events colocalize. We do this by using k-means clustering, a well-known algorithm which assigns each event to one of k clusters by iteratively updating the centers of these clusters and minimizing the root-mean-square distance between the event location and its assigned cluster center [70]. The number of clusters k is a parameter for the algorithm; as it increases, the average mean distance of events from their assigned center typically decreases. However, beyond a critical threshold k*, the decrease rate may become negligible, indicating that new clusters are not distinguishable from old ones. As shown in S1.2 section in S1 File, applying k-means clustering to the CDT data for India, Israel and Mexico, yields k* = 4 as this critical threshold for all three. Henceforth, we will consider four geographical clusters per country.

3.1.2 Hawkes process

The temporal Hawkes process [32, 71, 72] models the distribution of a random time variable as a non-homogeneous Poisson process with a time-dependent intensity function λ(t) defined as

λ(t)=limh0E(N(t+h)-N(t))h. (1)

Here N(t)=i1tit is number of events up to time t. The index i labels the events so that the event time sequence {ti} defines the point process. Thus, λ(t) measures the number of events that are expected to arrive per unit time. For a homogeneous Poisson process E(N(t))=λt is proportional to time and λ(t) = λ is constant. Within non-homogeneous Hawkes processes λ(t) is typically decomposed into a background intensity μ(t), often assumed to be constant μ(t) = μ, and an excitatory component g(t) triggered at the times ti of past events so that

λ(t)=μ+ti<tg(t-ti) (2)

We model the excitatory function g(t) through an exponential decay, according to standard protocols

λ(t)=μ+ti<tαe-β(t-ti), (3)

where α and β quantify the self-excitatory degree of the process. Here, α represents a jump factor representing the rate of increase of events immediately after a triggering, prior event, while β is the associated decay rate; 1/β is often used as a proxy for the typical lifetime of an excitation. Large values of α and small values of β imply the process is highly reactive and its effects last longer, respectively [20]. The α and β parameters are learned by applying maximum likelihood estimation (MLE) to Eq 3 where {ti} is known and the μ, β, α parameters are to be determined, as described in S1.3 Section in S1 File. From α and β one can derive the branching ratio γ, an estimate of the total number of events that are endogenously generated by a single event

γ=0αe-βtdt=αβ. (4)

If one considers “immigrant” events those that occur independently within a given generation, and the ones they trigger at the next generation as their “offspring”, γ may also be interpreted as the total expected number of offsprings triggered by an immigrant event. The so-called supercritical regime γ > 1 implies that the number of offspring events is larger than the number of immigrant events that generated them, leading to the unrealistic scenario of an infinite cascade. Hence, the γ < 1 constraint is imposed in the maximum likelihood estimation. The sub-critical regime ensures that the cascade of events triggered by an original immigrant event will eventually subside. Thus, assuming γ < 1, we can also estimate the total number of offspring events N generated by a single immigrant event. If at each generation γ offspring events arise, the number of events at generation j is given by γj−1, where j = 1 represents the first, single, immigrant event. Hence the total number of offspring events is

N=j=1γj-1=11-γ. (5)

Using Eq 5 we can estimate the average number of events until time t, due to both background and excitatory events

E(N(t))μt1-γ, (6)

from which the average expected number of events per unit time can be evaluated

limtE(N(t))tμ1-γ=μ(1+γ1-γ). (7)

The last equality in Eq 7 implies that γ < 1 also represents the percent of events per unit time that are endogenously generated. We apply Eq 2 to our data, both as a baseline Poisson process (setting the self-excitability function g = 0) so that λ(t) = λ = μ and making the process Markovian, and as a Hawkes process (g ≠ 0, and as in Eq 3). To compare results, we determine the Akaike Information Criterion (AIC) values of the two models defined as

AIC=2κ-2logL (8)

where κ is the total number of parameters used (κ = 1 for a Poisson process and κ = 3 for a Hawkes process) and logL is the MLE of the model as described in S1.3 section in S1 File. By construction, the model with the lowest AIC value is the one that best fits the data.

We also employ residual analysis to validate the choice of the exponential function g in modeling the self-excitability of the process [73] Given the intensity function λ(t) of a Hawkes process and the set of event times {ti} we can derive the set of residuals {τi} defined as

τi=0tiλ(t)dt (9)

It can be shown that the {τi} residuals are independent and follow a stationary Poisson process with unit rate [73, 74]. This implies that the inter-arrival values Yi = τiτi−1, defined for i > 1 and where τ0 = 0 is imposed, define a set of independent and exponentially distributed variables. Finally, it follows that the derived quantities Ui=1eYi are also independent and uniformly distributed. To test the goodness of fit of the Hawkes process we can thus verify whether the 0 ≤ Ui < 1 values are indeed uniformly distributed. Operationally, we employ the two-tailed Kolmogorov-Smirnov (KS) test, a common non-parametric test that determines whether a set of given observations (in this case {Ui}) come from a known distribution (in this case the uniform distribution between 0 and 1) [75]. The test compares the value of the statistic D

D=max[(maxi|Ui-i-1U|),(maxi|Ui-iU|)], (10)

to a given critical value Dc. In Eq 10, U is the cardinality of the {Ui} set, which is the number of observations and same as the cardinality of the {Yi} and {τi} sets. If D > Dc, then the hypothesis that the {Ui} values follow a uniform distribution, and hence that the {ti} values define a Hawkes-like point process, can be rejected at the α level of significance. We apply the KS test to our data at the 95% Dα=1.36/U, α = 0.05) and at the 99% (Dα=1.36/U), α = 0.01) confidence levels. Other tabulated values for Dc and different confidence levels can be used [76].

4 Results

4.1 India

The four spatial clusters we identified in India are visualized in Fig 4; for the most part they follow geographical and/or topographical divisions within the country. Cluster 1 (C1), which includes the northern states of Himachal Pradesh, Rajasthan, Haryana, Uttar Pradesh, Uttarkhand, and the Union territories of Jammu and Kashmir and Ladakh, accounts for a total of 913 events. Cluster 2 (C2) is associated with the highest number of events overall, 946, and covers the eastern states of Arunachal Pradesh, Assam, Bihar, Jharkhand, and Odisha. The third cluster (C3) groups 436 in the central and western states of Maharashtra, Gujarat, and Madhya Pradesh. Finally, Cluster 4 (C4) accounts for a total of 568 events in the southern states, including Kerala, Tamil Nadu, Andhra Pradesh, Karnataka, and Telangana.

Fig 4. COVID-19 disorder events in India.

Fig 4

The four detected clusters, C1-C4, host approximately equal numbers of residents, with a maximum of about 27% of the total population in C1 and a minimum of about 18% in C2. Clusters however are very heterogeneous in terms of population density and territorial extent. Two of the most densely inhabited states in the area, Uttar Pradesh and Bihar, are located in C1 and C2, respectively. This map has been generated via rnaturalearth in R, a package built using Natural Earth map data.

Fig 5 displays the number of events nj occurring during week j in each of the C1-C4 clusters. For all clusters we observe the first spiking of events around week j = 13 and j = 14 (between March 22nd and April 4th 2020) followed by a second period of intensifying activity around week j = 27 (between June 28th and July 4th), although the relative magnitude of events are cluster-dependent. Cluster-wise event distributions for India are also visualized in box plots in S1.4.1 section in S1 File.

Fig 5. Weekly time series of disorder events {nj} visualized by cluster, in India.

Fig 5

Weeks are marked from week j = 1 (December 29th 2019 to January 4th 2020) to week j = 50 (December 6th to December 12th 2020).

The left panel of Fig 6 displays Pearson’s correlation coefficient r for the weekly number of events {nj} between pairs of clusters. This quantity ranges from r = 0.595 between C2 and C3 to r = 0.724 between C1 and C3, showing relative synchrony among clusters. Starting from {nj} we can also construct the first-order difference sequence {Δnj} where Δnj = njnj−1, and investigate how differences in weekly counts correlate between clusters. The right panel of Fig 6 shows that when using {Δnj} the positive association between clusters lowers significantly compared to when {nj} is used, but remains significant in some clusters indicating partial national synchrony. Specifically, C3 and C4 carry the highest correlation value, r = 0.512, whereas the weakest relationship is between C1 and C2, for which r = 0.124. Noteworthy is the relationship between C1 and C3, which has the highest r relative to {nj} counts and the second-lowest r relative to {Δnj} counts. Numerical values are listed in S1.5.1 subsection in S1 File.

Fig 6. Cluster dynamics in India: (left) Pearson’s correlation of weekly eventsnj across pairs of clusters.

Fig 6

(right) Pearson’s correlation of differentiated weekly events Δnj = njnj−1. The color scale is restricted to positive values as as no negative relationships are found. The left panel reveals a substantial level of correlation, however, when first-order differences are considered all coefficients decrease, implying that the rate of change in the occurrence of events is less correlated.

Finally, in Table 2 we list statistical outcomes pertaining to the India disorders, where we tally events daily. Here, the Hawkes process with an exponential excitatory term g always leads to lower AIC values compared to the baseline Poisson process, indicating a considerable degree of self-excitability and temporal dependence in the data. All cases considered (national and subnational Hawkes processes) passed the KS test, as can be verified by the D values being lower than the critical KS value in Table 2. We tally 2,910 countrywide disorders, which if treated as a Hawkes process on the national scale, lead to a background rate of μ = 0.5 events per day with self-excitatory events arising at a rate of α = 2.07 events per day, spanning over 1/β = 0.46 days. These values lead to a branching ratio γ = α/β = 0.95, revealing that a large percentage of disorder events are due to feedback mechanisms.

Table 2. Statistical outcomes of the Hawkes process applied to data from India.

The Hawkes process outperforms the baseline Poisson process both nationwide and in each cluster, since the Hawkes AIC is always less than the Poisson AIC. The Hawkes process passes the KS test at the 95% significance level in all cases, with D<Dc95.

Cluster India (all) India (C1) India (C2) India (C3) India (C4)
Number of events 2,910 913 993 436 568
μ 0.497 0.611 0.368 0.173 0.322
α 2.073 1.529 1.400 0.569 0.712
β 2.192 1.928 1.586 0.646 0.854
γ 0.946 0.793 0.882 0.881 0.834
μ/(1 − γ) 9.15 2.95 3.13 1.44 1.93
Hawkes AIC -9298 -768 -1178 286 23
Poisson AIC -6983 -144 -261 579 403
KS Stat, D 0.049 0.051 0.084 0.125 0.063
KS Crit 95%, Dc95 0.112 0.098 0.127 0.205 0.142
KS Crit 99%, Dc99 0.135 0.118 0.152 0.245 0.170

On the more local level, C1 and C2, the clusters with the largest number of events, display similar self-excitatory trends compared to C3 and C4. As can be seen from Table 2 values of α are larger in C1 and C2 (α = 1.52 and 1.40 events per day, respectively) than in C3 and C4 (α = 0.57 and 0.71 events per day, respectively) however the associated timescales 1/β are less than one day in C1 and C2 (1/β = 0.5 and 0.6 days, respectively), smaller compared to those observed for C3 and C4 (1/β = 1.54 and 1.2 days, respectively). These results suggest that C1 and C2 are marked by more intense, yet more quickly damped feedback activity than C3 and C4. The two opposite trends lead to relatively uniform branching ratios across clusters with γ ranging from γ = 0.88 (C2) to γ = 0.79 (C1). Of particular interest is C3, the most sparse cluster, as can be seen in Fig 4). This cluster also carries the least number of events (436) and displays the lowest reactivity yet, it displays the longest timescale, leading to a very large branching ratio γ = 0.88. These results suggest that although disorder events are rarer in C3, feedback effects are very strong and echoes of disorder persist the longest. Finally, the background intensity μ is highest in C1 (μ = 0.61 events per day) and smallest in C3 (μ = 0.17 events per day). Overall, one may expect the emergence of roughly 9 events per day countrywide, with a high likelihood of events being self-excited; disaggregating trends within the separate clusters shows that most of these events are to be expected in C2 and C1, and to a lesser degree in C4 and C3. While C3 contributes less than others to the expected daily disorder count, the degree of self-excitation is strong. Interestingly, C1 and C2 are also the clusters that according to the 2011 Census of India, host the states with the most dense population: Uttar Pradesh in C1 (200 million residents, and a density of 828 persons per km2) and Bihar in C3 (105 million residents, and a density of 1,102 persons per km2).

4.2 Israel

We apply similar procedures for disorder events in Israel, leading to the four clusters displayed in Fig 7. Cluster 1 (C1) groups 792 events occurring in the greater Jerusalem area and in proximity of the Gaza strip; the second cluster (C2) is located in the southern part of the country, at the border with Jordan and only counts 220 events. The third cluster (C3) is centered around Tel Aviv, on the western coast and contains 1073 events. Finally, cluster C4 is located in the Haifa region, in the northern part of the country, and contains the most number of events, 1446.

Fig 7. COVID-19 disorder events in Israel.

Fig 7

Clusters C1, C3, C4 host the most densely populated areas located around the cities of Haifa, Tel Aviv and Jerusalem, respectively, Events in cluster C2, the least dense region, are the most sparse and emerge mostly at the border with Jordan. This map has been generated via rnaturalearth in R, a package built using Natural Earth map data.

Fig 8 shows the temporal dynamics across the four clusters in Israel. From a temporal distribution standpoint, the overall picture is instead sensibly different from what observed in India. Besides scattered events recorded in early 2020, most weekly events nj are concentrated between week j = 37 (September 6th to September 12th) and week j = 50 (December 6th to December 12th), concurrent with nationwide protests organized by the Flag Movement against the alleged corruption of Prime Minister Nethanyahu and his failures in managing the pandemic Cluster-wise event distributions for Israel are also visualized in box plots in S1.4.2 section in S1 File.

Fig 8. Weekly time series of disorder events {nj} visualized by cluster, in Israel.

Fig 8

Weeks are marked from week j = 1 (December 29th 2019 to January 4th 2020) to week j = 50 (December 6th to December 12th 2020).

The Pearson’s correlation coefficients r comparing weekly {nj} events between pairs of clusters are shown in Fig 9 and reveal strong homogeneous, positive synchrony Values range between r = 0.995 (between C2 and C3, and C2 and C4) and r = 0.999 (between C3 and C4). Similarly strong, positive relationships persist when considering the first order difference sequence {Δnj}. This finding underscores that even when considering increasing or decreasing trends, clusters are tightly aligned, indicating nation-wide synchrony. The fact that this feature emerges with so much clarity in Israel compared to India may be a consequence of its much smaller territorial extent, a more linguistically homogenous population, and/or larger access to broadband internet, but also the result of the Flag Movement’s nation-wide campaigns. Numerical values are listed in S1.5.2 subsection in S1 File.

Fig 9. Cluster dynamics in Israel: (left) Pearson’s correlation of weekly events nj across pairs of clusters.

Fig 9

(right) Pearson’s correlation of differentiated weekly events Δnj = njnj−1 across pairs of clusters. The left panel shows almost perfect correlation between weekly-based streams of events for all cluster pairs. The synchrony remains almost perfect when considering first-order differences in the right. The nationwide correlation that is much more visible than in India or Mexico may be due to Israel’s more compact geographical extension, linguistic unity, tighter virtual connectivity, and/or due to the nationwide engagement of the Flag movement. Note that correlation coefficients between clusters in Israel are very large (r ≥ 0.95 in all cases) compared to those computed for India (and Mexico). Thus, if we kept the same scale as in Figs 6 and 12 (-1 ≤ r ≤ 1) the correlation plots for Israel would be colored uniformly. Instead, for a more nuanced view we use instead a more restricted scale (0.95 ≤ r ≤ 1).

Table 3 lists all statistical quantities derived from fitting the Hawkes process to the tabulated disorder events in Israel. As observed for India, the Hawkes process always outperforms the baseline Poisson process in terms of AIC values. However, the D statistic derived from the KS analysis is higher than the critical Dα both at the 95% and at the 99% confidence levels, indicating that more appropriate time-dependent point processes should be used to describe the data. For example, the extreme clustering that characterizes events in C4 might be better represented by more rapidly decaying forms than the exponential decay g(t). From Table 3 we also observe that the 3,531 countrywide events can be described by a Hawkes process with a decaying exponential function g where α = 23.53 events per day, lasting 1/β = 0.45 days. These values correspond to a branching ratio γ = 0.97 and indicate that disorders cause strong feedback of short duration. This is confirmed by Fig 3 where we observe a very high concentration of events occurring over a limited timeframe. Clusters C1, C3 and C4 display relatively similar trends: the background rate μ varies between μ = 0.151 (C4) and μ = 0.265 (C1) events per day, whereas γ ranges from γ = 0.92 (C1) to γ = 0.97 (C4), indicating relatively low background rates but sustained feedback. Conversely, C2 reports the largest background rate among all clusters with μ = 0.59 events per day, the lowest reactivity with α = 4.82 events per day and the largest lifetime 1/β = 0.15 days, which combine to yield the lowest branching ratio γ = 0.76 of all clusters. On average, the total number of disorders expected in Israel is μ/(1 − γ) = 13.8 events per day, arising in descending order in C3, C1 and C2. However, the contribution of C4 cannot be determined since the Hawkes process may not be the most adequate representation of the local point process distribution in this cluster.

Table 3. Statistical outcomes of the Hawkes process applied to data from Israel.

The Hawkes process outperforms the baseline Poisson process both nationwide and in each cluster, since the Hawkes AIC is always less than the Poisson AIC. The Hawkes process passes the KS test at the 95% significance level in all cases except for C4, where D>Dc99, indicating that the hypothesis that the data can be fit to a Hawkes process with a decaying exponential should not be accepted. Given the nature of the data, a more steeply decaying function than the decaying exponential should be used in C4.

Cluster Israel (all) Israel (C1) Israel (C2) Israel (C3) Israel (C4)
Number of events 3,531 792 220 1,073 1,446
μ 0.390 0.265 0.590 0.236 0.151
α 23.528 9.894 4.822 12.386 15.306
β 24.212 10.812 6.310 13.118 15.717
γ 0.972 0.915 0.764 0.944 0.974
μ/(1 − γ) 13.79 3.12 2.50 4.21 5.79
Hawkes AIC -25047 -2655 -145 -4588 -7649†
Poisson AIC 10988 -149 58 -805 -1917
KS Stat, D 0.098 0.157 0.134 0.156 0.274
KS Crit 95%, Dc95 0.127 0.160 0.190 0.168 0.212
KS Crit 99%, Dc99 0.153 0.192 0.228 0.202 0.254

4.3 Mexico

As for India and Israel, the clustering process yields four clusters in Mexico; they are shown in Fig 10. Two of them exhibit a sparse nature, with events distributed in a less dense manner compared to the other two. The first cluster (C1) only contains 139 events that however are spatially concentrated. This cluster covers the southern part of the country, and includes the states of Chiapas, Veracruz, Campeche, Yucatan, and Quintana Roo. The second cluster (C2) contains a total of 270 events, mainly located in the states of Durango, Tamaulipas, Nuevo Leon, and Nayarit. Cluster C3 is the least populated, tallying only 101 events that are spread across the Northern states, particularly Baja California Sur, Baja California, Sonora, Sinaloa, and Chihuahua. As can be seen, the vast majority of events (766) are located in C4, which accounts for 60% of total disorders. C4 contains Mexico City, the country’s capital, as well as the states of Oaxaca, Puebla, Queretaro, Guanajuato, Michoacan, and Mexico state.

Fig 10. COVID-19 disorder events in Mexico.

Fig 10

Of all clusters, C4 carries the largest population as it includes the capital city and the state of Mexico. The two are respectively the most populated city and state in the country. The state of Mexico is also the most dense nationwide. This map has been generated via rnaturalearth in R, a package built using Natural Earth map data.

Fig 11 displays cluster trends at the weekly level. Contrary to what observed for India and Israel, disorder events have mostly persisted throughout the COVID-19 crisis: in Mexico there have been no major interruptions of protests, riots or violence against civilians since the onset of the pandemic. This may be due to the government never having imposed a complete lockdown in the country. However, the alignment in peaks of disorder activity across clusters is weak, and much less pronounced than in India or Israel. For instance, while C4 (the cluster that records the majority of events) shows sustained activity on weeks j = 14 (March 29th to April 4th), j = 16 (April 12th to April 18th), and j = 18 (April 26th to May 2nd), similar trends are not detected in the other clusters. For example, in neighboring C2, activity spikes in week j = 19 (May 3rd to May 9th). Cluster-wise event distributions for Mexico are also visualized in box plots in S1.4.3 section in S1 File.

Fig 11. Weekly time series of disorder events {nj} visualized by cluster, in Mexico.

Fig 11

Weeks are marked from week j = 1 (December 29th 2019 to January 4th 2020) to week j = 50 (December 6th to December 12th 2020).

The Pearson’s correlation coefficients r for Mexico and its four clusters are shown in Fig 12. Calculations relative to the weekly {nj} events reveal some alignment between clusters, specially between C2 and C4 (r = 0.826), and to a lesser degree between C3 and C4 (r = 0.772). However, after computing the correlation coefficient relative to the first order difference sequence {Δnj}, these relationships become much weaker: all positive correlations between weekly counts are reduced, C3 and C4 display low correlation (r = 0.286) and the value of the coefficients between C1 and C2 (r = −0.092) and C2 and C3 (r = −0.445) become negative. Numerical values are listed in S1.5.3 subsection in S1 File.

Fig 12. Cluster dynamics in Mexico: (left) Pearson’s correlation of weekly events nj across pairs of clusters.

Fig 12

(right) Pearson’s correlation of differentiated weekly events Δnj = njnj−1. The left panel shows a high level of correlation between clusters; however, contrary to what observed in India and Israel, dramatic decreases are observed when computing coefficients between first order differences implying a low level of synchrony in the rate of change of events.

The statistical results obtained from applying the Hawkes model to Mexico are listed in Table 4. As for India and Israel, the Hawkes process yields better outcomes than the baseline Poisson process in modeling disorder events related to the COVID-19 pandemic, both nationwide and at the cluster level. Furthermore, all models fitted with data on Mexico passed the KS test as well, testifying to the goodness of fit provided by the specific Hawkes formalization of a self-excitability process. We identify an underlying temporal-dependence among events even in the case of C3, the cluster with least number of events. Countrywide, the 1, 276 events yield a Hawkes process marked by reactivity α = 2.29 events per day, with a relatively short lifetime of 1/β = 0.41 days. The branching ratio is γ = 0.79, indicating a considerable amount of self-excitability, although much less than what observed in India and Israel. Among the various clusters, the greatest reactivity is observed in C4 with α = 1.66, decreasing in other clusters until a minimum of α = 0.10 events per day is reached in C3; C1 is also the cluster where the longest lifetime of self-excitatory phenomena is observed, with 1/β = 6.88 days whereas the shortest is in C4 where 1/β = 0.44 days. Overall, the cluster values of α, β yield sensibly lower values of γ compared to India and Israel, ranging from γ = 0.54 (C2) to γ = 0.73 (C4) and confirming the nationwide trend. The background rate μ ranges from μ = 0.774 (C4) to μ = 0.121 (C3) events per day. Combined, these results imply that nationwide one can expect a total of μ/(1 − γ) = 4.77 events per day, of which the most (2.86) will occur in C4, and the least (0.39) in C3.

Table 4. Statistical outcomes of the Hawkes process applied to data from Mexico.

The Hawkes process outperforms the baseline Poisson process both nationwide and in each cluster, since the Hawkes AIC is always less than the Poisson AIC. The Hawkes process passes the KS test at the 95% significance level in all cases, with D<Dc95.

Cluster Mexico (all) Mexico (C1) Mexico (C2) Mexico (C3) Mexico (C4)
Number of Events 1,276 139 270 101 766
μ 0.996 0.217 0.469 0.121 0.774
α 1.931 0.446 1.086 0.101 1.660
β 2.440 0.728 2.009 0.145 2.274
γ 0.791 0.612 0.541 0.693 0.730
μ/(1 − γ) 4.77 0.55 1.02 0.39 2.86
Hawkes AIC -2201 382 413 377 -526
Poisson AIC -1424 445 532 401 -69
KS Stat, D 0.047 0.092 0.076 0.098 0.063
KS Crit 95%, Dc95 0.082 0.275 0.123 0.233 0.092
KS Crit 99%, Dc99 0.098 0.330 0.147 0.279 0.111

5 Discussion and conclusion

We studied COVID-19 disorder events by using a public database compiled by the CDT initiative promoted by ACLED, the most reliable and complete source of data on conflicts and disorder patterns worldwide. Specifically, we analyzed the spatio-temporal distributions and characteristics of demonstrations in the three countries with the highest number of events i.e., India, Israel, and Mexico between January 3rd and December 12th 2020. Using the well known Hawkes point process we investigated whether self-exciting effects could arise across events. We first considered countrywide data and later identified distinct geographical clusters in each of the three countries, to investigate trends on the more local level. Our intent was to better understand the macro- and meso-scale mechanisms that govern disorder events occurring in the same general context (the pandemic) but that may be ignited, shaped, acerbated or placated by more local happenings. Our work is in line with other empirical studies related to social tension, nucleated by the seminal work of M. I. Midlarsky [27] and that include analyses of the 2011 London riots [40, 50], and of the 2005 Paris riots [48].

We identified four geographical clusters in each of the the countries we investigated by employing k-means clustering, These hosted varying numbers of events, were of varying spatial extent, and mostly followed clear geographical separations. We observed self-excitatory effects in all countries and in almost all subnational clusters, and found that the time-dependent Hawkes process is always a better fit to the disorder data than a simple Poisson process. We also performed several robustness checks, such as modifying the random number generator, or considering shorter time windows (see S1.6 section in S1 File); the number of clusters, and the applicability of the Hawkes process persisted in all cases. These results show that temporal dependence and self-excitability at the national level are not the result of the superimposition of unstructured, random processes at the subnational level. Instead, disorder events naturally cluster already at the local level, regardless of cluster size, and country examined.

However, while the temporal dependency between events, a hallmark of the Hawkes process, represents a common feature of protests, riots, and similar events related to the COVID-19 pandemic, important differences in the magnitude of these dependencies arise both intra- and inter-country. The three parameters that define the conditional intensity function of the Hawkes processes, i.e. the background rate μ, the reactivity α, the decay rate β, as well as other derived quantities such as the branching ratio γ and the average expected intensity E[λ(t)], report a wide heterogeneity. This may be due to local infectivity trends, local decision-making, and how the pandemic and the associated measures impacted local calendars of religious or public holidays.

The distribution of disorder events in Mexico for instance, does not display large variations between March and October 2020; in India, although the frequency of disorders has always remained relatively large starting in April 2020, major spikes emerged in May 2020 and between June and July 2020. Israel, finally, displays an even more extreme situation: a handful of events were recorded in March 2020, but intense protesting occurred between September and October 2020. As a result of the relatively homogenous temporal trend, Mexico is associated with the largest background intensity μ; reactivity α on the other hand is largest in Israel, the country which also displays the shortest duration of an excitation β−1. In Israel, the influence of an event lasts for β−1 = 0.04 days, ten times less than in India and Mexico where β−1 = 0.46 and β−1 = 0.41 days, respectively, The more homogeneous course of events in Mexico is also manifest in the lowest branching factor, γ = 0.791, compared to India and Israel (γ = 0.946, γ = 0.972), implying that the probability that an event is endogenously generated as a consequence of another event is lowest in Mexico. Among the social and political events driving these patterns are the lack of a complete lockdown in Mexico, large scale protests in Israel as organized by the Flag Movement, the more compact geography and stronger internet connectivity in Israel compared to Mexico and India, which are also more linguistically and culturally heterogeneous. In all cases, the highest reactivity α emerges at the national scale, conversely, the average number of days upon which events may excite others is always highest in subnational clusters. Correlating the number of events with specific cluster demographic or geographical characteristics is outside the scope of this paper. However, regions with large numbers of pandemic-related events are often, but not always, characterized by large populations and/or large population densities. One notable exception is Jammu-Kashmir, a region in India marked by a relatively large number of events that is not among the country’s most populous, nor most dense areas. Similarly, while the greater Jerusalem area is among the most densely inhabited in Israel, relatively few disorder events have been recorded here. These findings underly the need to consider the intersectionality of many demographic, socioeconomic, political and/or religious factors when trying to understand why some clusters display more events than others.

Our work comes with some limitations. First, a more systematic approach to assess temporal dependence and self-excitability on the global scale is needed, especially considering the risk of prolonged restrictive measures during national vaccination campaigns. Although India, Israel, and Mexico report the highest number of disorders, they represent a small fraction of the countries in which disorders have occurred. Evaluating whether temporal clustering is a universal characteristic would help advance our knowledge on human behavior under prolonged periods of duress, and under greater social and cultural diversity. Furthermore, we did not distinguish events based upon their nature (e.g., protests vs. violence against civilians), motives (e.g., protests against restrictions imposed by the government vs. protests against the lack of supplies for health care workers; or participant type (migrant workers vs. students). As mentioned, the vast majority of events in India, Israel and Mexico, have been peaceful protests, however the dataset we utilized did not allow for a clear stratification of motives or participant type. Disentangling the distinct mechanisms that trigger self-excitability based on the qualitative features of the event themselves and the demands participants carry, would greatly add to our understanding of how social unrest unfolds.

Notwithstanding, our work shows that analyzing disorders at the national and subnational scales is useful. A national focus allows us to understand higher-level dynamics that transcend physical distances, especially in the current era of unprecedentedly fast information (and disinformation) spread. Social-media and other forms of long-distance connectivity can facilitate the dissemination of government decisions but also help large scale planning of nationwide or even international disorders. Understanding subnational dynamics allows for a more nuanced picture as local streams of protests may be ignited by more local issues. The global nature of the pandemic does not imply that its impacts are homogeneously distributed; to the contrary, existing socio-economic contexts lead to heterogeneous responses to the unfolding and management of the crisis. Decisions taken may resonate differently in different communities, which may be more or less concerned with the restriction of individual freedoms, being able to provide for one’s livelihood, or prevent authoritarianism, and this may lead to localized waves of disorders, with a diverse composition of participants. Finally, our work underscores the need to align citizen trust with governmental decisions, especially at the local level, so that the implementation of restrictions and other public health measures are perceived to be temporary and in the interest of the common good, and that appropriate supporting policies are promoted to ensure the least economic disruption and uncertainty.

Supporting information

S1 File

(PDF)

Data Availability

The original dataset is freely and openly available to anyone at the ACLED dedicated website: https://acleddata.com/analysis/covid-19-disorder-tracker/. The processed datasets and code utilized in this paper are available at: https://github.com/gcampede/covid19-protests.

Funding Statement

MRD acknowledges support from the Army Research Office (W911NF-18-1-0345) (url: https://www.arl.army.mil/), and the National Science Foundation (DMS-1814090). (Url: https://www.nsf.gov/) The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1. Hilsenrath P, Borders T. Ethics and economics of the COVID-19 pandemic in the United States. Health Services Research and Managerial Epidemiology. 2020;7:1–3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2. Brady RR, Insler M, Rothert J. The Fragmented United States of America: The Impact of Scattered Lock-Down Policies on Country-Wide Infections. Rochester, NY: Social Science Research Network; 2020. ID 3681486. Available from: https://papers.ssrn.com/abstract=3681486. [Google Scholar]
  • 3. Mills MC, Salisbury D. The challenges of distributing COVID-19 vaccinations. EClinicalMedicine. 2021;31. 10.1016/j.eclinm.2020.100674 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Muriel JJ, Bauchner H. Vaccine Distribution—Equity Left Behind? JAMA. 2021; 10.1001/jama.2021.1205 [DOI] [PubMed] [Google Scholar]
  • 5. Alfano V, Ercolano S. The Efficacy of Lockdown Against COVID-19: A Cross-Country Panel Analysis. Applied Health Economics and Health Policy. 2020;18(4):509–517. 10.1007/s40258-020-00596-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6. Delen D, Eryarsoy E, Davazdahemami B. No Place Like Home: Cross-National Data Analysis of the Efficacy of Social Distancing During the COVID-19 Pandemic. JMIR Public Health and Surveillance. 2020;6(2):e19862. 10.2196/19862 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Wellenius GA, Vispute S, Espinosa V, Fabrikant A, Tsai TC, Hennessy J, et al. Impacts of US State-Level Social Distancing Policies on Population Mobility and COVID-19 Case Growth During the First Wave of the Pandemic. arXiv:200410172 [q-bio]. 2020;.
  • 8. Patel JA, Nielsen FBH, Badiani AA, Assi S, Unadkat VA, Patel B, et al. Poverty, inequality and COVID-19: The forgotten vulnerable. Public Health. 2020;183:110–111. 10.1016/j.puhe.2020.05.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9. van Dorn A, Cooney RE, Sabin ML. COVID-19 exacerbating inequalities in the US. The Lancet. 2020;395:1243–1244. 10.1016/S0140-6736(20)30893-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10. Galea S, Abdalla SM. COVID-19 pandemic, unemployment, and civil unrest: Underlying deep racial and socioeconomic divides. Journal of the American Medical Association. 2020;324:227. 10.1001/jama.2020.11132 [DOI] [PubMed] [Google Scholar]
  • 11. Sibley CG, Greaves LM, Satherley N, Wilson MS, Overall NC, Lee CHJ, et al. Effects of the COVID-19 pandemic and nationwide lockdown on trust, attitudes toward government, and well-being. American Psychologist. 2020;75:618–630. 10.1037/amp0000662 [DOI] [PubMed] [Google Scholar]
  • 12. Gao J, Zheng P, Jia Y, Chen H, Mao Y, Chen S, et al. Mental health problems and social media exposure during COVID-19 outbreak. PLoS One. 2020;15:e0231924. 10.1371/journal.pone.0231924 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13. Al-Dmour H, Masa’deh R, Salman A, Abuhashesh M, Al-Dmour R. Influence of Social Media Platforms on Public Health Protection Against the COVID-19 Pandemic via the Mediating Effects of Public Health Awareness and Behavioral Changes: Integrated Model. Journal of Medical Internet Research. 2020;22(8):e19996. 10.2196/19996 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14. Chen Q, Min C, Zhang W, Wang G, Ma X, Evans R. Unpacking the black box: How to promote citizen engagement through government social media during the COVID-19 crisis. Computers in Human Behavior. 2020;110:106380. 10.1016/j.chb.2020.106380 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15. Pennycook G, McPhetres J, Zhang Y, Lu JG, Rand DG. Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention. Psychological Science. 2020;31(7):770–780. 10.1177/0956797620939054 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16. Tasnim S, Hossain MM, Mazumder H. Impact of Rumors and Misinformation on COVID-19 in Social Media. Journal of Preventive Medicine and Public Health. 2020;53(3):171–174. 10.3961/jpmph.20.094 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17. Kouzy R, Abi Jaoude J, Kraitem A, El Alam MB, Karam B, Adib E, et al. Coronavirus Goes Viral: Quantifying the COVID-19 Misinformation Epidemic on Twitter. Cureus. 2020;12(3). 10.7759/cureus.7255 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Short MB, D’Orsogna MR, Brantingham PJ, Tita GE. Measuring and modeling repeat and near-repeat burglary effects. Journal of Quantitative Criminology. 2009;25:325–339. 10.1007/s10940-009-9068-8 [DOI] [Google Scholar]
  • 19. King RD, Sutton GM. High times for hate crimes: Explaining the temporal clustering of hate-motivated offending. Criminology. 2013;51:871–894. 10.1111/1745-9125.12022 [DOI] [Google Scholar]
  • 20. Lewis E, Mohler G, Brantingham PJ, Bertozzi AL. Self-exciting point process models of civilian deaths in Iraq. Security Journal. 2012;25:244–264. 10.1057/sj.2011.21 [DOI] [Google Scholar]
  • 21. Chuang YL, Ben-Asher N, D’Orsogna MR. Local alliances and rivalries shape near-repeat terror activity of al-Qaeda, ISIS, and insurgents. Proceedings of the National Academy of Sciences. 2019;116:20898–20903. 10.1073/pnas.1904418116 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22. Simmons BA, Elkins Z. The globalization of liberalization: Policy diffusion in the international political economy. American Political Science Review. 2004;98:171–189. 10.1017/S0003055404001078 [DOI] [Google Scholar]
  • 23. Houle C, Kayser MA, Xiang J. Diffusion or confusion? Clustered shocks and the conditional diffusion of democracy. International Organization. 2016;70:687–726. 10.1017/S002081831600028X [DOI] [Google Scholar]
  • 24. Buhaug H, Gleditsch KS. Contagion or confusion? Why conflicts cluster in space. International Studies Quarterly. 2008;52:215–233. 10.1111/j.1468-2478.2008.00499.x [DOI] [Google Scholar]
  • 25. Schutte S, Weidmann NB. Diffusion patterns of violence in civil wars. Political Geography. 2011;30:143–152. 10.1016/j.polgeo.2011.03.005 [DOI] [Google Scholar]
  • 26. Sullivan TJ. The critical mass in crowd behavior: Crowd size, contagion and the evolution of riots. Humboldt Journal of Social Relations. 1977;4:46–59. [Google Scholar]
  • 27. Midlarsky MI. Analyzing diffusion and contagion effects: The urban disorders of the 1960s. The American Political Science Review. 1978;72:996–1008. 10.2307/1955117 [DOI] [Google Scholar]
  • 28. Myers DJ. The diffusion of collective violence: Infectiousness, susceptibility, and mass media networks. American Journal of Sociology. 2000;106:173–208. 10.1086/303110 [DOI] [Google Scholar]
  • 29.ACLED. COVID-19 Disorder Tracker; 2020. Available from: https://acleddata.com/analysis/covid-19-disorder-tracker/.
  • 30. Raleigh C, Linke A, Hegre H, Karlsen J. Introducing ACLED: An armed conflict location and event dataset: Special data feature. Journal of Peace Research. 2010;47:651–660. 10.1177/0022343310378914 [DOI] [Google Scholar]
  • 31. Geschwender JA. Civil rights protest and riots: A disappearing distinction. Social Science Quarterly. 1968;49:474–484. [Google Scholar]
  • 32. Hawkes AG. Spectra of some self-exciting and mutually exciting point processes. Biometrika. 1971;58:83–90. 10.1093/biomet/58.1.83 [DOI] [Google Scholar]
  • 33. Tench S, Fry H, Gill P. Spatio-temporal patterns of IED usage by the Provisional Irish Republican Army. European Journal of Applied Mathematics. 2016;27:377–402. 10.1017/S0956792515000686 [DOI] [Google Scholar]
  • 34. Loeffler C, Flaxman S. Is Gun Violence Contagious? A Spatiotemporal Test. Journal of Quantitative Criminology. 2018;34(4):999–1017. 10.1007/s10940-017-9363-8 [DOI] [Google Scholar]
  • 35. Brantingham PJ, Yuan B, Herz D. Is Gang Violent Crime More Contagious than Non-Gang Violent Crime? Journal of Quantitative Criminology. 2020;. 10.1007/s10940-020-09479-1 [DOI] [Google Scholar]
  • 36. Clement M. A people’s history of riots, protest and the law. London, UK: Palgrave Macmillan UK; 2016. [Google Scholar]
  • 37. Della Porta D, Diani M. Social movements: An introduction. John Wiley & Sons; 2020. [Google Scholar]
  • 38. Hale HE. Regime change cascades: What we have learned from the 1848 revolutions to the 2011 Arab uprisings. Annual Review of Political Science. 2013;16:331–353. 10.1146/annurev-polisci-032211-212204 [DOI] [Google Scholar]
  • 39. Greer C, McLaughlin E. We predict a riot? Public order policing, new media environments and the rise of the citizen journalist. The British Journal of Criminology. 2010;50:1041–1059. 10.1093/bjc/azq039 [DOI] [Google Scholar]
  • 40. Baudains P, Johnson SD, Braithwaite AM. Geographic patterns of diffusion in the 2011 London riots. Applied Geography. 2013;45:211–219. 10.1016/j.apgeog.2013.09.010 [DOI] [Google Scholar]
  • 41. Thomas EF, Louis WR. When will collective action be effective? Violent and non-violent protests differentially influence perceptions of legitimacy and efficacy among sympathizers. Personality and Social Psychology Bulletin. 2014;40:263–276. 10.1177/0146167213510525 [DOI] [PubMed] [Google Scholar]
  • 42. Drury J, Stott C, Ball R, Reicher S, Neville F, Bell L, et al. A social identity model of riot diffusion: From injustice to empowerment in the 2011 London riots. European Journal of Social Psychology. 2020;50:646–661. 10.1002/ejsp.2650 [DOI] [Google Scholar]
  • 43. Midlarsky MI, Crenshaw M, Yoshida F. Why violence spreads: The contagion of international terrorism. International Studies Quarterly. 1980;24:262–298. 10.2307/2600202 [DOI] [Google Scholar]
  • 44. Poell T. Social media and the transformation of activist communication: exploring the social media ecology of the 2010 Toronto G20 protests. Information, Communication and Society. 2014;17:716–731. 10.1080/1369118X.2013.812674 [DOI] [Google Scholar]
  • 45. Trottier D, Fuchs C. Social media, politics and the state: Protests, revolutions, riots, crime and policing in the age of Facebook, Twitter and YouTube. New York, NY: Routledge; 2014. [Google Scholar]
  • 46. Jost JT, Barberá P, Bonneau R, Langer M, Metzger M, Nagler J, et al. How social media facilitates political protest: Information, motivation, and social networks. Political Psychology. 2018;39:85–118. 10.1111/pops.12478 [DOI] [Google Scholar]
  • 47. Berestycki H, Nadal JP, Rodriguez N. A model of riots dynamics: Shocks, diffusion and thresholds. Networks and Heterogeneous Media. 2015;10:443–475. 10.3934/nhm.2015.10.443 [DOI] [Google Scholar]
  • 48. Bonnasse-Gahot L, Berestycki H, Depuiset MA, Gordon MB, Roché S, Rodriguez N, et al. Epidemiological modelling of the 2005 French riots: A spreading wave and the role of contagion. Scientific Reports. 2018;8:107. 10.1038/s41598-017-18093-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49. Baudains P, Braithwaite A, Johnson SD. Target choice during extreme events: A discrete spatial choice model of the 2011 London riots. Criminology. 2013;51:251–285. 10.1111/1745-9125.12004 [DOI] [Google Scholar]
  • 50. Davies TP, Fry HM, Wilson AG, Bishop SR. A mathematical model of the London riots and their policing. Scientific Reports. 2013;3:1303. 10.1038/srep01303 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51. Cadena J, Korkmaz G, Kuhlman CJ, Marathe A, Ramakrishnan N, Vullikanti A. Forecasting social unrest using activity cascades. PLoS One. 2015;10:e0128879. 10.1371/journal.pone.0128879 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52. Hussain MM, Howard PN. What best explains successful protest cascades? ICTs and the fuzzy causes of the Arab spring. International Studies Review. 2013;15:48–66. 10.1111/misr.12020 [DOI] [Google Scholar]
  • 53. Midlarsky M. Mathematical models of instability and a theory of diffusion. International Studies Quarterly. 1970;14:60. 10.2307/3013540 [DOI] [Google Scholar]
  • 54. Li RPY, Thompson WR. The “Coup Contagion” hypothesis. Journal of Conflict Resolution. 1975;19:63–84. 10.1177/002200277501900104 [DOI] [Google Scholar]
  • 55. McCall GJ, Simmons JL. Identities and interactions: An examination of human associations in everyday life. New York, NY: Free Press; 1978. [Google Scholar]
  • 56. Dong E, Du H, Gardner L. An interactive web-based dashboard to track COVID-19 in real time. The Lancet Infectious Diseases. 2020;20:533–534. 10.1016/S1473-3099(20)30120-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57. Andrews MA, Areekal B, Rajesh KR, Krishnan J, Suryakala R, Krishnan B, et al. First confirmed case of COVID-19 infection in India: A case report. The Indian Journal of Medical Research. 2020;151:490–492. 10.4103/ijmr.IJMR_2131_20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58. Bhardwaj M. India sets global record with single-day rise in coronavirus cases. Reuters. 2020;. [Google Scholar]
  • 59. Pokharel K, Purnell N. Protests Over India’s New Citizenship Law Widen. The Wall Street Journal. 2019;. [Google Scholar]
  • 60.Datareportal. Digital 2020: India; 2020. Available from: https://datareportal.com/reports/digital-2020-india.
  • 61. Last M. The first wave of COVID-19 in Israel: Initial analysis of publicly available data. PLoS One. 2020;15:e0240393. 10.1371/journal.pone.0240393 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62. Jaffe-Hoffman M. Red light, green light, go! Gamzu’s traffic light plan passes. The Jerusalem Post. 2020;. [Google Scholar]
  • 63. Shpigel N, Peleg B, Hasson N, Breiner J, Shezaf H. Clashes, arrests as hundreds of anti-Netanyahu protests held across Israel under lockdown. Haaretz. 2020;. [Google Scholar]
  • 64.Datareportal. Digital 2020: Israel; 2020. Available from: https://datareportal.com/reports/digital-2020-israel
  • 65. Uriel Sanchez DJ. As Mexico focuses on coronavirus, drug gang violence rises. Reuters. 2020;. [Google Scholar]
  • 66. Christine Murray OL. Murders of women in Mexico rise amid fears of lockdown violence. Reuters. 2020;. [Google Scholar]
  • 67.Datareportal. Digital 2021: Mexico; 2021. Available from: https://datareportal.com/reports/digital-2021-mexico.
  • 68.ACLED. Methodology Brief: Coronavirus-Related Events in the ACLED Dataset; 2020. Available from: https://acleddata.com/analysis/covid-19-disorder-tracker/.
  • 69. Baudains P, Braithwaite A, Johnson SD. Spatial patterns in the 2011 London riots. Policing: A Journal of Policy and Practice. 2013;7:21–31. 10.1093/police/pas049 [DOI] [Google Scholar]
  • 70. Lloyd S. Least squares quantization in PCM. IEEE Transactions on Information Theory. 1982;28:129–137. 10.1109/TIT.1982.1056489 [DOI] [Google Scholar]
  • 71. Cox DR, Lewis PAW. The statistical analysis of series of events. Methuen’s monographs on applied probability and statistics. Springer; Netherlands; 1966. [Google Scholar]
  • 72. Bartlett MS. The spectral analysis of point processes. Journal of the Royal Statistical Society: Series B. 1963;25:264–281. [Google Scholar]
  • 73. Ogata Y. Statistical models for earthquake occurrences and residual analysis for point processes. Journal of the American Statistical Association. 1988;83:9–27. 10.1080/01621459.1988.10478560 [DOI] [Google Scholar]
  • 74. Papangelou F. Statistical models for earthquake occurrences and residual analysis for point processes. Transactions of the American Mathematical Association. 1972;165:483–506. [Google Scholar]
  • 75. Zar JH. Biostatistical analysis. 5th ed. Essex, UK: Pearson education limited; 2014. [Google Scholar]
  • 76. O’Connor PDT, Kleyner A. Practical reliability engineering. 5th ed. West Sussex, UK: Wiley; 2012. [Google Scholar]

Decision Letter 0

Chad M Topaz

17 Feb 2021

PONE-D-21-01644

Temporal Clustering of Disorder Events During the COVID-19 Pandemic

PLOS ONE

Dear Dr. Campedelli,

Thank you so much for submitting your manuscript to PLOS ONE. This round of review is now completed. You'll see that both authors feel positively about the manuscript, and have provided a number of quite detailed suggestions regarding various contextual, technical, and presentation issues. I encourage you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Apr 03 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols

I look forward to receiving your revised manuscript!

Best,

Chad

Chad M. Topaz

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that Figures 3, 7 and 12 in your submission contain map/satellite images which may be copyrighted.

All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (a) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (b) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figures 3, 7 and 12 to publish the content specifically under the CC BY 4.0 license. 

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This manuscript presents an interesting application of Hawkes processes and k-means clustering to the spatial and temporal relationships between civil disorder events. In particular, the paper provides a quantitative evaluation of the suspected interplay between a government’s efforts to control the COVID-19 pandemic and resultant civil unrest. I do not have any major comments on the use of Hawkes processes for this data. I found the description of the method and communication of results very informative.

Major Comments:

Background

- Line 189+: When the BLM protests are discussed earlier in the paper, it’s stated that disorder such as this would not be included in the work since they “arise primarily in response to racial injustice, although racial disparities in COVID-19 cases may have contributed to the unrest.” This seems like a sensible exclusion, and I wonder if this exclusion criteria should also apply to the June CAA demonstrations. The authors seem to make the case that these are not primarily a result of the pandemic. In fact, they seem to be quelled rather than incited following lockdown orders.

Results

- I wonder if the box plots contribute enough to the overall objective to remain included as figures or if they could be removed in order to avoid detracting from the more informative results. There is very little main text dedicated to interpreting them in the Results section and none in the Discussion. Given the expected (and demonstrated) skew of the data, it seems like a less than ideal visualization technique. If the average count of weekly events is worth reporting explicitly, then that can be accomplished in the text and without a corresponding figure. Further, the distribution of weekly counts and its variability can be more clearly observed in the time series plots, which also allows the reader to see the temporal trends that lead up to "outlier" weeks.

Minor Comments:

Background

- Generally, these paragraphs are very dense with important and overlapping dates for each country. Perhaps a timeline figure would complement these descriptions and make this information easier to parse.

- Line 159-160: awkward sentence structure

- Line 165: “22nd”

- Line 168-169: awkward sentence structure

- Line 254: “including those who work in the informal economy”

Materials and Methods

- Fig. 1 caption:

o PLOS One guidelines require that all non-standard abbreviations be defined. Would recommend for “Violence a.c.”

o There’s a spelling issue in the database name (should be ACLED not ALCED)

o Consider including the date range for the data displayed to make the figure and caption stand alone.

Results

- Consider changing the x-axes on the country/cluster specific time-series plots to match the time series from Figure 2. I don’t feel strongly about this, but for the sake of historical context, dates may be more useful than indexed weeks.

- Line 498: missing punctuation after “synchrony”

- Lines 549-551: awkward sentence structure should be reworked (maybe one sentence got broken into two?)

Discussion

- Line 620: typo “dcay”

- Line 661: missing word “allows us to understand”

Reviewer #2: In this work, the authors use Poisson and Hawkes processes to model the temporal dynamics of pandemic-related disorder events in India, Israel, and Mexico, and use k-means clustering to assess spatial clustering. The manuscript is well-written and appears scientifically sound. However, the manuscript would benefit from more thorough citation, more condensed figures, and better consistency across figures. I recommend that the manuscript be accepted contingent on addressing these issues.

Major comments

1. The introduction would benefit from more citations for various claims about the global response to COVID-19 and the role of media, if such references are available. I don’t doubt that these claims are accurate, but think the introduction would be strengthened by the addition of more references.

2. Have similar methods been used to study other types of disorder, violence, or other human behaviors? Please add a brief statement with references in the introduction on the applicability of these methods to this type of problem. It looks like examples are given in Section 2, but it is not clear whether the methodology is similar.

3. Are there references for the estimates of what proportion of the population had internet access in 2020?

4. Section 2.1 would also benefit from additional references for the specific examples that are given, such as: protests in response to the CAA; traffic light monitoring plans; clashes with police; increase in murders and femicides.

5. Please include a citation for the COVID-19 Disorder Tracker dataset and ACLED in Section 3 (line 270-271).

6. Figure 2 seems to be missing.

7. Line 417: “Cluster 2 accounts for the majority of disorder events” – this is not quite accurate, and the term “plurality” should be used instead.

8. Tables 2, 3, 4: Are there tests for statistical significance that can be used to compare these values between clusters?

9. Line 463: by “more damped” feedback, do you mean shorter? This is not totally clear; perhaps the wording should be “more quickly damped”.

10. Can differences in the number of events for each cluster be explained primarily by population size? It seems natural that more events would occur in larger populations.

11. In Figure 10, it is misleading to use the scale of 0.95-1 since there is really very little difference in values, yet visually it appears there are large differences. This figure could likely even be omitted, since there is no meaningful difference between the correlations. Similarly, in Figure 6 it is misleading to use a two-color scale when all values are positive. In general, for the pairwise correlation plots, there should be a consistent color map from -1 to 1, with one color for negative values and another color for positive values, so that the color scale is the same across all plots. This would allow for comparison between plots and better interpretation.

12. There are quite a lot of figures. It may be beneficial to condense some figures into panel figures; for example, to combine all figures for one country into a single panel figure.

Minor comments

13. Line 58: “Disorded” -> “Disorder”

14. Line 164: “22th” -> “22nd”

15. Line 244: “began reported” -> “began reporting”

16. The figure files don’t seem to be presented in order, and there are multiple files for each figure. Please ensure figures are correctly inserted for publication.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Apr 22;16(4):e0250433. doi: 10.1371/journal.pone.0250433.r002

Author response to Decision Letter 0


12 Mar 2021

Dear Editor,

Dear Reviewers,

We are grateful for the time spent on our manuscript and the insightful comments provided. We have addressed them one by one, and we feel that, after having taken care of your suggestions, the manuscript has been significantly improved in both its style and contents.

As anticipated, please find below our point-by-point response.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

We modified file naming and other stylistic choices to match the requirements listed in the PLOS ONE style templates. While we believe all requirements are now met, we kindly ask the Editor to let us know whether further attention needs to be devoted to formatting issues.

2. We note that Figures 3, 7 and 12 in your submission contain map/satellite images which may be copyrighted.

All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (a) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (b) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figures 3, 7 and 12 to publish the content specifically under the CC BY 4.0 license.

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

We appreciate the attention to proper licensing of figures 4, 7, and 10. Google Maps explicitly allows use of their materials for research purposes, provided it is fair use and there is proper attribution. Please see https://about.google/brand-resource-center/products-and-services/geo-guidelines/. Ours is a scientific publication, justifying fair use. In the revised version of the manuscript, and as required by Google Maps, we have provided proper attribution in each figure caption and in the Acknowledgments.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information

We have now added a caption for the Supporting Information file at the end of the manuscript and checked in-text citations.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

________________________________________

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: This manuscript presents an interesting application of Hawkes processes and k-means clustering to the spatial and temporal relationships between civil disorder events. In particular, the paper provides a quantitative evaluation of the suspected interplay between a government’s efforts to control the COVID-19 pandemic and resultant civil unrest. I do not have any major comments on the use of Hawkes processes for this data. I found the description of the method and communication of results very informative.

Major Comments:

Background

- Line 189+: When the BLM protests are discussed earlier in the paper, it’s stated that disorder such as this would not be included in the work since they “arise primarily in response to racial injustice, although racial disparities in COVID-19 cases may have contributed to the unrest.” This seems like a sensible exclusion, and I wonder if this exclusion criteria should also apply to the June CAA demonstrations. The authors seem to make the case that these are not primarily a result of the pandemic. In fact, they seem to be quelled rather than incited following lockdown orders.

We thank the reviewer for giving us the opportunity to clarify this point. We confirm that social unrest events concurrent with the pandemic are not tallied by the ACLED’s COVID Disorder Tracker initiative, and therefore are not included in our analyses. What is reported in the Background section (particularly in reference to India), is simply a description of the timeline of the most relevant events that took place during 2020, at the same time of the pandemic. This does not mean that CAA disorders are part of the ACLED/CDT dataset. If they were, we would have excluded them from our analyses, given that – as for the BLM protests – their motive is not intrinsically related to the pandemic, as the reviewer rightly points out.

ACLED’s methodology in filtering out non-pandemic related protests is very clearly detailed in the brief published (and cited in our manuscript) at https://acleddata.com/acleddatanew/wp-content/uploads/dlm_uploads/2020/04/ACLED_Direct-COVID19-Disorder_Methodology-Brief_4.2020.pdfcontent/uploads/dlm_uploads/2020/04/ACLED_Direct-COVID19-Disorder_Methodology-Brief_4.2020.pdf

where they state:

For users interested in data capturing disorder linked to the coronavirus, ACLED offers a curated data file containing all events that are directly related to the pandemic. By ‘directly related’, we mean all events for which the word ‘coronavirus’ is included in the ‘Notes’ column of the ACLED dataset to specifically indicate that the pandemic was an explicit factor. ACLED Researchers include this tag only when an incident report makes obvious that the coronavirus motivated the event (e.g. “A protest occurred in opposition to movement restrictions imposed as a result of the coronavirus”). Events that are directly related to the pandemic include things such as:

● The targeting of healthcare workers responding to the coronavirus

● Violent mobs attacking individuals due to fears of their alleged links to the coronavirus (e.g. Muslims in India; foreigners in Africa; etc.)

● Demonstrations against governance decisions made in response to the coronavirus

No reference to the coronavirus will be made for events that are not directly related to the pandemic (e.g. “A battle occurred and was not connected to the coronavirus”). In this way, ACLED can ensure that the ‘coronavirus’ tag does not trigger such an event’s inclusion in the curated data file as a false positive

Results

- I wonder if the box plots contribute enough to the overall objective to remain included as figures or if they could be removed in order to avoid detracting from the more informative results. There is very little main text dedicated to interpreting them in the Results section and none in the Discussion. Given the expected (and demonstrated) skew of the data, it seems like a less than ideal visualization technique. If the average count of weekly events is worth reporting explicitly, then that can be accomplished in the text and without a corresponding figure. Further, the distribution of weekly counts and its variability can be more clearly observed in the time series plots, which also allows the reader to see the temporal trends that lead up to "outlier" weeks.

We agree with the reviewers’ comment regarding the marginal usefulness of the box plot, especially compared to the time-series plots. In light of this, we have now moved the box plots to the Supporting Information.

Minor Comments:

Background

- Generally, these paragraphs are very dense with important and overlapping dates for each country. Perhaps a timeline figure would complement these descriptions and make this information easier to parse.

We have now provided a figure at the end of the Background section illustrating a timeline with the most relevant events in the COVID-19 pandemic for each country.

- Line 159-160: awkward sentence structure ?

Fixed.

- Line 165: “22nd”

Fixed.

- Line 168-169: awkward sentence structure

Corrected.

- Line 254: “including those who work in the informal economy”

Fixed.

Materials and Methods

- Fig. 1 caption:

o PLOS One guidelines require that all non-standard abbreviations be defined. Would recommend for “Violence a.c.”

We have now added a definition in the caption.

o There’s a spelling issue in the database name (should be ACLED not ALCED)

Fixed. Thanks for notifying us.

o Consider including the date range for the data displayed to make the figure and caption stand alone.

Included.

Results

- Consider changing the x-axes on the country/cluster specific time-series plots to match the time series from Figure 2. I don’t feel strongly about this, but for the sake of historical context, dates may be more useful than indexed weeks.

We have carefully considered this option, but have concluded that for clarity it is best to keep the axes as they are. In Figure 2 we focus on time-series at the daily level and plot the data jointly for all three countries of interest. In this case, using actual dates facilitates the processing and interpretation of the graphic. However, in the country/cluster specific time-series we display weekly-level time series for each country without juxtaposing data for all three so it makes more sense to keep indexed weeks which are easier to display and which reduce the risk of confusion. Note that we do provide information on start and end dates, to allow for the extrapolation of actual dates from the indexed ones. Furthermore, when discussing the findings from these plots in the main text, we included the corresponding actual dates. This should help the reader better place events within the timeline of the pandemic.

- Line 498: missing punctuation after “synchrony”

Fixed.

- Lines 549-551: awkward sentence structure should be reworked (maybe one sentence got broken into two?)

Fixed. Thank you again for pointing this out.

Discussion

- Line 620: typo “decay”

- Line 661: missing word “allows us to understand”

Both fixed.

Reviewer #2: In this work, the authors use Poisson and Hawkes processes to model the temporal dynamics of pandemic-related disorder events in India, Israel, and Mexico, and use k-means clustering to assess spatial clustering. The manuscript is well-written and appears scientifically sound. However, the manuscript would benefit from more thorough citation, more condensed figures, and better consistency across figures. I recommend that the manuscript be accepted contingent on addressing these issues.

Major comments

1. The introduction would benefit from more citations for various claims about the global response to COVID-19 and the role of media, if such references are available. I don’t doubt that these claims are accurate, but think the introduction would be strengthened by the addition of more references.

We have now provided citations in the Introduction addressing the role of the media, as well as other ones we believe deserved better referencing. The references added in the Introduction are:

1. Al-Dmour, H., Masa’deh, R., Salman, A., Abuhashesh, M., & Al-Dmour, R. (2020). Influence of Social Media Platforms on Public Health Protection Against the COVID-19 Pandemic via the Mediating Effects of Public Health Awareness and Behavioral Changes: Integrated Model. Journal of Medical Internet Research, 22(8), e19996. https://doi.org/10.2196/19996

2. Alfano, V., & Ercolano, S. (2020). The Efficacy of Lockdown Against COVID-19: A Cross-Country Panel Analysis. Applied Health Economics and Health Policy, 18(4), 509–517. https://doi.org/10.1007/s40258-020-00596-3

3. Brady, R. R., Insler, M., & Rothert, J. (2020). The Fragmented United States of America: The Impact of Scattered Lock-Down Policies on Country-Wide Infections (SSRN Scholarly Paper ID 3681486). Social Science Research Network. https://doi.org/10.2139/ssrn.3681486

4. Chen, Q., Min, C., Zhang, W., Wang, G., Ma, X., & Evans, R. (2020). Unpacking the black box: How to promote citizen engagement through government social media during the COVID-19 crisis. Computers in Human Behavior, 110, 106380. https://doi.org/10.1016/j.chb.2020.106380

5. Delen, D., Eryarsoy, E., & Davazdahemami, B. (2020). No Place Like Home: Cross-National Data Analysis of the Efficacy of Social Distancing During the COVID-19 Pandemic. JMIR Public Health and Surveillance, 6(2), e19862. https://doi.org/10.2196/19862

6. Kouzy, R., Abi Jaoude, J., Kraitem, A., El Alam, M. B., Karam, B., Adib, E., Zarka, J., Traboulsi, C., Akl, E. W., & Baddour, K. (2020). Coronavirus Goes Viral: Quantifying the COVID-19 Misinformation Epidemic on Twitter. Cureus, 12(3). https://doi.org/10.7759/cureus.7255

7. Mills, M. C., & Salisbury, D. (2021). The challenges of distributing COVID-19 vaccinations. EClinicalMedicine, 31. https://doi.org/10.1016/j.eclinm.2020.100674

8. Muriel, J.-J., & Bauchner, H. (2021). Vaccine Distribution—Equity Left Behind? JAMA. https://doi.org/10.1001/jama.2021.1205

9. Pennycook, G., McPhetres, J., Zhang, Y., Lu, J. G., & Rand, D. G. (2020). Fighting COVID-19 Misinformation on Social Media: Experimental Evidence for a Scalable Accuracy-Nudge Intervention. Psychological Science, 31(7), 770–780. https://doi.org/10.1177/0956797620939054

10. Tasnim, S., Hossain, M. M., & Mazumder, H. (2020). Impact of Rumors and Misinformation on COVID-19 in Social Media. Journal of Preventive Medicine and Public Health, 53(3), 171–174. https://doi.org/10.3961/jpmph.20.094

11. Wellenius, G. A., Vispute, S., Espinosa, V., Fabrikant, A., Tsai, T. C., Hennessy, J., Dai, A., Williams, B., Gadepalli, K., Boulanger, A., Pearce, A., Kamath, C., Schlosberg, A., Bendebury, C., Mandayam, C., Stanton, C., Bavadekar, S., Pluntke, C., Desfontaines, D., … Gabrilovich, E. (2020). Impacts of US State-Level Social Distancing Policies on Population Mobility and COVID-19 Case Growth During the First Wave of the Pandemic. ArXiv:2004.10172 [q-Bio]. http://arxiv.org/abs/2004.10172

2. Have similar methods been used to study other types of disorder, violence, or other human behaviors? Please add a brief statement with references in the introduction on the applicability of these methods to this type of problem. It looks like examples are given in Section 2, but it is not clear whether the methodology is similar.

In the revised manuscript we have included a discussion and multiple references on the use of Hawkes processes in understanding patterns of violent human phenomena. These are:

1. Brantingham, P. J., Yuan, B., & Herz, D. (2020). Is Gang Violent Crime More Contagious than Non-Gang Violent Crime? Journal of Quantitative Criminology. https://doi.org/10.1007/s10940-020-09479-1

2. Loeffler, C., & Flaxman, S. (2018). Is Gun Violence Contagious? A Spatiotemporal Test. Journal of Quantitative Criminology, 34(4), 999–1017. https://doi.org/10.1007/s10940-017-9363-8

3. Tench, S., Fry, H., & Gill, P. (2016). Spatio-temporal patterns of IED usage by the Provisional Irish Republican Army. European Journal of Applied Mathematics, 27(3), 377–402.

3. Are there references for the estimates of what proportion of the population had internet access in 2020?

We have now added the requested references for each country.

4. Section 2.1 would also benefit from additional references for the specific examples that are given, such as: protests in response to the CAA; traffic light monitoring plans; clashes with police; increase in murders and femicides.

We now provide references related to the abovementioned events as well as to other important pandemic-related facts in the three countries of interest. These references are:

1. Jaffe-Hoffman, M. (2020). Red light, green light, go! Gamzu’s traffic light plan passes. The Jerusalem Post. https://www.jpost.com/health-science/coronavirus-cabinet-to-convene-sneak-peek-at-gamzus-traffic-light-plan-640464

2. Murray, O. L., Christine. (2020, April 27). Murders of women in Mexico rise amid fears of lockdown violence. Reuters. https://www.reuters.com/article/us-mexico-women-violence-trfn-idUSKCN22930V

3. Pokharel, K., & Purnell, N. (2019). Protests Over India’s New Citizenship Law Widen. The Wall Street Journal. https://www.wsj.com/articles/protests-over-indias-new-citizenship-law-widen-11576501527

4. Sanchez, D. J., Uriel. (2020, June 18). As Mexico focuses on coronavirus, drug gang violence rises. Reuters. https://www.reuters.com/article/uk-health-coronavirus-mexico-cartels-idUKKBN23P1T5

5. Shpigel, N., Peleg, B., Hasson, N., Breiner, J., & Shezaf, H. (2020). Clashes, arrests as hundreds of anti-Netanyahu protests held across Israel under lockdown. Haaretz. https://www.haaretz.com/israel-news/.premium-despite-restrictions-anti-netanyahu-protests-continue-at-thousands-of-locations-1.9205689

5. Please include a citation for the COVID-19 Disorder Tracker dataset and ACLED in Section 3 (line 270-271).

We have now added the requested citation.

6. Figure 2 seems to be missing.

We have now included the figure.

7. Line 417: “Cluster 2 accounts for the majority of disorder events” – this is not quite accurate, and the term “plurality” should be used instead.

We have corrected as suggested.

8. Tables 2, 3, 4: Are there tests for statistical significance that can be used to compare these values between clusters?

To the best of our knowledge, not quite. The Kolmogorov-Smirnov (KS) test is typically used as a goodness of fit test for Hawkes processes, and implies that the set of compensators calculated at each event time should define a Poisson processes. It may be that two clusters differ in the outcomes of the KS test (e.g., one of them passes the KS test the other does not), and therefore we can “compare” the clusters claiming that in one case there is support for the use of a Hawkes process with an exponential decay function, while in the other the modeling choice does not fit well. However, it would make little sense to compare the magnitude and significance of the tests between clusters, especially given that the sampled residuals vary in numbers across clusters.

9. Line 463: by “more damped” feedback, do you mean shorter? This is not totally clear; perhaps the wording should be “more quickly damped”

Thanks for pointing this out. We have clarified by using “more quickly damped”, as suggested.

10. Can differences in the number of events for each cluster be explained primarily by population size? It seems natural that more events would occur in larger populations.

We appreciate very much the reviewer's suggestion to correlate the number of protes events in each cluster with its population. In the paper, we identified the clusters with the largest number of events, however, due to the many possible variables at play, thoroughly correlating the number of events with cluster-specific characteristics (not just density, but also overall population, percent of rural population, percent of young persons, income, climate, political leanings, government responsiveness) would require an analysis of its own, and is outside the scope of this paper.

Nonetheless, during this review process, we did take a closer look of the data, and noted that in India the greatest number of events does often occur in clusters that contain populous or densely populated states or Union Territories (e.g., Punjab and Assam in Clusters 1 and 2, respectively). However, the Union Territory with the highest number of protest events - Jammu and Kashmir - is neither among the most populous or the densest, implying that other socio-political or socio-economic factors might be at play in igniting the covid-related protests.

The data from Mexico shows that the greatest number of events occurs in Cluster C4 that contains the most populous, dense states of the country including the capital, Mexico City (population 9 million, density 6,180 persons/km2), and the state of Mexico proper.

Finally, in Israel, the greatest number of events occurs in Cluster C4 that contains the city of Haifa, among the most densely populated in Israel. Cluster 3, which is the second highest in terms of recorded events, contains other populated territories of the country, including Tel Aviv and the Sharon plain. Interestingly, Jerusalem, also one of the highest density areas in the country, is not characterized by a significantly high number of disorder events.

As mentioned above, these not-so-clear cut observations show that correlating the number of events with specific cluster demographic or geographical characteristics may be too simplistic. For completeness, we added a paragraph in the conclusion with a brief discussion, underlying the need to consider the intersectionality of socioeconomic, political and/or religious factors when trying to understand why some clusters display more events than others.

11. In Figure 10, it is misleading to use the scale of 0.95-1 since there is really very little difference in values, yet visually it appears there are large differences. This figure could likely even be omitted, since there is no meaningful difference between the correlations. Similarly, in Figure 6 it is misleading to use a two-color scale when all values are positive. In general, for the pairwise correlation plots, there should be a consistent color map from -1 to 1, with one color for negative values and another color for positive values, so that the color scale is the same across all plots. This would allow for comparison between plots and better interpretation.

We thank the reviewer for this comment, which allowed us to rethink the way we present our correlation plots in the manuscript at the subnational scale and to find ways to better display our findings. We believe that the correlation plots are important as they convey relevant information regarding the event distributions within each cluster. Hence, we think it is more informative to keep them in the main body of the manuscript.

To strike a balance between plot comparability (i.e., one should be able to compare each plot in each country with the corresponding plot in another country) and consistency (i.e. the same number and types of figures should be displayed for each country) we partially followed the reviewer’s advice. Specifically, in the revised version of the manuscript, the correlation plots for all three countries are produced using the same color map, aka the Spectral palette in ggplot. Furthermore, the plots for India and Mexico are drawn using the entire (-1;+1) range, as typical of Pearson’s correlation plots. These two choices facilitate comparability across countries. However, we maintained a restricted scale (+0.95; +1) for Israel to allow for more insight, given the high values of the correlation coefficient nationwide.

The rationale behind this choice is better illustrated in the caption of Figure 9 in the revised manuscript where the differing range for Israel compared to India and Mexico is specifically pointed to the reader’s attention. We preferred this choice compared to the other two alternatives, (a) deleting the figure for Israel, reducing consistency across countries and (b) maintaining the original scale (-1,+1), which would have led to a uniformly colored, and not informative, plot.

12. There are quite a lot of figures. It may be beneficial to condense some figures into panel figures; for example, to combine all figures for one country into a single panel figure.

To address both this comment and another comment from the other reviewer, we have now modified the figures removing the box plots for each country, thus reducing the number of plots overall.

Minor comments

13. Line 58: “Disorded” -> “Disorder”

Fixed.

14. Line 164: “22th” -> “22nd”

Fixed.

15. Line 244: “began reported” -> “began reporting”

Fixed. Thank you for spotting these typos.

16. The figure files don’t seem to be presented in order, and there are multiple files for each figure. Please ensure figures are correctly inserted for publication.

We have verified that the figures are presented in the correct order in the revised manuscript.

Decision Letter 1

Chad M Topaz

7 Apr 2021

Temporal Clustering of Disorder Events During the COVID-19 Pandemic

PONE-D-21-01644R1

Dear Dr. Campedelli,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Chad M. Topaz

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: (No Response)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

Acceptance letter

Chad M Topaz

13 Apr 2021

PONE-D-21-01644R1

Temporal Clustering of Disorder Events During the COVID-19 Pandemic

Dear Dr. Campedelli:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Chad M. Topaz

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (PDF)

    Data Availability Statement

    The original dataset is freely and openly available to anyone at the ACLED dedicated website: https://acleddata.com/analysis/covid-19-disorder-tracker/. The processed datasets and code utilized in this paper are available at: https://github.com/gcampede/covid19-protests.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES