Skip to main content
PLOS One logoLink to PLOS One
. 2021 Aug 10;16(8):e0255598. doi: 10.1371/journal.pone.0255598

A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak

Matteo P Lisi 1,2,*, Marina Scattolin 1,2, Martina Fusaro 2, Salvatore Maria Aglioti 1,2,*
Editor: Valerio Capraro3
PMCID: PMC8354471  PMID: 34375361

Abstract

Humans typically create and maintain social bonds through interactions that occur at close social distances. The interpersonal distance of at least 1 m recommended as a relevant measure for COVID-19 contagion containment requires a significant change in everyday behavior. In a web-based experimental study conducted during the first pandemic wave (mid-April 2020), we asked 242 participants to regulate their preferred distance towards confederates who did or did not wear protective masks and gloves and whose COVID-19 test results were positive, negative, or unknown. Information concerning dispositional factors (perceived vulnerability to disease, moral attitudes, and prosocial tendencies) and situational factors (perceived severity of the situation in the country, frequency of physical and virtual social contacts, and attitudes toward quarantine) that may modulate compliance with safety prescriptions was also acquired. A Bayesian analysis approach was adopted. Individual differences did not modulate interpersonal distance. We found strong evidence in favor of a reduction of interpersonal distance towards individuals wearing protective equipment and who tested negative to COVID-19. Importantly, shorter interpersonal distances were maintained towards confederates wearing protective gear, even when their COVID-19 test result was unknown or positive. This protective equipment-related regulation of interpersonal distance may reflect an underestimation of perceived vulnerability to infection; this perception must be discouraged when pursuing individual and collective health-safety measures.

Introduction

On March 11, 2020, the World Health Organization described the COVID-19 outbreak as a pandemic to signal that the new coronavirus disease had spread across continents, covering large parts of the world. The severe acute respiratory syndrome coronavirus-2 (SARS-CoV-2), which is the virus responsible for the emergence of the COVID-19 disease, was found to be transmissible during social interactions, when particles emitted from an infected person’s respiratory system may enter another’s [1]. To limit gatherings and close-range interactions, multiple governments imposed the closure of many public places. These closures and other measures of transmission containment, such as handwashing and use of face masks [2], have been widely adopted in conjunction with maintaining interpersonal distances of at least 1 m [3]. The need to regulate the minimum distance during in-person interactions is justified by the observation that, although humans tend to keep themselves at about 1 m from unfamiliar individuals [4], this distance reduces when interacting with acquaintances and friends [5]. Crucially this pattern seems to hold across different countries [5], suggesting that the imposed governmental measures sought to change a globally established, everyday behavior. While the reasons behind enforcement of such distancing rules are clear, it remains to be clarified which dispositional and situational factors may impact adherence to interpersonal distancing measures. By providing insights on this topic, social and behavioral sciences can support human responses to pandemics [6, 7].

Research in proxemics, the study of interpersonal spatial behavior [8, 9], has defined interpersonal distance (IPD) as the separation zone that individuals keep between themselves and others [10]. IPD is shaped by situational factors such as social threat [11, 12] and interpersonal attraction [13], as well as individual characteristics such as morality [14] and prejudice [15]. Ultimately, the appropriate IPD appears to be automatically regulated according to distance-related feelings of personal comfort [16]. Although previous research has largely investigated IPD under regular circumstances, much less is known about the factors influencing the regulation of IPD during the spread of infectious diseases. A limited body of research suggests that greater distances are kept when others are improperly perceived as contagious (i.e., people with AIDS) or as a threat to an individual’s health [17, 18]. Moreover, two studies conducted during the first COVID-19 outbreak [19, 20] showed that a smaller IPD was preferred when the other person was wearing a mask. One possible interpretation is that the sight of a person wearing a face mask triggers a feeling of safety. It is important to note that, if not accompanied by the appropriate IPD, wearing a mask is not in itself sufficient to prevent contagion [21]. Therefore, one crucial aspect to clarify is whether wearing a mask can reduce the IPD even when the other person is contagious. If this is the case, the erroneous belief that the use of protective equipment is enough to prevent contagion may have potentially dangerous effects.

It is worth noting that modulations of IPD during a pandemic may not only mirror self-protective motives, but also affiliative [22] and cooperative ones [23]. In fact, previous research showed that prosocial individuals are more likely to follow physical distancing [24, 25], while prosocial messages appear to foster compliance with health behaviors [26].

Understanding which of these variables are more influential on IPD behavior is crucial in the current global context, where policies that effectively reduce contagion are fundamental.

Given the circumstances preventing in-person testing, we used the Interpersonal Visual Analogue Scale (IVAS), a validated, self-report measure of IPD [27]. In the IVAS, participants were presented with a silhouette and an avatar’s profile on a computer screen. The silhouette represented the participant and the avatar represented a possible unknown individual. Participants were asked to indicate the shortest distance between themselves and the other person that they would feel comfortable maintaining. Both male and female interactants were considered, and distance was indicated along a horizontal line. Since the aim of this study was to investigate whether being at risk of infection modulates participants’ predicted IPD, the avatar representing the other person was associated with a negative, positive or unknown COVID-19 test result. In addition, the avatar could be wearing protective equipment (i.e., mask and gloves) or not. Factors hypothesized to play a role included (a) the perceived vulnerability to a disease, and (b) the perceived severity of the situation in the country, which were relevant for evaluating attitudes towards the threat itself. We also explored (c) the role of individual differences in levels of physical and virtual contact prior to participation. Finally, we aimed to assess the possible role of different styles of (d) moral thinking (individualization-oriented and binding-oriented), (e) attitudes toward quarantine, and (f) altruism.

We expected participants to maintain a greater distance when others were not wearing protective equipment and when they were identified as positive to COVID-19. The shortest distance was expected to be observed when the other person was wearing a mask and gloves and had received a negative diagnosis of COVID-19. We included a condition in which COVID-19 test results were unknown. This was our control condition and was used to estimate (i) how participants may react to strangers approaching them in everyday situations, and (ii) how reactions may change when the other person is wearing protective equipment or not. We expected higher levels of perceived severity of the situation in the country of participants and their perceived vulnerability to a disease to be associated with greater IPD. As to the affiliative domain, we expected our results to show one of the following two paths: on the one hand, participants who engaged in fewer virtual and physical contact may display a stronger tendency to distance themselves from others [28] compared to participants with more frequent contacts. On the other hand, and in accordance with the contact hunger hypothesis [22], the opposite pattern of results could appear: people who had engaged in more frequent and recent social contacts at the time of testing may not feel the need for closeness that people who had engaged in fewer and less frequent contacts may feel. We expected that participants’ positive attitudes toward quarantine may be associated with greater IPD across all conditions. In addition, since binding (vs. individualizing) moral intuitions are more strongly correlated with dispositional germ aversion [29], we expected binding moral thinking styles to contribute to the tendency to maintain a greater IPD. Lastly, if prosocial motives play a role, higher levels of altruism should predict greater distance. In order to avoid overfitting and to select only the relevant variables, we used a model selection approach [30].

Materials and method

Participants

All procedures were approved by the Ethics Committee of the Department of Psychology, University of Rome “La Sapienza” (Prot. n. 0000612) and in accordance with the ethical standards laid down in the Declaration of Helsinki (2013).

A power analysis using MorePower [31] indicated that a sample size of 238 participants was necessary to detect a small effect size (ƞ2 = 0.02) with a power of 0.80. This analysis was performed for a repeated measure design 2 (Participant’s Gender: Male/Female) x 2 (Other Avatar’s Gender: Male/Female) x 2 (Protective Equipment: Worn/NotWorn) x 3 (COVID-19 Test Result: Positive/Negative/Unknown).

Participants were recruited through the online platform Prolific [32] and were compensated with $2.28 USD ($6.50 USD per hour) for their participation. Written informed consent was obtained from all participants. Data collection started on April 16, 2020, and ended on April 22, 2020.

Of the original 250 participants, eight were excluded due to failure in two or more attentional checks. A total of 242 international participants (100 women) were included in the final sample. Demographic characteristics of the sample, as well as a list of all countries of residence, are presented in Table 1. All countries of residence involved in the data collection had an average Government Stringency Index (a composite measure of the strictness of contagion policies in each country, based on nine response indicators, ranging from 0 to 100) [33] greater than 60 (see Table 1).

Table 1. Demographic characteristics for each of the 28 countries of residence included in the study.

Country of residence Gender Age Range Government Stringency Index
Total Male Female 18–34 35–55 55 Mean (between 16–22 April 2020)
or more
Australia 4 4 0 3 1 0 70.5
Austria 3 1 2 3 0 0 77.8
Belgium 2 1 1 2 0 0 81.5
Canada 3 3 0 3 0 0 72.7
Czech Republic 4 4 0 4 0 0 67
Denmark 1 0 1 1 0 0 68.5
Estonia 8 2 6 7 1 0 77.8
Finland 2 1 1 2 0 0 61.8
France 7 5 2 6 1 0 87.9
Germany 4 3 1 4 0 0 76.8
Greece 16 12 4 13 3 0 84.2
Hungary 9 5 4 8 1 0 76.8
Ireland 3 2 1 3 0 0 90.7
Israel 3 3 0 3 0 0 89.9
Italy 26 15 11 24 2 0 93.5
Latvia 2 0 2 2 0 0 69.4
Mexico 2 2 0 2 0 0 82.4
Netherlands 4 3 1 4 0 0 79.6
New Zealand 3 2 1 3 0 0 96.3
Norway 2 2 0 2 0 0 76.4
Poland 34 23 11 31 3 0 83.3
Portugal 30 17 13 22 6 2 82.4
Slovenia 5 4 1 4 1 0 88.2
South Africa 1 0 1 0 1 0 87.9
Spain 10 7 3 8 2 0 85.1
Sweden 1 1 0 1 0 0 64.8
UK 48 15 33 31 13 4 79.6
USA 5 5 0 4 1 0 72.7
Total 242 142 100 200 36 6

Procedure

The experiment was conducted using PsyToolkit [34, 35]. After reading general information concerning the study, participants could check the informed consent page and agree to take part in the study. Only those who gave their consent to participate could begin the survey. Participants always completed the demographic information and the questionnaires before the IVAS task. The silhouette representing participants in the IVAS task was selected based on each participant’s gender (task version “Female-Self” and “Male-Self”). The silhouette was pictured in a standing position on a marker at the left end of a line and facing the right end of the line (see Fig 1). The height of participants’ silhouettes and of the other person’s virtual avatar were matched. The virtual avatars were realized using MakeHuman Community 1.2.0 (http://www.makehumancommunity.org); the pictures of the avatars were taken using Unity v.2019.4.15f1 (https://unity.com). Before beginning the IVAS, participants were provided with the following instructions: “Imagine that you are the person on the left of the line and that you cannot turn nor move. Then, imagine that the other person, depicted on the line, begins walking toward you. You should indicate how close you would allow this person to approach you while still being comfortable with that distance. To indicate where the other should stop, click on the horizontal line. Then, press ‘Next’ to move to the following trial. During the task you will be approached by men and women, that may or may not be wearing masks and gloves. On the top center of the screen you’ll read some information about the results of their COVID-19 test: a red sign reporting ‘COVID-19 +’ indicates a person that tested positive; a green ‘COVID-19 –’ indicates a person whose results were negative; a grey ‘COVID-19?’ indicates that the person was not tested or that results are unknown.” In each trial, participants were reminded of these instructions by the sentence: “Click the position on the line where you’d want the other person to stop.” This reminder was continuously displayed on the top-center of the screen, above the indicator of COVID-19 Test Result (Fig 1).

Fig 1. Example of experimental stimuli.

Fig 1

Participants were instructed to imagine to be the person on the left side, represented by a gender-matched, black silhouette, and to indicate the distance to the other person (female or male, represented in A-C and B, respectively) that they would feel comfortable keeping. The other person could be wearing protective equipment (A-B) or not (C). The label appearing on the upper part of the screen indicated the COVID-19 test result of the other person: a Positive test result was represented by a “+” and displayed in red (A); an Unknown test result was represented by a “?”and displayed in gray (B); a Negative test result was represented by a “-”and shown in green (C).

For each condition (i.e., the combination of factors Other Avatar’s Gender x Protective Equipment x COVID-19 Test Result), a total of three trials was presented. Three catch trials were included to ensure that participants were paying attention during the task. In these trials, participants were asked to place the other person’s avatar on the far-left end of the line. A total of 39 trials were presented to participants. For each trial, the distance between the participant’s silhouette and the other person’s avatar was calculated considering that the left end of the horizontal line corresponded to 0 while the right end of the line corresponded to 100.

Measures

Perceived Severity of the Situation relative to the COVID-19 outbreak in the country

Perceived Severity of the Situation concerning the COVID-19 outbreak was assessed through participants’ answers to the following question: “In your opinion, how serious is the situation related to COVID-19 in your country?” Participants rated this on a VAS ranging from 0 (labelled as not serious at all) to 100 (extremely serious).

Physical and Virtual Contact

Physical Contact was assessed by means of the question “How often did you have PHYSICAL contacts (for instance, hugs, cuddling, handshakes, etc.) in the last two weeks?” Participants provided their response on a 5-point Likert scale: never (1), rarely (2), sometimes (3), often (4), always (5). Participants rated frequency of Virtual Contact on a single-item, 5-point Likert scale: never (1), rarely (2), sometimes (3), often (4), always (5). The question was the following: “How often did you have VIRTUAL contacts (for instance, through Skype, Zoom, WhatsApp, etc.) in the last two weeks?”

Moral Foundations Questionnaire

This is a self‐report questionnaire that contains 30 items related to harm, fairness, in‐group loyalty, respect for authority, and purity (six items for each foundation) [36].

We computed scores for the individualizing foundations (mean of the harm/care and fairness/reciprocity subscales; Cronbach’s α = 0.77) and the binding foundations (mean of the in-group/loyalty, authority/respect, and purity/sanctity subscales; α = 0.85); these values were used in subsequent analyses since we were interested in individualizing and binding foundations broadly. The focus on the well-being of individuals is observed in association with individualizing approaches to moral thinking [37]. People who rely on this style of moral thinking focus on protection of individuals from harm and unfairness and consider individuals as the center of moral regulations [36]. On the other hand, binding foundations favor moral evaluations that are group-oriented and value authority.

Perceived Vulnerability to Disease

Participants completed an adapted version of a questionnaire assessing individual differences in perceived vulnerability to disease [38]. Specifically, we dropped one item (“I avoid using public telephones because of the risk that I may catch something from the previous user”) because of its poor relevance to the contemporary context, where the majority of people use cell phones. Consequently, a 14-item version was employed. The overall score (Cronbach’s α = 0.75) was used for our analysis.

Public Attitudes Toward Quarantine

This is a 15-item questionnaire developed by Tracy and colleagues [39]. Participants were asked to rate each sentence on a 5-point Likert scale ranging from strongly disagree to strongly agree. The Justification subscale (Cronbach’s α = 0.68) was entered in the analysis to investigate the relationship between the agreement with the use of quarantine and the interpersonal distance regulation.

Self-Report Altruism Scale

For assessment of participants’ altruism, the scale developed by Rushton and colleagues [40] was employed. This includes 18 items measuring helping or altruistic traits based on the frequency of helping behaviors. Cronbach’s α was 0.84.

Sexual Orientation

For the assessment of participants’ sexual orientation, we used the Kinsey Scale [41]. Participants provided their response on a 8-point Likert scale ranging from exclusively heterosexual (1), to exclusively homosexual (7), and also including no socio-sexual contacts or reactions (8).

The full survey can be found in the S1 File.

Results

Model comparison

A Bayesian analysis approach was applied. This approach differs from the one used within the standard framework of frequentist null-hypothesis significance testing (NHST) in that it allows evidence to be obtained in favor of the null hypothesis and discrimination between “absence of evidence” and “evidence of absence” [42].

Data analyses were computed using the programming language R [43] by means of the RStudio interface [44]. Preparation and plotting of data were performed using several tidyverse packages [45]; modeling and inference were performed using the brms package [46], which is based on the probabilistic programming language Stan [47]. Packages emmeans [48] and bayestestR [49] were employed for computing contrasts between posterior distributions, credible intervals, and Bayes factors.

The score along the 0–100 Visual Analogue Scale was used as a measure of the distance that participants preferred to keep between themselves and other person’s avatars. This measure was set as the outcome of our analysis. We first graphically inspected the univariate and bivariate distributions of outcome and predictor variables. This was done in order to (i) check data distributions and identify potential errors/anomalies, and (ii) identify which models to adopt for a better fit of our data.

To account for the nested structure of our sample, that is, participants nested within countries, multilevel modeling was used [50]. Multilevel models of increasing complexity were fitted in order to select the most accurate one. A list of all models can be found in Table 2. The starting point was a “Primary” Model, which included the main effects of COVID-19 Test Result, Protective Equipment, Participant’s Gender and Other Avatar’s Gender. The interactions between COVID-19 Test Result and Protective Equipment and between Participant’s and Other Avatar’s Gender were also included as predictors. All models presented here included the intercept over Participants and Countries as random effects (see Table 1).

Table 2. Formulas for each model.

Model Formula
Model 0 Distance ~ 1 + (1 | Country) + (1 |Participant)
Model 1 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + (1 | Country) + (1 |Participant)
Model 2 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + (1 | Country) + (1 |Participant)
Model 3 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + (1 | Country) + (1 |Participant)
Model 4 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + (1 | Country) + (1 |Participant)
Model 5 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + (1 | Country) + (1 |Participant)
Model 6 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + Individualizing Moral Foundation + (1 | Country) + (1 |Participant)
Model 7 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + Individualizing Moral Foundation + Binding Moral Foundation + (1 | Country) + (1 |Participant)
Model 8 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + Individualizing Moral Foundation + Binding Moral Foundation + Quarantine’s Justification + (1 | Country) + (1 |Participant)
Model 9 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + Individualizing Moral Foundation + Binding Moral Foundation + Quarantine’s Justification + Altruism + (1 | Country) + (1 |Participant)
Model 10 Distance ~ 1 + Protective Equipment × COVID-19 Test Result + Participant’s Gender × Other Avatar’s Gender x Participant’s Sexual Orientation + Perceived Severity of the situation in the Country + Virtual Contact + Physical Contact + Perceived Vulnerability to Disease + Individualizing Moral Foundation + Binding Moral Foundation + Quarantine’s Justification + Altruism + (1 | Country) + (1 |Participant)

All continuous predictors were mean-centered. The two ordinal scales Virtual and Physical Contact were dichotomized into “Frequent” (including “Often” and “Always’’) and “Infrequent” (including “Never,” “Rarely,” and “Sometimes”), while Sexual Orientation was categorized into “Heterosexual” (including Kinsey Scale’s 1–3 scores), “Non Heterosexual” (including Kinsey Scale’s 4–7 scores) and “No socio-sexual contacts or reactions” (Kinsey Scale’s 8 score). Non-informative, normally-distributed priors (M = 0, SD = 1000) were applied to all models, on all population-level effects and t- distributed priors (df = 3, M = 0, SD = 28) on the intercept and on the group-level effects. Use of non-informative prior prevents results from being biased toward alternative hypotheses [51] and respects the Laplacian principle of indifference [52]. All models were fitted using four independent Markov chains. Each chain had 30,000 iterations, the first 15,000 of which were warm-up. This led to a total of 60,000 post warm-up posterior samples for inference. According to standard convergence diagnostics [53], all models converged (Rhat < 1.05) with sufficient precision (effective sample size > 1000).

The models were compared through approximate leave-one-out cross-validation and using Pareto-smoothed importance sampling (PSIS-LOO [30]), which estimates out-of-sample predictive accuracy adopting within-sample fits. Model 5 had the best predictive accuracy and included the same structure of the Primary model plus the main effects of Perceived Severity of the situation in the country, Virtual and Physical Contact, and Perceived Vulnerability to Disease (see Table 3).

Table 3. Model comparison via leave-one-out cross-validation.

Model ELPD-diff SE-diff weight
Model 5 0 0 0.14
Model 3 -0.1 0.3 0.13
Model 1 -0.2 0.5 0.11
Model 6 -0.3 0.1 0.11
Model 2 -0.3 0.5 0.10
Model 4 -0.3 0.1 0.10
Model 8 -0.3 0.4 0.10
Model 7 -0.4 0.3 0.09
Model 9 -0.5 0.4 0.08
Model 10 -3.9 0.7 0
Model 0 -2200.3 58.1 0

We report the differences in the point estimates (ELPD-diff) and standard errors of the difference (SE-diff) of the expected log pointwise predictive density (ELPD). The values in the ELPD-diff and SE-diff columns of the returned matrix are computed by making pairwise comparisons between each model and the model with the largest ELPD (the model in the first row). ELPD indicates the predictive performance of the model. Model weights are calculated via stacking of the predictive distributions: The method combines all models by maximizing the leave-one-out predictive density of the combination distribution.

Final model

To visualize the probability of direction of the effect for each parameter included in the study, see Fig 2. The summary of the model is reported in Table 4. Table 5 presents contrasts between all levels of Protective Equipment and COVID-19 Test Result; a graphical representation of this interaction can be found in Fig 3. Contrasts between all levels of Participant’s Gender and Other Avatar’s Gender are reported in Table 6.

Fig 2. Probability of direction and the magnitude of the effect for each predictor included in the study.

Fig 2

The y-axis indicates the predictors and the x-axis indicates the possible parameter values. The color indicates the direction of the effect: black stands for a negative direction (reduction of IPD), while gray represents a positive direction (enlargement of IPD). The effect of the parameters included in the final model whose HDI are completely outside of zero are marked with “-” (if the direction of the effect is negative) or a “+” (if the direction of the effect is positive). The interaction between COVID-19 Test Result and Protective Equipment and the interaction between Participant’s Gender and Other Avatar’s Gender are better explained by the contrasts between all levels of the factors (COVID-19 Test Result: Protective Equipment see Table 4 and Fig 3; Participant’s Gender: Other Avatar’s Gender see Table 5).

Table 4. Summary of the final model.

Parameter Median 95% HDI BF10 ESS Ȓ
Intercept 33.61 [28.11, 39.25] 8.33E+10 9319 1
Protective Equipment -6.58 [-7.67, -5.50] 1.08E+11 33152 1
Worn v. Not Worn
COVID-19 test result -27.90 [-28.66, -27.11] 3.526e+97 35176 1
Negative v. Positive
Negative v. Unknown -11.37 [-12.14, -10.59] 9.795e+42 35998 1
Positive v. Unknown 16.52 [15.76, 17.30] 1.458e+47 35765 1
Participant’s Gender 5.08 [0.08, 10.06] 0.02 6970 1
Female v. Male
Other Avatar’s Gender 0.40 [-0.39, 1.22] 6.759e-04 39129 1
Male v. Female
Perceived Severity of the situation in the Country 0.10 [-0.01, 0.22] 2.773e-04 9688 1
Virtual contact -8.71 [-14.23, -3.07] 0.28 10351 1
Infrequent v. Frequent
Physical contact 5.04 [-0.38, 10.28] 0.015 9056 1
Infrequent v. Frequent
Perceived Vulnerability to Disease -1.04 [-5.99, 3.85] 0.003 8344 1

For all categorical predictors, we report the contrasts between each level of the factor; for the continuous predictors, we report the regression coefficient which represents the change in the outcome resulting from a unit change in the predictor. Results are described by means of the Median, the 95% HDI (Highest Density Interval) and the BF (Bayes Factor). A BF greater than 3 indicates support for the alternative hypothesis, while the HDI quantifies the magnitude of the effect and its uncertainty.

Table 5. Contrasts between all levels of protective equipment and COVID-19 test result.

Protective Equipment: COVID-19 test result Contrasts Median 95% HDI BF10
Negative: Worn v. Not Worn -6.58 [-7.67, -5.50] 2.68E+09
Unknown: Worn v. Not Worn -6.41 [-7.48, -5.30] 8.81E+08
Positive: Worn v. Not Worn -7.60 [-8.69, -6.52] 1.08E+13
Worn: Negative v. Unknown -11.46 [-12.55, -10.38] 6.6E+19
Worn: Positive v. Unknown 15.94 [14.84, 17.01] 1.72E+79
Worn: Negative v. Positive -27.39 [-28.48, -26.30] 1.05E+70
Not Worn: Negative v. Unknown -4.88 [-5.96, -3.78] 645871.4
Not Worn: Positive v. Unknown 17.13 [16.03, 18.21] 1.19E+31
Not Worn: Negative v. Positive -28.42 [-29.49, -27.31] 2.14E+78
Worn x Negative v. -35.00 [-36.09, -33.90] 1.34E+86
Not Worn x Positive
Not Worn x Negative v. -20.81 [-21.91, -19.75] 7.18E+53
Worn x Positive
Worn x Negative v. -17.87 [-18.94, -16.76] 1.27E+44
Not Worn x Unknown
Not Worn x Negative v. -11.28 [-12.39, -10.22] 7.35E+24
Not Worn x Unknown
Worn x Positive v. 9.52 [8.44, 10.60] 5.87E+20
Not Worn x Unknown
Not Worn x Positive v. 23.53 [22.43, 24.61] 1.4E+63
Worn x Unknown

Fig 3. Parameter estimates from the interaction between COVID-19 test result and protective equipment.

Fig 3

The central dot indicates the posterior median and the whiskers indicate the lower and upper limits of the 95% HDI. The contrasts for which the 95% HDI does not include zero and for which BF10 > 3 (support for the alternative hypothesis) are connected with lines.

Table 6. Contrasts between all levels of participant’s and other avatar’s gender.

Participant’s Gender: Other Avatar’s Gender Contrasts Median 95% HDI BF10
Female Participants: Female Avatar v. Male Avatar 0.36 [-1.35, 0.61] 4.557e-04
Male Participants: Female Avatar v. Male Avatar -0.41 [-1.23, 0.39] 6.761e-04
Female Avatar: Male Participants v. Female Participants -5.09 [-10.06, -0.08] 0.019
Male Avatar: Male Participants v. Female Participants -5.04 [-10.04, -0.11] 0.013
Male Participants x Female Avatar v. Female Participants x Male Avatar -5.45 [-10.40, -0.43] 0.015
Female Participants, Female Avatar v. Male Participants, Male Avatar 4.67 [-0.19, 9.72] 0.01

Analysis of the final model (Model 5) focused on posterior contrasts between all levels of categorical predictors and the slope of continuous predictors. In order to quantify the uncertainty and magnitude of effects, we computed the 95% highest density interval (HDI). Any parameter value inside the HDI has higher probability density than any parameter value outside the HDI [54]. However, the credible interval is conditional on H1 being true and quantifies the strength of an effect, assuming it is present [55]. To quantify evidence for presence or absence of the effects, we computed the Bayes factors [42]. The BF quantifies the relative predictive performance of two rival hypotheses, and represents the degree to which data require a change in beliefs concerning the relative plausibility hypotheses [55]. A common rule of thumb is the following: BF10 > 3 indicates support for the alternative hypothesis and BF10 < 0.333 suggests support for the null hypothesis [55].

We found strong evidence that the preferred IPD was shorter for the Negative-diagnosed avatar in comparison with the Positive-diagnosed (estimate = -27.90, HDI [-28.65, -27.11], BF10 = 3.526e+97, see Fig 3) and with the Unknown-diagnosed avatar (estimate -11.37, HDI [-12.13, -10.59], BF10 = 9.795e+42). The preferred IPD was larger for the Positive-diagnosed compared to the Unknown-diagnosed (estimate 16.52, HDI [15.76, 17.30], BF10 = 1.458e+47). The preferred IPD was shorter for the Worn Protective Equipment condition compared to the Not Worn Protective Equipment condition (estimate = -6.58, HDI [-7.67, -5.50], BF10 = 1.08E+11). This effect was present when considering the Negative-diagnosed avatar, (estimate = -6.58, HDI [-7.67, -5.50], BF10 = 2.68E+09), the Unknown-diagnosed avatar (estimate = -6.41, HDI [-7.48, -5.30], BF10 = 8.81E+08) and Positive-diagnosed avatar (estimate = -7.60, HDI [-8.69, -6.52], BF10 = 1.08E+13).

We also found non-zero effects for Participant’s Gender and Virtual Contact. However, in both cases the Bayes factor indicated moderate evidence in support of the null hypothesis: the preferred IPD was larger for women compared to men (estimate = 5.08, HDI [0.08, 10.06], BF10 = 0.02) and for participants who had Infrequent Virtual Contact during the two weeks prior to participation compared to participants who had Frequent Virtual Contact (estimate = -8.71, HDI [-14.23, -3.07], BF10 = 0.28). No other credible effects were found.

Discussion

Interpersonal distance of at least 1 m is a fundamental measure of containment for the spreading of SARS-CoV-2. Adherence to this measure represents a dramatic change from people’s behavior under normal circumstances. As of now, the dispositional and situational factors that impact adherence to this rule are under-investigated. In this study, we explored the role of protective equipment, actual risk of infection, perceived vulnerability, severity of the situation, physical and virtual contacts, morality, attitudes toward quarantine, and prosocial tendencies in the regulation of IPD during the COVID-19 outbreak. Using a model selection approach, we aimed to identify the most relevant variables to predict IPD behavior. In line with previous studies that investigated the distance maintained from infected individuals [17, 18], we found strong evidence that providing information regarding a positive COVID-19 test result increased IPD. In particular, we found a continuous increase in the space that participants put between themselves and another person, with the shortest distance reported in association with a negative-tested individual, a medium distance observed when the other individual had an unknown-test result, and a maximum distance when the other person tested positive to COVID-19. These results may reflect the notion of “behavioral immune system” [56], according to which humans use behavioral avoidance of disease-causing objects and people as a disease-management strategy. The evidence that our three different conditions are associated with a continuously increasing space between participants and the another person suggests that the purported behavioral immune system may be regulated by a probabilistic inference about risk [57]: the higher the perceived risk, the larger the IPD. Indeed, when participants were not informed about the other person’s COVID-19 test result (i.e., Unknown condition) they might have relied on the conviction that the other had a 50% chance of being infected, thus placing themselves between the more extreme conditions (where a 0% risk is associated with the Negative condition and an estimated 100% risk to the Positive one).

We also found strong evidence that interacting with someone who was wearing protective equipment was associated with reduced IPD. This result is consistent with the findings of other studies conducted during the COVID-19 pandemic that used different methodologies [19, 20]. Specifically, Iachini and colleagues [20] used an 8-point Likert scale (ranging from 1 = 0.5 m to 8 = 4 m) and found that the comfort-distance from others wearing a mask was shorter than the one from others without a mask. Cartaud and colleagues [19] used characters showing either positive, neutral, or negative facial expression or wearing a mask (which was always associated to a neutral facial expression). Characters were presented at different fixed distances from participants. Results showed that shorter IPD was judged as more appropriate for the characters wearing a mask compared to the other conditions; these characters were also perceived as more trustworthy. It has been suggested that the sight of a mask could induce a feeling of safety that facilitates a reduction of IPD. Enactment of this tendency in real-life situations may constitute a potential threat, since the use of protective equipment alone is not enough to prevent SARS-CoV-2 from spreading [21]. Therefore, one question that remained unanswered is whether the reduction of IPD in response to the sight of protective equipment also occurs when there is an actual risk of infection. Importantly, at variance with the previous studies, we observed that the effect of mask wearing is present not only when participants are not provided with information regarding the other person’s COVID-19 test result, but also when they are provided with information of a positive diagnosis. In public settings, allowing a shorter IPD to a person wearing protective equipment may create conditions for further transmission of the new coronavirus.

Among other predictors, Virtual Contact had a non-zero effect, meaning that frequent virtual contact led to larger IPD compared to infrequent virtual contact. However, it is worth noting that the Bayes factor analysis did not reveal support for this effect. According to the contact hunger hypothesis, the type of social isolation individuals may experience during the pandemic could lead to an enhanced need for physical contact [22]. Indeed, affiliation and contact-seeking are core responses to perceived danger [58, 59], and this may happen even in cases where contact itself is a threat, as in infectious diseases. It is possible that engaging in frequent virtual contacts may have modulated this evolutionary drive, leading to lower motivation for interpersonal connection in comparison to those who experienced infrequent virtual contact. Future studies should systematically investigate the effect of virtual contact’s quantity and quality in modulating IPD during social isolation.

Overall, women kept a larger distance from others compared to men, although Bayes factor analysis did not show decisive support for this effect. Women, indeed, tend to exhibit more defensive behavior during interactions with strangers [5, 60]. Interestingly, this result, which requires further investigation, is in line with research on gender differences in the pandemic response, which showed that men’s belief of being gravely affected by COVID-19 is reduced with respect to women [61]. Additionally, men appear to be less likely to comply with preventive behaviors [62]. Contrary to previous evidence [13, 15], participant’s sexual orientation did not modulate the gender differences, suggesting that, in the context of a pandemic, its relevance may be reduced.

It should be noted that, because this study is based on hypothetical choices, we cannot provide a conclusive answer to the question of how people regulate IPD during the spread of an infectious disease. Although in the domain of physical distancing there is evidence that self-report measures are correlated with actual behavior [61], it is difficult to rule out the influence of social desirability bias and thus the present findings must be replicated in a more ecological context.

Moreover, future studies are needed to clarify whether the reduction of IPD following the sight of worn protective equipment is present across different public contexts (i.e., hospitals, supermarkets) and whether this effect is dependent on the social encoding of the other person. Finally, the results of our study must be considered in light of recent neuroscientific evidence [63], which shows that IPD regulation may be rooted in the peripersonal space representation (the multisensory motor area within which it is possible to reach and interact with objects [64]). Indeed, Vieira and colleagues [65] showed that distance from other organisms (conspecifics or not) is regulated by a network that includes the midbrain periaqueductal gray (a region sensitive to threat proximity and involved in defensive behaviors) and frontoparietal structures representing peripersonal space. Future neuroimaging studies may allow to investigate whether the reduction of IPD associated to seeing another person wearing a mask reflects a modulation of the activity in the above network, therefore supporting the hypothesis of a reduced perceived threat.

Supporting information

S1 File. Supplemental information of: A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak.

(DOCX)

Data Availability

All the data and codes for the analysis are available from the Mendeley repository: https://data.mendeley.com/datasets/jw3sbz2nkv/1 (DOI: 10.17632/jw3sbz2nkv.1).

Funding Statement

This work was supported by a European Research Council (ERC, https://erc.europa.eu/) Advanced Grant 2017, Embodied Honesty in real world and digital interactions (eHONESTY) to SMA (grant number 789058), Avvio alla Ricerca (2019) awarded by La Sapienza University of Rome (https://www.uniroma1.it/en) to MF (grant number AR21916B88690F78), Avvio alla Ricerca (2020) awarded by La Sapienza University of Rome to MPL (grant number AR120172B17A70D1). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Bahl P, Doolan C, de Silva C, Chughtai AA, Bourouiba L, MacIntyre CR. Airborne or Droplet Precautions for Health Workers Treating Coronavirus Disease 2019? J Infect Dis. 2020; jiaa189. doi: 10.1093/infdis/jiaa189. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.World Health Organization. Available from: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public. 2021.
  • 3.Chu DK, Akl EA, Duda S, Solo K, Yaacoub S, Schünemann HJ, et al. Physical distancing, face masks, and eye protection to prevent person-to-person transmission of SARS-CoV-2 and COVID-19: a systematic review and meta-analysis. Lancet. 2020;395: 1973–1987. doi: 10.1016/S0140-6736(20)31142-9 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Hecht H, Welsch R, Viehoff J, Longo MR. The shape of personal space. Acta Psychol (Amst). 2019;193: 113–122. doi: 10.1016/j.actpsy.2018.12.009 . [DOI] [PubMed] [Google Scholar]
  • 5.Sorokowska A, Sorokowski P, Hilpert P, Cantarero K, Frackowiak T, Ahmadi K, et al. Preferred Interpersonal Distances: A Global Comparison. J Cross Cult Psychol. 2017;48: 577–592. doi: 10.1177/0022022117698039 [DOI] [Google Scholar]
  • 6.Bavel JJV, Baicker K, Boggio PS, Capraro V, Cichocka A, Cikara M, et al. Using social and behavioural science to support COVID-19 pandemic response. Nat Hum Behav. 2020;4: 460–471. doi: 10.1038/s41562-020-0884-z . [DOI] [PubMed] [Google Scholar]
  • 7.Capraro V, Boggio P, Böhm R, Perc M, Sjåstad H. Cooperation and acting for the greater good during the COVID-19 pandemic. In: Miller MK, editor. The Social Science of the COVID-19 Pandemic: A Call to Action for Researchers. Oxford University Press.; Forthcoming. doi: 10.31234/osf.io/65xmg [DOI] [Google Scholar]
  • 8.VandenBos GR. APA dictionary of psychology. American Psychological Association; 2007. [Google Scholar]
  • 9.Hall ET. The hidden dimension. Doubleday & Co.; 1966. [Google Scholar]
  • 10.Hayduk LA. Personal space: An evaluative and orienting overview. Psychol Bull. 1978;85: 117–134. doi: 10.1037/0033-2909.85.1.117 [DOI] [Google Scholar]
  • 11.Vagnoni E, Lewis J, Tajadura-Jiménez A, Cardini F. Listening to a conversation with aggressive content expands the interpersonal space. PLoS ONE. 2018;13: e0192753. doi: 10.1371/journal.pone.0192753. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Cartaud A, Ruggiero G, Ott L, Iachini T, Coello Y. Physiological Response to Facial Expressions in Peripersonal Space Determines Interpersonal Distance in a Social Interaction Context. Front Psychol. 2018;9: 657. doi: 10.3389/fpsyg.2018.00657. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Welsch R, von Castell C, Rettenberger M, Turner D, Hecht H, Fromberger P. Sexual attraction modulates interpersonal distance and approach-avoidance movements towards virtual agents in males. PLoS ONE. 2020;15: e0231539. doi: 10.1371/journal.pone.0231539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Iachini T, Pagliaro S, Ruggiero G. Near or far? It depends on my impression: Moral information and spatial behavior in virtual interactions. Acta Psychol (Amst). 2015;161: 131–136. doi: 10.1016/j.actpsy.2015.09.003 . [DOI] [PubMed] [Google Scholar]
  • 15.Lisi MP, Fusaro M, Tieri G, Aglioti SM. Humans adjust virtual comfort-distance towards an artificial agent depending on their sexual orientation and implicit prejudice against gay men. Comput Human Behav. 2021;125: 106948. doi: 10.1016/j.chb.2021.106948 [DOI] [Google Scholar]
  • 16.Sommer R. Personal space in a digital age. In: Bechtel RB, Churchman A, editors. Handbook of environmental psychology. John Wiley & Sons, Inc.; 2002. pp. 647–660. [Google Scholar]
  • 17.Mooney KM, Cohn ES, Swift MB. Physical Distance and AIDS: Too Close for Comfort?1. J Appl Social Psychol. 1992;22: 1442–1452. doi: 10.1111/j.1559-1816.1992.tb00959.x [DOI] [Google Scholar]
  • 18.Toppenberg HL, Bos AER, Ruiter RAC, Wigboldus DHJ, Pryor JB. HIV-related stigma in social interactions: Approach and avoidance behaviour in a virtual environment: HIV-related stigma in social interactions. Eur J Soc Psychol. 2015;45: 169–179. doi: 10.1002/ejsp.2082 [DOI] [Google Scholar]
  • 19.Cartaud A, Quesque F, Coello Y. Wearing a face mask against Covid-19 results in a reduction of social distancing. PLoS ONE. 2020;15: e0243023. doi: 10.1371/journal.pone.0243023. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Iachini T, Frassinetti F, Ruotolo F, Sbordone FL, Ferrara A, Arioli M, et al. Social Distance during the COVID-19 Pandemic Reflects Perceived Rather Than Actual Risk. IJERPH. 2021;18: 5504. doi: 10.3390/ijerph18115504. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.World Health Organization. Rational use of personal protective equipment for coronavirus disease (‎COVID-19)‎ and considerations during severe shortages: interim guidance. Available from: https://apps.who.int/iris/handle/10665/331695. 6Apr2020. [Google Scholar]
  • 22.Dezecache G, Frith CD, Deroy O. Pandemics and the great evolutionary mismatch. Curr Biol. 2020;30: R417–R419. doi: 10.1016/j.cub.2020.04.010 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Shim E, Chapman GB, Townsend JP, Galvani AP. The influence of altruism on influenza vaccination decisions. J R Soc Interface. 2012;9: 2234–2243. doi: 10.1098/rsif.2012.0115 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Campos-Mercade P, Meier AN, Schneider FH, Wengström E. Prosociality predicts health behaviors during the COVID-19 pandemic. Journal of Public Economics. 2021;195: 104367. doi: 10.1016/j.jpubeco.2021.104367. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Pfattheicher S, Nockur L, Böhm R, Sassenrath C, Petersen MB. The Emotional Path to Action: Empathy Promotes Physical Distancing and Wearing of Face Masks During the COVID-19 Pandemic. Psychol Sci. 2020;31: 1363–1373. doi: 10.1177/0956797620964422 . [DOI] [PubMed] [Google Scholar]
  • 26.Heffner J, Vives M-L, FeldmanHall O. Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic. Pers Individ Dif. 2021;170: 110420. doi: 10.1016/j.paid.2020.110420. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Iachini T, Coello Y, Frassinetti F, Senese VP, Galante F, Ruggiero G. Peripersonal and interpersonal space in virtual and real environments: Effects of gender and age. J Environ Psychol. 2016;45: 154–164. doi: 10.1016/j.jenvp.2016.01.004 [DOI] [Google Scholar]
  • 28.Layden EA, Cacioppo JT, Cacioppo S. Loneliness predicts a preference for larger interpersonal distance within intimate space. PLoS ONE. 2018;13: e0203491. doi: 10.1371/journal.pone.0203491. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Park JH, Isherwood E. Effects of Concerns About Pathogens on Conservatism and Anti-Fat Prejudice: Are They Mediated by Moral Intuitions? J Soc Psychol. 2011;151: 391–394. doi: 10.1080/00224545.2010.481692 . [DOI] [PubMed] [Google Scholar]
  • 30.Vehtari A, Gelman A, Gabry J. Practical Bayesian model evaluation using leave-one-out cross-validation and WAIC. Stat Comput. 2017;27: 1413–1432. doi: 10.1007/s11222-016-9696-4 [DOI] [Google Scholar]
  • 31.Campbell JID, Thompson VA. MorePower 6.0 for ANOVA with relational confidence intervals and Bayesian analysis. Behav Res. 2012;44: 1255–1265. doi: 10.3758/s13428-012-0186-0 [DOI] [PubMed] [Google Scholar]
  • 32.Palan S, Schitter C. Prolific.ac—A subject pool for online experiments. J Behav Exp Finance. 2018;17: 22–27. doi: 10.1016/j.jbef.2017.12.004 [DOI] [Google Scholar]
  • 33.Hale T, Angrist N, Kira B, Petherick A, Philips T, Webster S. Variation in Government Responses to COVID-19 Version 6.0. Blavatnik School of Government Working Paper. 25May2020. Available from: www.bsg.ox.ac.uk/covidtracker. [Google Scholar]
  • 34.Stoet G. PsyToolkit: A software package for programming psychological experiments using Linux. Behav Res Methods. 2010;42: 1096–1104. doi: 10.3758/BRM.42.4.1096 . [DOI] [PubMed] [Google Scholar]
  • 35.Stoet G. PsyToolkit: A Novel Web-Based Method for Running Online Questionnaires and Reaction-Time Experiments. Teach Psychol. 2017;44: 24–31. doi: 10.1177/0098628316677643 [DOI] [Google Scholar]
  • 36.Graham J, Nosek BA, Haidt J, Iyer R, Koleva S, Ditto PH. Mapping the moral domain. J Pers Soc Psychol. 2011;101: 366–385. doi: 10.1037/a0021847 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Graham J, Haidt J, Nosek BA. Liberals and conservatives rely on different sets of moral foundations. J Pers Soc Psychol. 2009;96: 1029–1046. doi: 10.1037/a0015141 . [DOI] [PubMed] [Google Scholar]
  • 38.Duncan LA, Schaller M, Park JH. Perceived vulnerability to disease: Development and validation of a 15-item self-report instrument. Pers Individ Dif. 2009;47: 541–546. doi: 10.1016/j.paid.2009.05.001 [DOI] [Google Scholar]
  • 39.Tracy CS, Rea E, Upshur RE. Public perceptions of quarantine: community-based telephone survey following an infectious disease outbreak. BMC Public Health. 2009;9: 470. doi: 10.1186/1471-2458-9-470. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Rushton JP, Chrisjohn RD, Cynthia Fekken G. The altruistic personality and the self-report altruism scale. Pers Individ Dif. 1981;2: 293–302. doi: 10.1016/0191-8869(81)90084-2 [DOI] [Google Scholar]
  • 41.Kinsey AC, Pomeroy WR, Martin CE. Sexual Behavior in the Human Male. Am J Public Health. 2003;93: 894–898. doi: 10.2105/ajph.93.6.894 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Keysers C, Gazzola V, Wagenmakers E-J. Using Bayes factor hypothesis testing in neuroscience to establish evidence of absence. Nat Neurosci. 2020;23: 788–799. doi: 10.1038/s41593-020-0660-4 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.R Core Team. R: A language and environment for statistical computing. 2013. [Google Scholar]
  • 44.RStudio Team. RStudio: integrated development for R. 2015. Available from: http://www.rstudio.com. [Google Scholar]
  • 45.Wickham H, Averick M, Bryan J, Chang W, McGowan L, François R, et al. Welcome to the Tidyverse. JOSS. 2019;4: 1686. doi: 10.21105/joss.01686 [DOI] [Google Scholar]
  • 46.Bürkner P-C. brms : An R Package for Bayesian Multilevel Models Using Stan. J Stat Soft. 2017;80. doi: 10.18637/jss.v080.i01 [DOI] [Google Scholar]
  • 47.Carpenter B, Gelman A, Hoffman MD, Lee D, Goodrich B, Betancourt M, et al. Stan : A Probabilistic Programming Language. J Stat Soft. 2017;76. doi: 10.18637/jss.v076.i01 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Lenth R, Singmann H, Love J, Buerkner P, Herve M. Emmeans: Estimated marginal means, aka least-squares means. 2018;R package version: 3. [Google Scholar]
  • 49.Makowski D, Ben-Shachar M, Lüdecke D. bayestestR: Describing Effects and their Uncertainty, Existence and Significance within the Bayesian Framework. JOSS. 2019;4: 1541. doi: 10.21105/joss.01541 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Raudenbush SW, Bryk AS. Hierarchical linear models: Applications and data analysis methods. Sage; 2002. [Google Scholar]
  • 51.Weakliem DL. A Critique of the Bayesian Information Criterion for Model Selection. Sociol Methods Res. 1999;27: 359–397. doi: 10.1177/0049124199027003002 [DOI] [Google Scholar]
  • 52.de Laplace PS. Essai philosophique sur les probabilités. Bachelier; 1825. [Google Scholar]
  • 53.Vehtari A, Gelman A, Simpson D, Carpenter B, Bürkner P-C. Rank-Normalization, Folding, and Localization: An Improved Rˆ for Assessing Convergence of MCMC. Bayesian Anal. 2021;1. doi: 10.1214/20-BA1221 [DOI] [Google Scholar]
  • 54.Kruschke JK, Liddell TM. The Bayesian New Statistics: Hypothesis testing, estimation, meta-analysis, and power analysis from a Bayesian perspective. Psychon Bull Rev. 2018;25: 178–206. doi: 10.3758/s13423-016-1221-4 . [DOI] [PubMed] [Google Scholar]
  • 55.van Doorn J, van den Bergh D, Böhm U, Dablander F, Derks K, Draws T, et al. The JASP guidelines for conducting and reporting a Bayesian analysis. Psychon Bull Rev. 2020. doi: 10.3758/s13423-020-01798-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Ackerman JM, Hill SE, Murray DR. The behavioral immune system: Current concerns and future directions. Soc Personal Psychol Compass. 2018;12: e12371. doi: 10.1111/spc3.12371 [DOI] [Google Scholar]
  • 57.Ackerman JM, Merrell WN, Choi S. What people believe about detecting infectious disease using the senses. CRESP. 2020;1: 100002. doi: 10.1016/j.cresp.2020.100002 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Dezecache G, Grèzes J, Dahl CD. The nature and distribution of affiliative behaviour during exposure to mild threat. R Soc open sci. 2017;4: 170265. doi: 10.1098/rsos.170265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Mawson AR. Mass panic and social attachment: The dynamics of human behavior. Routledge; 2017. [Google Scholar]
  • 60.Iachini T, Coello Y, Frassinetti F, Ruggiero G. Body Space in Social Interactions: A Comparison of Reaching and Comfort Distance in Immersive Virtual Reality. PLoS ONE. 2014;9: e111511. doi: 10.1371/journal.pone.0111511. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Capraro V, Barcelo H. The effect of messaging and gender on intentions to wear a face covering to slow down COVID-19 transmission. JBEP. 2020;4, Special Issue 2: 45–55. doi: 10.31234/osf.io/tg7vz [DOI] [Google Scholar]
  • 62.Olcaysoy Okten I, Gollwitzer A, Oettingen G. Gender Differences in Preventing the Spread of Coronavirus. 2020. Available from: https://behavioralpolicy.org/articles/gender-differences-in-preventing-the-spread-of-coronavirus/. [Google Scholar]
  • 63.Coello Y, Cartaud A. The Interrelation Between Peripersonal Action Space and Interpersonal Social Space: Psychophysiological Evidence and Clinical Implications. Front Hum Neurosci. 2021;15: 636124. doi: 10.3389/fnhum.2021.636124. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.di Pellegrino G, Làdavas E. Peripersonal space in the brain. Neuropsychologia. 2015;66: 126–133. doi: 10.1016/j.neuropsychologia.2014.11.011 . [DOI] [PubMed] [Google Scholar]
  • 65.Vieira JB, Pierzchajlo SR, Mitchell DGV. Neural correlates of social and non-social personal space intrusions: Role of defensive and peripersonal space systems in interpersonal distance regulation. Soc Neurosci. 2020;15: 36–51. doi: 10.1080/17470919.2019.1626763 . [DOI] [PubMed] [Google Scholar]

Decision Letter 0

Valerio Capraro

26 Mar 2021

PONE-D-21-03526

A Bayesian approach to reveal the key role of mask wearing in modulating interpersonal distance during the first COVID-19 outbreak

PLOS ONE

Dear Dr. Lisi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please find below the reviewers' comments, as well as those of mine.

Please submit your revised manuscript by May 10 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Valerio Capraro

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. If materials, methods, and protocols are well established, authors may cite articles where those protocols are described in detail, but your submission should include sufficient information to be understood independent of these references (https://journals.plos.org/plosone/s/submission-guidelines#loc-materials-and-methods).

Additional Editor Comments:

I have now collected three reviews from three experts in the field. All reviewers think that the topic of the paper is important, but their final judgment is split: two recommend major revision, one recommends rejection. The negative review is based on the observation that the method is inappropriate for answering the question, because it is based on hypothetical choices, while the first field experiments on the topic are already coming out. While I understand this reviewer's objection, at the same time I think that also this approach is valuable, especially because there is also some evidence that self-report measures are correlated to actual behavior, at least in the domain of physical distancing (Gollwitzer et al. 2020). Moreover, the field experiment mentioned by the reviewer is a working paper. Therefore, I have decided to follow the majority and invite you to revise your work. Needless to say that all comments must be addressed. In particular, I expect you to try to improve your writing in order to accomodate also the negative reviewer: make explicit the fact that your results are based on hypothetical choices and discuss the limitations of this approach in details and stress the need for future work. Perhaps also the title should be changed in order to make clear that your measure is hypothetical Also, I would like to add a couple more comments regarding the literature review, which I found to be incomplete: (i) the "perspective article" on what social and behavioural science can do to support pandemic response, published by Van Bavel et al in Nature Human Behaviour, could be a useful general reference; (ii) I was surprised to see that you did not review the emerging literature on the role of prosociality on pandemic response. I am aware of at least seven published papers looking at this (Banker et al. 2020; Bilancini et al. 2020; Capraro & Barcelo, 2020; Campos-Mercade et al. 2020; Heffner et al. 2020; Lunn et al. 2020; Pfattheicher et al. 2020).

I am looking forward for the revision.

References

Banker, S., & Park, J. (2020). Evaluating prosocial COVID-19 messaging frames: Evidence from a field study on Facebook. Judgment and Decision Making, 15(6), 1037-1043.

Bilancini E, Boncinelli L, Capraro V, Celadin T, Di Paolo R (2020) The effect of norm-based messages on reading and understanding COVID-19 pandemic response governmental rules. Journal of Behavioral Economics for Policy 4, Special Issue 1, 45-55.

Capraro, V., & Barcelo, H. (2020). The effect of messaging and gender on intentions to wear a face covering to slow down COVID-19 transmission. Journal of Behavioral Economics for Policy, 4, Special Issue 2, 45-55.

Campos-Mercade, P., Meier, A. N., Schneider, F. H., & Wengström, E. (2021). Prosociality predicts health behaviors during the COVID-19 pandemic. Journal of Public Economics, 195, 104367.

Heffner, J., Vives, M. L., & FeldmanHall, O. (2020). Emotional responses to prosocial messages increase willingness to self-isolate during the COVID-19 pandemic. Personality and Individual Differences, 170, 110420.

Lunn, P. D., Timmons, S., Barjaková, M., Belton, C. A., Julienne, H., & Lavin, C. (2020). Motivating social distancing during the Covid-19 pandemic: An online experiment. Social Science & Medicine, 113478.

Pfattheicher, S., Nockur, L., Böhm, R., Sassenrath, C., & Petersen, M. B. (In press). The emotional path to action: Empathy promotes physical distancing during the COVID-19 pandemic. Psychological Science.

Van Bavel, J. J., et al. (2020). Using social and behavioural science to support COVID-19 pandemic response. Nature Human Behaviour, 4, 460-471.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

Reviewer #3: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: No

Reviewer #3: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: I think this is an important question, but ultimately the methods are inappropriate to answer it.

There is better evidence from real-world field experiments along similar lines:

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3641367

Given this, extrapolating from hypothetical choices on laboratory screens seems unnecessary given the many possible differences between this and the real-world. Foremost among them is that respondents are answering what they think experimenters want rather than what they would actually do in practice.

Reviewer #2: The manuscript focuses on a relevant topic concerning a very actual issue as it investigates the effect of protective equipment and knowledge in COVID-19 test results on the regulation of interpersonal distances (IPD). This work is very interesting and important in the context of the COVID-19 pandemic as well as in pandemic context in general. However, I have several concerns about different aspects of the study that I report bellow:

1. I cannot access the data and the codes with the link provided by the authors (which seems to be down). Therefore, I cannot take a look neither at the statistical code nor at the data. This is the reason why I answered “I don’t know” and “No” to question 2 and 3 respectively. This is also the reason why I am recommending major revisions. However, the arguments related to the choice of the statistical analysis in the text are clear and the statistical analysis used is appropriate.

2. In the introduction section, even if Hayduk is mentioned in the text, I think Hall should also be cited, at least when introducing proxemics.

3. The experimental method may not be the best to use (see Hayduk, 1983), although it is quite understandable to use given the sanitary context. As the task is particularly sensitive to expectation bias, how the authors could rule out this potential confound? I noticed the authors mentioned this limitation in the discussion section.

4. P3, l.43. “Although previous research has helped define IPD under normal circumstances, insights on which factors influence the regulation of IPD during a pandemic are lacking”. This sentence is contradictory with the following one (citing studies focusing on different factors influencing IPD during a pandemic).

5. In Table 2:

5.1. Random effects are specified twice in every model except Model 0, why?

5.2. Can the authors explain why they added 2 or 3 variables between Model 2 and 3, 3 and 4 and 4 and 5, rather than adding one variable at the time for the LOO comparison?

6. The authors could write directly in the text that Model 4 is the final model in order to improve the clarity of the manuscript.

7. Table 4: There is a typo: negative sign outside of the hook in the Negative v. Unknown comparison.

8. Table 4 and 5: I think there is a mistake when reporting the results. the Median and 95% HDI of the Negative: Worn v. Not Worn comparison (Table 5) are equal to the Median and 95% HDI of the Protective Equipment comparison Worn v. Not Worn (Table 4, -6.58 [-7.67, -5.50]).

9. I was particularly interested by the results regarding the COVID-19 test results variable (first time reported to my knowledge) and especially by the results of the Unknown condition as it suggests that individuals think about risk in a “probabilistic” way (50% chance the individual is sick: medium distance). I was a little disappointed the authors did not develop more in the discussion section about those results. I think it is a key point of this research.

Reviewer #3: In a web-based experimental study conducted during the first pandemic wave (mid-April 2020), the authors tested preferred interpersonal distance with confederates. The variables explored concerned the role of protective equipment, actual risk of infection, perceived vulnerability, severity of the situation, physical and virtual contacts, morality, attitudes toward quarantine, and prosocial tendencies in the regulation of IPD during the COVID-19 outbreak. The test was based on the Interpersonal Visual Analogue Scale (IVAS), adapted to the present study. Based on Bayesian analysis approach the authors found evidence in favor of a reduction of interpersonal distance towards individuals wearing protective equipment and who tested negative to COVID- 19. Shorter interpersonal distances were also found with confederates wearing protective gear, even when COVID-19 test result was unknown or positive. Individual differences did not modulate significantly interpersonal distances. The protective equipment-related regulation of interpersonal distance may reflect an underestimation of perceived vulnerability to infection. Consequences in terms of collective health-safety measures communication are discussed.

The aim of this study was to investigate whether being at risk of infection or having specific personal characteristics modulates IPD. The effects of variables were tested using a model selection approach embedded in a Bayesian analysis approach. The study was a web-based experimental study, but provided interesting results. I have only few comments relating to the state of the art in the research domain, and the analysis of the data, exposed hereafter.

Introduction

When stating “handwashing and use of face masks have been widely adopted in conjunction with maintaining interpersonal distances of at least 1.5 m”, this is in fact dependent on the country (see for instance https://theprint.in/theprint-essential/1m-1-5m-2m-the-different-levels-of-social-distancing-countries-are-following-amid-covid/449425/)

When indicating “Research in proxemics, the study of interpersonal spatial behavior …” you should quote Hall (1966), who is at the origin of the research field.

When mentioning “IPD is shaped by situational factors such as social threat…” you should mention the demonstration made by Cartaud et al. (2018, Frontiers Psychology),

When indicating “IPD appears to be automatically regulated according to distance-related feelings of personal comfort », you should quote and perhaps discuss the recent model proposed by Coello & Cartaud (2021, Frontiers in Human Neuroscience).

Data analysis

It is not clear why sometimes the model includes one additional variable (Model 2 for instance) and sometimes two (Model 3 for instance).

Please, when discussing the Final Model, indicates that this refers to Model 4.

When discussing Fig 2, please indicate what negative/positive directions correspond to in terms of the measure.

I suggest to indicate which difference is significant in Figure 2. For instance, Gender effect (participants) is significant but this is not clear from the representation used in Figure 2.

You indicate that « IPD was shorter for women compared to men », but Figure 2 shows the opposite.

Discussion

It can be indicated that people wearing a mask are also perceive as more trustworthy (Cartaud et al., 2020).

When indicating “Among the other predictors, only Virtual Contact had a non-zero effect”, this is not in agreement from the information provided in the data analysis section where it is mentioned a “non-zero effects for Participant’s Gender and Virtual Contact”.

The Gender effect is not discussed and seems opposite to what is usually reported in the literature (for instance, Iachini et al., 2016, Journal of Environmental Psychology)

When concluding that “the results of our study must be considered in light of recent neuroscientific evidence, which shows that the distance from other organisms (conspecific or not) is regulated by a common network … representing peripersonal space”. I am not sure about what means “common network” in this sentence. Furthermore, on this issue I recommend the authors to refer to the recent paper by Coello & Cartaud (2021, Frontiers in Human Neuroscience), who propose a new model to account for the relation between IPD and peripersonal space.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Alice Cartaud

Reviewer #3: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Aug 10;16(8):e0255598. doi: 10.1371/journal.pone.0255598.r002

Author response to Decision Letter 0


6 May 2021

We enclose a point-by-point reply to the comments of each reviewer (our responses in bold; additions to the revised MS in bold&red).

Reviewer #1

Ref1#1. I think this is an important question, but ultimately the methods are inappropriate to answer it.

There is better evidence from real-world field experiments along similar lines:

https://papers.ssrn.com/sol3/papers.cfm?abstract_id=3641367

Given this, extrapolating from hypothetical choices on laboratory screens seems unnecessary given the many possible differences between this and the real-world. Foremost among them is that respondents are answering what they think experimenters want rather than what they would actually do in practice.

ARRef1#1:

We acknowledge this approach is generally limited by desirability bias and that our results are based on hypothetical choices. However, our decision to employ a projective method was motivated by: i) sanitary reasons, and ii) the possibility of having full control over the manipulated variables. Also, we believe that had their responses been biased by social desirability, we would expect participants to predict keeping a similar distance from avatars associated with Positive Covid-19 Test Result and from those labelled as Unknown. In fact, the latter condition represented the most realistic situation, as people are not usually aware of the other’s health status and therefore are supposed to maintain a safe distance a priori. Instead, we found that the predicted interpersonal distance from avatars associated with Unknown test results was shorter than the one from avatars showing a Positive diagnosis. This suggests that participants may indeed have provided responses based on their subjective evaluation, and thus they did not just apply the recommended rules of conduct. Additionally, it is worth noting that projective measures of physical distancing have been found to correlate with actual behavior (Gollwitzer et al., 2020).

Nevertheless, to discuss the limitations of our approach, we added the following paragraph to the Discussion section, which now reads (page 26-27, lines 410-415): “It should be noted that, because this study is based on hypothetical choices, we cannot provide a conclusive answer to the question of how people regulate IPD during the spread of an infectious disease. Although in the domain of physical distancing there is evidence that self-report measures are correlated with actual behavior [61], it is difficult to rule out the influence of social desirability bias and thus the present findings must be replicated in a more ecological context.”

We also decided to modify the title by adding the word “projected”, which we believe better describes the hypothetical nature of our task. Thus, the title now reads as follows: “A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak”.

--------------------------------------------------------------------------

Reviewer #2: The manuscript focuses on a relevant topic concerning a very actual issue as it investigates the effect of protective equipment and knowledge in COVID-19 test results on the regulation of interpersonal distances (IPD). This work is very interesting and important in the context of the COVID-19 pandemic as well as in pandemic context in general. However, I have several concerns about different aspects of the study that I report bellow:

We thank the Reviewer for his/her positive evaluation of our work. We addressed his/her points below.

--------------------------------------------------------------------------

Ref2#1. I cannot access the data and the codes with the link provided by the authors (which seems to be down). Therefore, I cannot take a look neither at the statistical code nor at the data. This is the reason why I answered “I don’t know” and “No” to question 2 and 3 respectively. This is also the reason why I am recommending major revisions. However, the arguments related to the choice of the statistical analysis in the text are clear and the statistical analysis used is appropriate

ARRef2#1: We apologize for this mistake. The dataset is now available at the following link: https://data.mendeley.com/datasets/jw3sbz2nkv/1 .

--------------------------------------------------------------------------

Ref2#2. In the introduction section, even if Hayduk is mentioned in the text, I think Hall should also be cited, at least when introducing proxemics.

ARRef2#2: We thank the Reviewer for suggesting this. We now cited Hall when defining interpersonal distance (page 3, lines 41-43): “Research in proxemics, the study of interpersonal spatial behavior [7,8], has defined interpersonal distance (IPD) as the separation zone that individuals keep between themselves and others [9].”

--------------------------------------------------------------------------

Ref2#3. The experimental method may not be the best to use (see Hayduk, 1983), although it is quite understandable to use given the sanitary context. As the task is particularly sensitive to expectation bias, how the authors could rule out this potential confound? I noticed the authors mentioned this limitation in the discussion section.

ARRef2#3: We thank the Reviewer for this comment, which is similar to an issue raised by Reviewer 1.

We acknowledge this approach is generally limited by desirability bias and that our results are based on hypothetical choices. However, our decision to employ a projective method was motivated by: i) sanitary reasons, and ii) the possibility of having full control over the manipulated variables. Also, we believe that had their responses been biased by social desirability, we would expect participants to predict keeping a similar distance from avatars associated with Positive Covid-19 Test Result and from those labelled as Unknown. In fact, the latter condition represented the most realistic situation, as people are not usually aware of the other’s health status and therefore are supposed to maintain a safe distance a priori. Instead, we found that the predicted interpersonal distance from avatars associated with Unknown test results was shorter than the one from avatars showing a Positive diagnosis. This suggests that participants may indeed have provided responses based on their subjective evaluation, and thus they did not just apply the recommended rules of conduct. Additionally, it is worth noting that projective measures of physical distancing have been found to correlate with actual behavior (Gollwitzer et al., 2020).

Nevertheless, to discuss the limitations of our approach, we added the following paragraph to the Discussion section, which now reads (page 26-27, lines 410-415): “It should be noted that, because this study is based on hypothetical choices, we cannot provide a conclusive answer to the question of how people regulate IPD during the spread of an infectious disease. Although in the domain of physical distancing there is evidence that self-report measures are correlated with actual behavior [61], it is difficult to rule out the influence of social desirability bias and thus the present findings must be replicated in a more ecological context.”

We also decided to modify the title by adding the word “projected”, which we believe better describes the hypothetical nature of our task. Thus, the title now reads as follows: “A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak.”

--------------------------------------------------------------------------

Ref2#4. P3, l.43. “Although previous research has helped define IPD under normal circumstances, insights on which factors influence the regulation of IPD during a pandemic are lacking”. This sentence is contradictory with the following one (citing studies focusing on different factors influencing IPD during a pandemic).

ARRef2#4: We thank the Reviewer for this comment, and we apologize for not being clear. We now corrected the sentence (page 3, lines 46-48): “Although previous research has largely investigated IPD under regular circumstances, much less is known about the factors influencing the regulation of IPD during the spread of infectious diseases.”

--------------------------------------------------------------------------

Ref2#5. 5. In Table 2:

5.1. Random effects are specified twice in every model except Model 0, why?

5.2. Can the authors explain why they added 2 or 3 variables between Model 2 and 3, 3 and 4 and 4 and 5, rather than adding one variable at the time for the LOO comparison?

ARRef2#5:

5.1. We thank the Reviewer for identifying this typo. We now reported the correct formula for each model in Table 2.

5.2. We have now reported a new analysis in which just one variable differentiates one model from the following one.

Table 2. Formulas for each model

--------------------------------------------------------------------------

Ref2#6. The authors could write directly in the text that Model 4 is the final model in order to improve the clarity of the manuscript.

ARRef2#6: We thank the Reviewer for suggesting this. In the new analysis, Model 5 is the final one. We added the following sentence to page 14-15, lines 264-267: “Model 5 had the best predictive accuracy and included the same structure of the Primary model plus the main effects of Perceived Severity of the situation in the country, Virtual and Physical Contact, and Perceived Vulnerability to Disease (see Table 3).” For the sake of clarity, we also specified this at page 18, line 284: “Analysis of the final model (Model 5) focused on posterior contrasts between all levels of categorical predictors and the slope of continuous predictors.”

--------------------------------------------------------------------------

Ref2#7. Table 4: There is a typo: negative sign outside of the hook in the Negative v. Unknown comparison.

ARRef2#7: We thank the Reviewer for highlighting this typo which we have now corrected.

--------------------------------------------------------------------------

Ref2#8. Table 4 and 5: I think there is a mistake when reporting the results. the Median and 95% HDI of the Negative: Worn v. Not Worn comparison (Table 5) are equal to the Median and 95% HDI of the Protective Equipment comparison Worn v. Not Worn (Table 4, -6.58 [-7.67, -5.50]).

ARRef2#8: We thank the Reviewer for this comment. However, we double-checked this result, and it is correct.

--------------------------------------------------------------------------

Ref2#9. I was particularly interested by the results regarding the COVID-19 test results variable (first time reported to my knowledge) and especially by the results of the Unknown condition as it suggests that individuals think about risk in a “probabilistic” way (50% chance the individual is sick: medium distance). I was a little disappointed the authors did not develop more in the discussion section about those results. I think it is a key point of this research.

ARRef2#9: We thank the Reviewer for pointing out this. We know expanded this point in the Discussion section (page 24-25, lines 354-368), which currently reads: “In particular, we found a continuous increase in the space that participants put between themselves and another person, with the shortest distance reported in association with a negative-tested individual, a medium distance observed when the other individual had an unknown-test result, and a maximum distance when the other person tested positive to COVID-19. These results may reflect the notion of “behavioral immune system” [54], according to which humans use behavioral avoidance of disease-causing objects and people as a disease-management strategy. The evidence that our three different conditions are associated with a continuously increasing space between participants and the another person suggests that the purported behavioral immune system may be regulated by a probabilistic inference about risk [55]: the higher the perceived risk, the larger the IPD. Indeed, when participants were not informed about the other person’s COVID-19 test result (i.e., Unknown condition) they might have relied on the conviction that the other had a 50% chance of being infected, thus placing themselves between the more extreme conditions (where a 0% risk is associated with the Negative condition and an estimated 100% risk to the Positive one).”

--------------------------------------------------------------------------

Reviewer #3: In a web-based experimental study conducted during the first pandemic wave (mid-April 2020), the authors tested preferred interpersonal distance with confederates. The variables explored concerned the role of protective equipment, actual risk of infection, perceived vulnerability, severity of the situation, physical and virtual contacts, morality, attitudes toward quarantine, and prosocial tendencies in the regulation of IPD during the COVID-19 outbreak. The test was based on the Interpersonal Visual Analogue Scale (IVAS), adapted to the present study. Based on Bayesian analysis approach the authors found evidence in favor of a reduction of interpersonal distance towards individuals wearing protective equipment and who tested negative to COVID- 19. Shorter interpersonal distances were also found with confederates wearing protective gear, even when COVID-19 test result was unknown or positive. Individual differences did not modulate significantly interpersonal distances. The protective equipment-related regulation of interpersonal distance may reflect an underestimation of perceived vulnerability to infection. Consequences in terms of collective health-safety measures communication are discussed.

The aim of this study was to investigate whether being at risk of infection or having specific personal characteristics modulates IPD. The effects of variables were tested using a model selection approach embedded in a Bayesian analysis approach. The study was a web-based experimental study, but provided interesting results. I have only few comments relating to the state of the art in the research domain, and the analysis of the data, exposed hereafter.

We thank the Reviewer for his/her positive evaluation of our work.

--------------------------------------------------------------------------

Ref3#1. Introduction

When stating “handwashing and use of face masks have been widely adopted in conjunction with maintaining interpersonal distances of at least 1.5 m”, this is in fact dependent on the country (see for instance https://theprint.in/theprint-essential/1m-1-5m-2m-the-different-levels-of-social-distancing-countries-are-following-amid-covid/449425/)

ARRef3#1: We thank the Reviewer for this suggestion. We corrected this erroneous information in the abstract (page 2, lines 3-5): “The interpersonal distance of at least 1 m recommended as a relevant measure for COVID-19 contagion containment requires a significant change in everyday behavior.”

We also accordingly corrected this in the introduction (page 3, lines 29-36). The sentence now reads as follows: “These closures and other measures of transmission containment, such as handwashing and use of face masks [2], have been widely adopted in conjunction with maintaining interpersonal distances of at least 1 m [3]. The need to regulate the minimum distance during in-person interactions is justified by the observation that, although humans tend to keep themselves at about 1 m from unfamiliar individuals [4], this distance reduces when interacting with acquaintances and friends [5]. Crucially this pattern seems to hold across different countries [5], suggesting that the imposed governmental measures sought to change a globally established, everyday behavior”

Lastly, we corrected the information in the discussion (page 24, lines 344-345): “Interpersonal distance of at least 1 m is a fundamental measure of containment for the spreading of SARS-CoV-2.”

--------------------------------------------------------------------------

Ref3#2. When indicating “Research in proxemics, the study of interpersonal spatial behavior …” you should quote Hall (1966), who is at the origin of the research field.

ARRef3#2: We thank the Reviewer for this comment. We now cited Hall when defining interpersonal distance (page 3, lines 41-43): “Research in proxemics, the study of interpersonal spatial behavior [7,8], has defined interpersonal distance (IPD) as the separation zone that individuals keep between themselves and others [9].”

--------------------------------------------------------------------------

Ref3#3. When mentioning “IPD is shaped by situational factors such as social threat…” you should mention the demonstration made by Cartaud et al. (2018, Frontiers Psychology),

ARRef3#3: We thank the Reviewer for this suggestion. We now cited Cartaud et al., 2018 at page 3, line 43.

--------------------------------------------------------------------------

Ref3#4. When indicating “IPD appears to be automatically regulated according to distance-related feelings of personal comfort », you should quote and perhaps discuss the recent model proposed by Coello & Cartaud (2021, Frontiers in Human Neuroscience).

ARRef3#4: We thank the Reviewer for this suggestion. We believe that this reference better fits our Discussion section, when examining possible future directions such as the investigation of the neural basis of IPD regulation (page 27, lines 419-428, see ARRef3#13).

--------------------------------------------------------------------------

Ref3#5. Data analysis

It is not clear why sometimes the model includes one additional variable (Model 2 for instance) and sometimes two (Model 3 for instance).

ARRef3#5: We apologize for the lack of clarity on this point. We have now reported the corrected analysis, where only one variable was additionally included in each model.

--------------------------------------------------------------------------

Ref3#6. Please, when discussing the Final Model, indicates that this refers to Model 4.

ARRef3#6: We thank the Reviewer for suggesting this. In the new analysis, Model 5 is the final one. We added the following sentence to page 14-15, lines 264-267: “Model 5 had the best predictive accuracy and included the same structure of the Primary model plus the main effects of Perceived Severity of the situation in the country, Virtual and Physical Contact, and Perceived Vulnerability to Disease (see Table 3).” For the sake of clarity, we also specified this at page 18, line 284: “Analysis of the final model (Model 5) focused on posterior contrasts between all levels of categorical predictors and the slope of continuous predictors.”

--------------------------------------------------------------------------

Ref3#7. When discussing Fig 2, please indicate what negative/positive directions correspond to in terms of the measure.

ARRef3#7: We now specified this (page 23, lines 325-335):

“Fig.2 Probability of direction and the magnitude of the effect for each predictor included in the study.

The y-axis indicates the predictors and the x-axis indicates the possible parameter values. The color indicates the direction of the effect: black stands for a negative direction (reduction of IPD), while gray represents a positive direction (enlargement of IPD). The effect of the parameters included in the final model where HDI are completely outside of zero are marked with either “-” (if the direction of the effect is negative) or “+” (if the direction of the effect is positive). The interaction between COVID-19 Test Result and Protective Equipment and the interaction between Participant’s Gender and Other Avatar’s Gender are better explained by the contrasts between all levels of the factors (COVID-19 Test Result: Protective Equipment see Table 4 and Fig 3; Participant’s Gender: Other Avatar’s Gender see Table 5).

--------------------------------------------------------------------------

Ref3#8. I suggest to indicate which difference is significant in Figure 2. For instance, Gender effect (participants) is significant but this is not clear from the representation used in Figure 2.

ARRef3#8: We thank the Reviewer for this comment. We now report the non-zero effects in Figure 2 with a “-” symbol when the direction of the effect is negative and a “+” symbol when the direction is positive. See above (ARRef3#7) for the modified caption of Fig 2.

--------------------------------------------------------------------------

Ref3#9. You indicate that « IPD was shorter for women compared to men », but Figure 2 shows the opposite.

ARRef3#9: We apologize for this mistake. We now corrected it (pages 19, lines 307-309): “the preferred IPD was larger for women compared to men (estimate= 5.08, HDI [0.08, 10.06], BF10 = 0.02)”.

--------------------------------------------------------------------------

Ref3#10. Discussion

It can be indicated that people wearing a mask are also perceive as more trustworthy (Cartaud et al., 2020).

ARRef3#10: We thank the Reviewer for suggesting this. We now added the following sentence to our Discussion (page 25, lines 377-379): “Results showed that shorter IPD was judged as more appropriate for the characters wearing a mask compared to the other conditions; these characters were also perceived as more trustworthy.”

--------------------------------------------------------------------------

Ref3#11. When indicating “Among the other predictors, only Virtual Contact had a non-zero effect”, this is not in agreement from the information provided in the data analysis section where it is mentioned a “non-zero effects for Participant’s Gender and Virtual Contact”.

ARRef3#11: We apologize for not being clear on this. The sentence now reads as follows (page 26, line 390-391): “Among other predictors, Virtual Contact had a non-zero effect, meaning that frequent virtual contact led to larger IPD compared to infrequent virtual contact.” Moreover, we also discussed the effect of Gender in the following paragraph (see ARRef3#12).

--------------------------------------------------------------------------

Ref3#12. The Gender effect is not discussed and seems opposite to what is usually reported in the literature (for instance, Iachini et al., 2016, Journal of Environmental Psychology)

ARRef3#12: We thank the Reviewer for pointing this out. Regarding the main effect of the Participant’s Gender, what we found is in accordance with the relevant literature, as female (vs male) participants tend to show larger interpersonal distance when interacting with strangers (Iachini et al., 2014; Sorokowska et al., 2017). The opposite trend is generally found for the Confederate’s Gender, as participants of both genders tend to keep a shorter distance from female confederates compared to male ones (Iachini et al., 2016). In this new version of the MS, we now discuss the main effect of Participant’s Gender by taking into account the traditional literature as well as evidence regarding gender differences in the pandemic response. For example, evidence shows that men are less likely to believe that contracting the coronavirus may have serious consequences for them (Capraro & Barcelo 2020), and overall, they tend to comply less with preventive behaviors compared to women (Olcaysoy et al.,2020). Considering that recent evidence shows that the Gender effects are modulated by the sexual orientation of individuals (Welsch et al., 2020; Lisi et al., 2021) we also added a new model (Model 10) which includes a three-level interaction between Participant’s Gender, Other Avatar’s Gender and Participant’s Sexual Orientation (see ARRef2#5). This model, however, did not significantly improve the fit.

The new paragraph now reads as follows (page 26, lines 401-409): “Overall, women kept a larger distance from others compared to men, although Bayes factor analysis did not show decisive support for this effect. Women, indeed, tend to exhibit more defensive behavior during interactions with strangers [5,58]. Interestingly, this result, which requires further investigation, is in line with research on gender differences in the pandemic response, which showed that men’s belief of being gravely affected by COVID-19 is reduced with respect to women [59]. Additionally, men appear to be less likely to comply with preventive behaviors [60]. Contrary to previous evidence [12,14], participant’s sexual orientation did not modulate the gender differences, suggesting that, in the context of a pandemic, its relevance may be reduced.”

--------------------------------------------------------------------------

Ref3#13. When concluding that “the results of our study must be considered in light of recent neuroscientific evidence, which shows that the distance from other organisms (conspecific or not) is regulated by a common network … representing peripersonal space”. I am not sure about what means “common network” in this sentence. Furthermore, on this issue I recommend the authors to refer to the recent paper by Coello & Cartaud (2021, Frontiers in Human Neuroscience), who propose a new model to account for the relation between IPD and peripersonal space.

ARRef3#13: We thank the Reviewer for this suggestion, and we apologize for an inaccurate use of the term “common”. We have now referred to the perspective paper by Coello & Cartaud (2021, Frontiers in Human Neuroscience) and the paragraph reads as follows (page 27, lines 419-428): “Finally, the results of our study must be considered in light of recent neuroscientific evidence [61], which shows that IPD regulation may be rooted in the peripersonal space representation (the multisensory motor area within which it is possible to reach and interact with objects [62]). Indeed, Vieira and colleagues [63] showed that distance from other organisms (conspecifics or not) is regulated by a network that includes the midbrain periaqueductal gray (a defensive region, sensitive to threat proximity) and frontoparietal structures representing peripersonal space. Future neuroimaging studies may allow to investigate whether the reduction of IPD associated to seeing another person wearing a mask reflects a modulation of the activity in the above network, therefore supporting the hypothesis of a reduced perceived threat.”

--------------------------------------------------------------------------

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Valerio Capraro

15 Jun 2021

PONE-D-21-03526R1

A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak

PLOS ONE

Dear Dr. Lisi,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jul 30 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Valerio Capraro

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments (if provided):

One of the reviewers suggests one final change before publication. Please address this last comment at your earliest convenience. Also, I would like to mention a recent review article on the role of prosociality in covid-19 response. Of course, it is not required to cite it, but, since you work on the same topic, I'm mentioning it because you may find it useful. I am looking forward for the final version.

Capraro V, Boggio PS, Böhm R, Perc M, Sjåstad H (forthcoming) Cooperation and acting for the greater good during the COVID-19 pandemic. In M. K. Miller (Ed.) The social science of the COVID-19 pandemic: A call to action for researchers. Oxford: Oxford University Press. Available at: https://psyarxiv.com/65xmg/

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: (No Response)

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: (No Response)

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: (No Response)

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: (No Response)

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: The authors have adequately addressed my comments. This manuscript is now acceptable for publication.

I however recommand modifying the periaqueducal grey definition "(a defensive region...)" which is, in my opinion, a bit awkward.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: Yes: Alice Cartaud

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Aug 10;16(8):e0255598. doi: 10.1371/journal.pone.0255598.r004

Author response to Decision Letter 1


16 Jul 2021

Reviewer #2

The authors have adequately addressed my comments. This manuscript is now acceptable for publication.

I however recommand modifying the periaqueducal grey definition "(a defensive region...)" which is, in my opinion, a bit awkward.

ARRef2:

We thank the Reviewer for pointing out this.

We modified the sentence (page 27, lines 422-425), which now reads as follows: “Indeed, Vieira and colleagues [64] showed that distance from other organisms (conspecifics or not) is regulated by a network that includes the midbrain periaqueductal gray (a region sensitive to threat proximity and involved in defensive behaviors) and frontoparietal structures representing peripersonal space.”

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Valerio Capraro

21 Jul 2021

A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak

PONE-D-21-03526R2

Dear Dr. Lisi,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Valerio Capraro

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Valerio Capraro

29 Jul 2021

PONE-D-21-03526R2

A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak

Dear Dr. Lisi:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Valerio Capraro

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Supplemental information of: A Bayesian approach to reveal the key role of mask wearing in modulating projected interpersonal distance during the first COVID-19 outbreak.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    All the data and codes for the analysis are available from the Mendeley repository: https://data.mendeley.com/datasets/jw3sbz2nkv/1 (DOI: 10.17632/jw3sbz2nkv.1).


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES