Skip to main content
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
. 2020 Jul 10;117(30):17667–17674. doi: 10.1073/pnas.2008868117

Working memory capacity predicts individual differences in social-distancing compliance during the COVID-19 pandemic in the United States

Weizhen Xie a,1, Stephen Campbell b, Weiwei Zhang b
PMCID: PMC7395511  PMID: 32651280

Significance

Before vaccination and other intervention measures become available, successful containment of an unknown infectious disease critically relies on people’s voluntary compliance with the recommended social-distancing guidelines. This involves a decision process of prioritizing the merits of social distancing over its costs, which may depend on one’s ability to compare multiple pieces of potentially conflicting information regarding social distancing in working memory. Our data support this hypothesis, highlighting the critical role of one’s working memory capacity in social-distancing compliance during the early stage of the coronavirus disease 2019 pandemic. This observation reveals a core cognitive limitation in one’s response to a public health crisis and suggests a possible cognitive venue for the development of strategies to mitigate this challenge.

Keywords: working memory, social distancing, social norm, individual differences, COVID-19

Abstract

Noncompliance with social distancing during the early stage of the coronavirus disease 2019 (COVID-19) pandemic poses a great challenge to the public health system. These noncompliance behaviors partly reflect people’s concerns for the inherent costs of social distancing while discounting its public health benefits. We propose that this oversight may be associated with the limitation in one’s mental capacity to simultaneously retain multiple pieces of information in working memory (WM) for rational decision making that leads to social-distancing compliance. We tested this hypothesis in 850 United States residents during the first 2 wk following the presidential declaration of national emergency because of the COVID-19 pandemic. We found that participants’ social-distancing compliance at this initial stage could be predicted by individual differences in WM capacity, partly due to increased awareness of benefits over costs of social distancing among higher WM capacity individuals. Critically, the unique contribution of WM capacity to the individual differences in social-distancing compliance could not be explained by other psychological and socioeconomic factors (e.g., moods, personality, education, and income levels). Furthermore, the critical role of WM capacity in social-distancing compliance can be generalized to the compliance with another set of rules for social interactions, namely the fairness norm, in Western cultures. Collectively, our data reveal contributions of a core cognitive process underlying social-distancing compliance during the early stage of the COVID-19 pandemic, highlighting a potential cognitive venue for developing strategies to mitigate a public health crisis.


The rapid outbreak of the novel coronavirus disease 2019 (COVID-19) poses a great challenge to almost every aspect of our everyday life. Because this virus can rapidly spread from person to person (1), restricting close-distance human interactions, also known as “social distancing,” is an effective measure to contain its transmission (2) and to prevent straining public health resources (3, 4). This measure mandates behaviors such as avoiding congregate settings and mass gathering, maintaining distance from others, and self-isolation (5). Before vaccination and other interventions become available, these behaviors will remain critical for an extended period of time, even after the government’s stay-at-home and shelter-in-place orders are lifted. However, in a society where social distancing mostly remains voluntary, there is widespread noncompliance, especially during the early stage of this pandemic (6, 7). This may be partly due to the concerns for the inherent costs associated with social distancing. Informed decision weighting benefits over costs is thus a critical mental process underlying social-distancing compliance (8). However, what constitutes an individual’s cognitive ability to formulate such a decision remains largely unclear.

This study thus aims to investigate whether and how a core cognitive function, namely working memory (WM), is associated with individual differences in social-distancing compliance during the early stage of the COVID-19 pandemic. WM retains a limited amount of information over a short period of time at the service of other ongoing mental activities. Its limited capacity constrains our mental functions (911), such that higher WM capacity is often associated with better cognitive and affective outcomes (1215). For example, higher WM capacity supports better learning in face of the adverse influences from stress (16). It also allows better cost-and-benefit evaluation of a given action under uncertainty (17), which can lead to better decisions (18, 19). Once a decision is made or a new rule is set, higher WM capacity is further associated with a better ability to retain and follow the decision or rule (2022). Given these critical roles of WM, we hypothesize that individuals with higher WM capacity may better understand the true merits of social distancing despite its potential costs, and subsequently show more compliance with recommended social-distancing guidelines during the early stage of the COVID-19 outbreak.

Our hypothesis echoes the theoretical emphasis on cognitive variables (e.g., reinforcement learning) in an individual’s choice to follow a set of well-established rules for social interactions, often referred to as social norms (2325). This cognitive approach is complementary to previous research on various social and affective factors underlying social-norm compliance (26). For example, individuals who have certain personality traits (e.g., considerateness) or feel anxious about pursuing social acceptance often show more social-norm compliance (2730). However, different from plenty of opportunities for reinforced learning of well-established social norms (23, 25), compliance with a still developing norm of social distancing during the early outbreak of an unknown infectious disease poses a unique demand on one’s ability to rapidly carry out deliberate cost-and-benefit analysis (8). It remains unclear whether WM plays a unique role in this type of decision, especially after taking into account other social and affective factors, such as personality and anxious feelings (2631). Identification of the essential cognitive building blocks underlying this decision process may pave the way for the development of strategies (32, 33) to reduce social-distancing noncompliance for mitigating a public health crisis (34).

We tested our hypothesis in two studies with a diverse group of 850 United States participants (SI Appendix, Table S1) from the online Amazon Mechanical Turk (mTurk) experimental platform. These studies were conducted within the first 2 wk (March 13 to 26, 2020) following the United States federal government’s declaration of national emergency due to the COVID-19 pandemic. During this period, social distancing progressively developed into a norm. Several states have issued stay-at-home orders. Still, many people fail to follow these guidelines (6). Study 1 examined these individual differences by asking participants to report their social-distancing compliance levels. Participants also completed a change localization task as a task measure of WM capacity (Fig. 1A) and a package of questionnaires capturing mood-related conditions during this period, including depressed mood, anxious feelings, and sleep quality (31). We found that WM capacity significantly predicted individual differences in social-distancing compliance even after taking into account other mood-related covariates. Study 2 replicated findings from study 1, and further factored out the contributions of several personality variables and fluid intelligence in the observed relationship between WM capacity and social-distancing compliance. Furthermore, we found that participants’ understanding of the merits of social distancing mediated the relationship between WM capacity and social-distancing compliance. Finally, we generalized the main findings from social-distancing compliance to the compliance with another social norm, namely the fairness norm, in Western cultures (35). Collectively, our data highlight the critical role of WM capacity in social cognition and behavior (33).

Fig. 1.

Fig. 1.

WM change localization task and the relationship between WM capacity and social distancing. (A) Participants performed an online visual WM task, in which they tried to memorize a set of briefly presented color squares for 500 ms and after a 1,000-ms delay tried to identify a changed color in the test display by clicking on it using a computer mouse. (B) Based on a median split of WM capacity across the subjects in each study, individuals with higher WM capacity tended to report more social-distancing compliance, as compared with lower-capacity individuals. (C) The significant association between WM capacity and social-distancing compliance is partly mediated by an individual’s understanding of benefits over costs about social distancing. That is, participants with higher WM capacity may be able to better evaluate the true merits of social distancing and subsequently comply more with social-distancing guidelines. This significant mediation effect has taken into account individual differences in age, gender, education, income level, depressed mood, anxious feeling, Big Five personality dimensions, and fluid intelligence as background confounders. Error bar areas in B indicate resampling SE of the cumulative probability estimates. *P < 0.05, ***P < 0.001.

Results

Measure of Social-Distancing Compliance and Its Relationship with Other Variables of Interest.

Across two studies, two independent groups of mTurk participants reported how closely they had followed a set of practices to keep away from close-distance social interactions in the past week (e.g., whether they have cancelled social gathering with friends and avoided handshakes, hugs, or kisses when greeting; see Materials and Methods for details). To estimate the validity of this measure, we correlated participants’ total scores for social-distancing compliance with their self-report numbers of times that they had left their home and with the frequency of hand washing in the past week, using Spearman rank-order correlations. Our assumption is that participants who are more likely to comply with social-distancing guidelines are less likely to leave their home and are more cognizant about the means to prevent disease transmission. Indeed, we found that participants with higher scores in social-distancing compliance also reported leaving home less (ρ = −0.32 [−0.40, −0.22], P < 0.001, n = 397 in study 1 and ρ = −0.19 [−0.28, −0.10], P < 0.001, n = 453 in study 2), but washing hands more frequently (ρ = 0.54 [0.46, 0.60], P < 0.001 in study 1 and ρ = 0.34 [0.25, 0.42], P < 0.001 in study 2). In contrast, this social-distancing compliance measure was not significantly correlated with education or income levels of the participants, even though female and older participants tended to show more social-distancing compliance (SI Appendix, Tables S2 and S3).

Of primary interest, we found that social-distancing compliance was significantly correlated with participants’ ability to retain a certain number of color squares in WM, namely WM capacity, measured from an established change localization task (36, 37). In this task, on each trial, participants tried to remember a set of briefly presented color squares over a short delay and reported a changed color in a second set of color squares, by clicking on the changed color (Fig. 1A). Response accuracy across trials was converted to K (38), as the task measure of the total number of remembered items (i.e., WM capacity). We found that higher visual WM capacity was significantly correlated with more social-distancing compliance both in study 1 (r = 0.29 [0.20, 0.38], P < 0.001) and in study 2 (r = 0.25 [0.17, 0.34], P < 0.001). In addition, individuals with higher WM capacity who scored above the median K value in each sample indeed reported more social-distancing compliance (Fig. 1B), as compared with lower WM individuals [study 1: t(395) = 4.72, P < 0.001, Cohen’s d = 0.47 (0.27, 0.67); study 2: t(451) = 3.97, P < 0.001, Cohen’s d = 0.37 (0.19, 0.56)]. We also found that social-distancing compliance and K were significantly correlated with other affective and trait variables, such as depressed mood, anxious feelings, agreeableness, and fluid intelligence (SI Appendix, Tables S2 and S3). The critical issue then is whether the association between WM capacity and social-distancing compliance can be accounted for by these mood-related and trait-related covariates. To address this issue, we adopted a regression approach to investigate the unique variance in social-distancing compliance explained by WM capacity after taking into account other covariates (3941).

WM Capacity Contributes Unique Variance to Social-Distancing Compliance.

In study 1, we first looked at whether WM capacity could predict social-distancing compliance after taking into account several mood-related covariates, such as depressed mood, anxious feelings, and poor sleep quality (see Materials and Methods for details). These variables have all been previously linked to reduced WM capacity (4244), and our current data replicated these previous observations (SI Appendix, Tables S2 and S3). Nonetheless, we found that WM capacity remained a robust predictor of social-distancing compliance (β = 0.18 [0.09, 0.28], P < 0.001), even after taking into account these mood-related covariates and other demographic variables, including age, gender, education, and income levels. This observation remained robust when WM capacity was entered into the regression model as the last predictor [ΔR2 = 0.03, F(1, 388) = 13.57, P < 0.001], suggesting that WM capacity contributed unique and additional variance to individual differences in social-distancing compliance (Table 1).

Table 1.

Predicting social-distancing compliance with multiple regression in study 1

Model 1 Model 2
β (95% CI) P β (95% CI) P
Age 0.12 (0.03, 0.22) 0.011 0.15 (0.05, 0.24) 0.002
Gender −0.15 (−0.24, −0.06) 0.001 −0.14 (−0.23, −0.05) 0.003
Education 0.03 (−0.07, 0.13) 0.55 0.04 (−0.06, 0.13) 0.44
Income 0.01 (−0.09, 0.10) 0.86 −0.01 (−0.10, 0.09) 0.92
Depressed mood −0.44 (−0.63, −0.26) <0.001 −0.35 (−0.54, −0.16) <0.001
Anxious feeling 0.18 (0.003, 0.35) 0.047 0.15 (−0.02, 0.33) 0.09
Sleep quality −0.08 (−0.20, 0.04) 0.19 −0.08 (−0.20, 0.04) 0.20
WM Capacity 0.18 (0.09, 0.28) <0.001
R2 (R2 adjusted) 0.18 (0.17) 0.21 (0.20)
Comparison ΔR2 = 0.03, F(1, 388) = 13.57, P < 0.001

In study 2, we further evaluated the robustness of this observation after factoring out some additional covariates, such as the “Big Five” personality and fluid intelligence. Consistent with some previous findings regarding personality and social norms (27), we found that participants with certain personality types showed more social-distancing compliance (e.g., agreeableness, β = 0.18 [0.08, 0.27], P < 0.001). However, individual variations in personality did not take away the unique contribution of WM capacity to social-distancing compliance. Similarly, although fluid intelligence was a significant predictor of social-distancing compliance (β = 0.13 [0.05, 0.22], P = 0.003), its contribution attenuated (β = 0.09 [−0.01, 0.18], P = 0.063) when WM capacity was entered into the model as the last predictor. These observations were supported by a model comparison between the regression models with and without WM capacity as an additional predictor [β = 0.14 (0.05, 0.24), ΔR2 = 0.02, F(1, 439) = 8.50, P = 0.004] (Table 2). Altogether, converging findings from studies 1 and 2 indicate the unique and significant contribution of WM capacity to individual variations in social-distancing compliance, which cannot be simply accounted for by mood-related variables, personality, or fluid intelligence of the participants.

Table 2.

Predicting social-distancing compliance with multiple regression in study 2

Model 1 Model 2
β (95% CI) P β (95% CI) P
Age 0.12 (0.04, 0.21) 0.005 0.15 (0.06, 0.23) 0.001
Gender −0.10 (−0.18, −0.02) 0.018 −0.10 (−0.18, −0.01) 0.022
Education −0.09 (−0.18, 0.001) 0.052 −0.08 (−0.17, 0.01) 0.068
Income 0.05 (−0.04, 0.14) 0.30 0.05 (−0.04, 0.14) 0.26
Depressed mood −0.25 (−0.41, −0.09) 0.002 −0.23 (−0.38, −0.07) 0.005
Anxious feeling 0.16 (0.01, 0.32) 0.042 0.17 (0.02, 0.32) 0.031
Agreeableness 0.18 (0.08, 0.27) <0.001 0.18 (0.08, 0.27) <0.001
Conscientiousness 0.04 (−0.06, 0.15) 0.44 0.04 (−0.07, 0.14) 0.50
Extraversion −0.06 (−0.15, 0.03) 0.18 −0.05 (−0.14, 0.04) 0.27
Openness 0.14 (0.05, 0.24) 0.002 0.13 (0.04, 0.22) 0.006
Neuroticism 0.07 (−0.05, 0.18) 0.25 0.06 (−0.05, 0.17) 0.25
RAPM 0.13 (0.05, 0.22) 0.003 0.09 (−0.01, 0.18) 0.063
WM Capacity 0.14 (0.05, 0.24) 0.004
R2 (R2 adjusted) 0.20 (0.19) 0.22 (0.20)
Comparison ΔR2 = 0.02, F(1, 439) = 8.50, P = 0.004

Weighting Benefits over Costs Mediates the Relationship between WM Capacity and Social-Distancing Compliance.

We next examined how WM capacity might account for unique variance in social-distancing compliance. Our working hypothesis is that higher WM capacity may facilitate one’s ability to perform cost-and-benefit analysis of social-distancing practice, which subsequently facilitates social-distancing compliance. This hypothesis predicts that participants’ understanding about benefits over costs of social distancing mediates the relationship between WM capacity and social-distancing compliance. We tested this prediction in study 2, in which participants evaluated the extent to which they agreed with several statements regarding social distancing during the COVID-19 pandemic (Materials and Methods and SI Appendix, Table S4). Some of these items highlight the needs or benefits to perform social distancing (e.g., “Social distancing may minimize the burden on medical resources, so people in need can use them”), whereas others highlight the potential costs associated with social distancing (e.g., “Small business could not survive if people keep social distancing”). We standardized the sum scores for the benefit- and cost-related items separately and then calculated the difference score as a measure of participants’ understanding of benefits over costs regarding social distancing at the time of testing.

We subsequently performed a formal mediation analysis (45), using WM capacity as a predictor, social-distancing compliance as the outcome variable, and participants’ understanding of benefits over costs about social distancing as a mediator (Fig. 1C). After factoring out other covariates as background confounders (Materials and Methods), we found that participants’ understanding of benefits over costs significantly mediated the relationship between WM capacity and social-distancing compliance (indirect effect: β = 0.03 [0.003, 0.07], P = 0.038). However, it was a partial mediation effect since this mediator did not fully take away the direct contribution of WM capacity to social-distancing compliance (β = 0.12 [0.02, 0.21], P = 0.013).

WM Capacity Also Predicts Fairness Norm Compliance.

To understand the more general role of WM capacity in social-norm compliance, we asked participants in study 2 to perform an additional fairness norm decision-making task (Fig. 2 A and B), which involved staged interactions between two anonymous players with real financial consequences (35, 46). At the beginning of this task, participants were told that they would be randomly paired with another mTurk worker and that they could be arbitrarily assigned into different roles (“Player A” vs. “Player B”). In fact, all participants were assigned to be Player A, whereas Player B was simulated by a preprogramed algorithm (46). The two players began each round with 25 money units (MUs), but Player A (the participant) received an additional 100 MUs and could decide to transfer x amount of MUs deemed fair by himself/herself to Player B (baseline condition). In another condition, Player B could respond to the MU transfer by either accepting it if it was fair or punishing Player A by y amount of MUs if it was deemed unfair (punishment condition). We simulated the amount of punishment based on the probability distribution and magnitude of how a real human Player B would have responded in this task from previous studies (33, 41) (SI Appendix, Table S5).

Fig. 2.

Fig. 2.

A modified ultimatum game (A and B) for social-norm compliance (C) and its relationship to WM capacity (D). On each round, both players started with 25 MUs. Player A also received an additional 100 MUs and had to decide whether to transfer x amount of MUs, in steps of 10 MUs from 0 to 100, to another anonymous Player B to be fair. (A) In the baseline condition, Player B could only accept whatever MUs Player A offered, resulting in a reduction of Player A’s earning by x MUs. (B) In the punishment condition, Player B could decide to either accept Player A’s offer or punish Player A by taking y MUs, ranging from 0 to 100 MUs, away from Player A. (C) The ultimate fairness for this game would be an even split of the 100 MUs between the two players (i.e., equality) in Western cultures. Therefore, the closer to equality the x amount of MUs Player A transferred to Player B is, the less likely Player B would punish Player A. Hence, over the course of the experiment, when faced with the punishment threat, Player A tended to transfer more MUs (close to the fairness norm of 50 MUs) to Player B, as compared to the baseline condition. The difference in the amount of MUs transferred from Player A to Player B is indicative of Player A’s sanction-induced fairness norm compliance. (D) We found that this fairness norm compliance measure was significantly correlated with WM capacity in study 2. Error bar areas in C indicate SEM estimates. And the solid line in D represents the linear fit of the data, with the dashed lines indicating its 95% confidence intervals.

According to the fairness norm in Western cultures, the ultimate fairness in this social setting would be an even split of the MUs between the two players (i.e., “split the cake”). However, this would conflict with Player A’s self interest in obtaining more MUs for a higher monetary reward, and consequently Player A generally tended to transfer a smaller amount of MUs to Player B in the baseline condition. In contrast, when a sanctioning threat was present as a reminder to comply with the fairness norm in the punishment condition, Player A tended to transfer more MUs to Player B (35, 46). We replicated these observations from previous research. Specifically, the amount of MUs the participants as Player A transferred to Player B was statistically not different from the fairness norm (i.e., 50 MUs) in the punishment condition [t(452) = 1.13, P = 0.26, Cohen’s d = 0.05 (−0.04, 0.15), Bays factor in favor of the null hypothesis = 10.02]. In contrast, participants as Player A transferred significantly fewer MUs to Player B in the baseline relative to the punishment condition [t(452) = 11.59, P < 0.001, Cohen’s d = 0.55 (0.45, 0.64)] (Fig. 2C). Consequently, the difference in the amount of transferred MUs between punishment and baseline conditions could capture individual differences in sanction-induced fairness norm compliance by taking into account individual differences in altruism and response biases (35).

We next evaluated whether WM capacity had a unique contribution to individual differences in sanction-induced fairness norm compliance. We found that WM capacity was significantly correlated with participants’ compliance with the fairness norm (r = 0.26 [0.17, 0.34], P < 0.001) (Fig. 2D). Furthermore, WM capacity’s contribution to individual differences in fairness norm compliance [β = 0.10 (0.003, 0.20), ΔR2 = 0.01, F(1, 439) = 4.13, P = 0.043] could not be accounted for by other significant predictors of performance in this task (SI Appendix, Table S6), such as continuousness (β = 0.13 [0.02, 0.24], P = 0.018) and fluid intelligence (β = 0.26 [0.16, 0.35], P < 0.001). This may be because that individuals with higher WM capacity can better evaluate the consequences of not following the fairness norm, such that they can maximize the total amount of reward in the end. This prediction was supported by a significant correlation between WM capacity and total amount of earned MUs across participants (r = 0.28 [0.20, 0.37], P < 0.001). Furthermore, participants’ compliance to the fairness norm was significantly correlated with social-distancing compliance as well (r = 0.18 [0.09, 0.27], P < 0.001). Altogether, these results suggest that participants who are more inclined to follow one set of social norms may also be more likely to follow another set of social norms, which are both highly related with individual differences in WM capacity.

Discussion

This study reveals a cognitive root of social-distancing compliance during the early stage of the COVID-19 pandemic. We find that WM capacity contributes unique variance to individual differences in social-distancing compliance, which may be partially attributed to the relationship between WM capacity and one’s ability to evaluate the true merits of the recommended social-distancing guidelines. This association remains robust after taking into account individual differences in age, gender, education, socioeconomic status, personality, mood-related conditions, and fluid intelligence. This unique contribution of WM capacity can also be generalized to fairness norm compliance, suggesting a critical role of WM capacity in social cognition and behavior (33). Altogether, this study adds insights into the cognitive building blocks that may lead to better social-distancing compliance.

Of paramount interest, our findings are in line with the theoretical framework that social-distancing compliance during the early outbreak of an infectious disease is driven by deliberate thoughts about the costs and benefits of this practice (8). Our observation is that the decision to follow the social-distancing norm in prioritizing societal benefits over personal costs is contingent on one’s WM capacity, the core of human cognition (9). Critically, this does not seem to a special case of WM’s contributions to a specific social behavior, because WM capacity can also predict fairness norm compliance. These unique contributions of WM capacity to social-norm compliance cannot be accounted for by other well-acknowledged factors, such as an individual’s moods (31), personality traits, fluid intelligence, or socioeconomic status (e.g., education and income levels). These robust findings add to the growing literature on the importance of cognitive factors in social-norm compliance (23, 25). Furthermore, in response to a recent call of applying behavioral science principles to mitigate the COVID-19 pandemic (7, 34, 47), our results suggest a possible cognitive venue for developing strategies to meet this challenge.

These behavioral associations may be driven by shared neurocognitive mechanisms underlying WM capacity and social-norm compliance in the prefrontal regions (35, 46). On the one hand, WM capacity is closely related to prefrontal mental processes, such as decision making, cognitive control, and fluid intelligence in healthy and clinical populations (4852). On the other hand, social-norm compliance has also been attributed to the prefrontal cortex (46), such that transcranial electrical stimulation over the prefrontal cortex can improve social-norm compliance (35). By bridging these two parallel lines of research, our data provide preliminary support for the potentials of intervention strategies targeting prefrontal functions (e.g., WM training) in mitigating social-norm noncompliance (53, 54).

Some caveats should be noted in this study. First, given the theoretical roles of attention in WM (9, 55), the observed relationships between WM capacity and social-distancing compliance may result from individual differences in our ability to control contents of attention especially when confronted with conflicting information (55, 56). Future research needs to systematically assess the contributions of other cognitive factors, such as attention control, in social-norm compliance. Second, this study investigates social-distancing compliance in a society when social distancing has remained largely voluntary and people could make different choices (7, 8). However, when social distancing is mandatory, compliance may be more related with other factors, such as the concerns about legal violations and the anxiety associated with being infected by the virus (31). Third, social-norm compliance was assessed using self-report measures. Although this measure correlated well with other practice for reducing the risk of getting infected (e.g., more home stay and frequent hand washing), it could reflect participants’ attitude more than their own behaviors regarding social distancing. That said, as attitude and behaviors are highly correlated (57), changes in attitude may be accompanied by corresponding behavioral changes over time (58). Last, the present observations are correlational in nature. Thus, the casual inference regarding the relationship between WM capacity and social-distancing compliance needs to be tested in future studies, such as by using WM training (33) or noninvasive brain stimulation (35).

In conclusion, the presentent study reveals a behavioral association between WM capacity and social-distancing compliance, partially mediated by a cost-and-benefit analysis of social-distancing practice, during the early stage of the COVID-19 pandemic in the United States. This critical role of WM capacity in social distancing can be generalized to another social norm, such as the fairness norm, in Western cultures. These findings provide a potential cognitive venue for the development of strategies to mitigate social-distancing noncompliance in a public health crisis.

Materials and Methods

Participants.

Across the two experiments, 1,159 participants (552 females; 38.51 ± 12.39 [mean ± SD] years old) were recruited from the online mTurk experimental platform. The study was only accessible to participants with an IP address located within the United States. Only participants who met these following inclusion criteria were included for further analyses, resulting in a final sample size of 850 participants (410 females; 38.24 ± 11.98 y old). Specifically, all eligible subjects: 1) Finished the study within more than 8 min (minimal time for just clicking through the survey and tasks), 2) responded accurately in a “trap question” (59) that was presented intermixed with other survey items (see SI Appendix for an example), and 3) performed above chance in the change localization task performance (20% as the chance performance for set size 5, see discussion of procedure below for details). In study 2, we additionally excluded participants with unmeaningfully fast responses for more than one-third of the trials in the Raven’s Advanced Progressive Matrices (RAPM) task, to ensure a reliable measure of fluid intelligence. The unmeaningfully fast responses were defined as the trials with response time less than half a second, considering that mean response time was 18.92 ± 19.40 s for each question regardless of accuracy in the RAPM task. These criteria were implemented mainly for controlling data quality (60). Consequently, 397 (198 females; 39.08 ± 12.37 y old) of 525 participants recruited between March 20 and 22, 2020 in study 1 and 453 (241 females; 37.51 ± 11.58 y old) of 634 total participants recruited between March 24 and 26, 2020 in study 2 met these criteria. Note, the exclusion percentage is on a par with other cognitive studies using mTurk (61). Further details about the demographic information about these participants can be found in SI Appendix, Table S1. No statistical methods were used to predetermine the sample sizes. That said, our sample sizes are similar to previous studies on individual differences, and had a reasonable statistical power (80%) to detect a median size significant effect from regression and mediation analyses (62, 63).

Informed consent was obtained prior to the study following the protocol approved by the Institutional Review Board of the University of California, Riverside. In brief, before participants decided to continue on the study by clicking a “proceed” button on the webpage, they were presented with detailed information including the purposes, procedures, potential risks/benefits, confidentiality, and compensation of the study. All participants were informed that they could withdraw from the study at any time by closing the web browser and were all compensated for their time in the study.

Procedure.

Participants at first completed a demographic survey, which included age, gender, ethnicity, education, and income level relative to their respective age group. Afterward, participants in study 1 completed a visual WM change localization task and a set of questionnaires, capturing individual differences in social-distancing compliance, depressed mood, anxious feelings, and sleep quality. Participants in study 2 completed similar tasks and questionnaires with these following exceptions. First, we included additional measures of personality variables and fluid intelligence. Second, we included more questions capturing participants’ understanding about the costs and benefits of social-distancing practice. Third, we also included an additional decision-making task that assessed individual differences in fairness norm compliance. Finally, we dropped the sleep quality measure to save time. Both studies were programmed using PsyToolkit (64, 65). Further details of these measures are described below.

Study 1.

Visual WM change localization task.

In this task, observers saw a set of five color squares (70 by 70 pixels each) presented on a computer screen (800 by 600 pixels through a webpage browser) for 500 ms and tried to remember them as best as they could. After a 1,000-ms delay period with a blank screen, participants saw another set of squares with repeated colors, except for one square, from the initial study set. Observers were asked to use a computer mouse to click on the color square that differed from its initial color (Fig. 1A). Colors used in this task were randomly sampled from a set of eight perceptually distinct colors (i.e., blue, green, red, yellow, brown, magenta, lime green, and cyan). And they were presented at 5 different locations randomly sampled from a set of 16 possible locations, in a 4-by-4 grid centering on the display screen, with 107 pixels between the centers of every two locations. Participants responded at their own pace to prioritize response accuracy over speed. Set size 5 was used to ensure that the tested set size was larger than the typical WM capacity for colors, which was about size 3 or 4 in the general population (9, 11), and that the task was at a medium difficulty level (37). All participants completed 5 practice trials, followed by 20 experimental trials. Participants’ performance in this task was measured as K [(proportion correct × set size) − 1] for the number of items held in visual WM (42), which is a reliable and valid estimate of visual WM capacity (36, 38). Using this measure from online participants in the present study, we were able to replicate some previous findings (4244, 66) from college students in more controlled laboratory settings. For example, we replicated the findings that reduced WM capacity was associated with self-report measures of depressed mood (r = −0.36 [−0.45, −0.27], P < 0.001), anxious feelings (r = −0.26 [−0.35, −0.17], P < 0.001), and poor sleep quality (r = −0.24 [−0.33, −0.14], P < 0.001).

Social-distancing compliance.

In this self-report questionnaire, we asked participants to report how closely they followed a set of social-distancing practice in the past week (from “Do not consider following” = 0 to “Follow very frequently” = 3). These items include whether a participant has “held no social gathering with friends,” “cancelled events or plans to go to an event,” “stopped going to the church or attending other community activity,” and “had no handshakes, hugs, or kisses when greeting.” We combined participants’ responses from these questions to formulate a composite score of social-distancing compliance (Cronbach’s α = 0.83). To estimate the validity of these measures, in separate questions, we further asked participants to report the number of times they had left their home in the past week and how frequently they had washed their hands in the past week on a four-point scale.

Depressed mood.

We used the Patient Health Questionnaire-9 (PHQ-9) to measure participants’ depressed feelings within the past week (67). Participants indicated how often in the past week they have been bothered by one of the nine symptoms using a four-point scale (from “Not at all = 0” to “Nearly every day = 3”). Possible scores range from 0 to 27, with 0 indicating no experience of depressed mood and 27 reflecting severe depression (Cronbach’s α = 0.94).

Anxious feelings.

We used the Generalized Anxiety Disorder-7 (GAD-7) scale to capture participants’ overall anxious feelings about an uncertain situation (68). Participants respond to seven symptom questions by indicating how often in the past week they have been bothered by that symptom using a four-point scale (from “Not at all = 0” to “Nearly every day = 3”). Possible scores range from 0 to 21, with a higher score indicating more anxious feelings (Cronbach’s α = 0.94).

Sleep quality.

Pittsburgh Sleep Quality Index (PSQI) was used to assess participants’ sleep quality over last week (69). The full index ranges from 0 to 21, with higher scores indicating poorer sleep quality. This scale has a reasonable internal reliability with a Cronbach’s α as 0.60 in the current sample. Higher PSQI scores have been reliably shown to be correlated with lower visual WM capacity (44).

Study 2.

Understanding of benefits and costs about social distancing.

We collected a set of statements based on news reports and opinions from medical experts (SI Appendix, Table S4), and asked participants to report the extent to which they think these statements were true on a four-point scale (“Don’t think it is true” = 0 to “It is very true” = 3). These statements can be categorized into benefit-related and cost-related items. We calculated the sum scores within each category, and then standardized them separately before taking the difference between the benefit-related and cost-related scores. This composite score provides an estimate about participants’ attitude toward the benefits over costs regarding social-distancing practice. The internal consistency measure of Cronbach’s α of the full scale is 0.61, and a principle component analysis further support two separable components in participants’ responses (SI Appendix, Table S4).

Fairness norm compliance task.

This task was modified from the ultimatum game in previous studies to assess fairness norm compliance (35, 46). We simplified this task to optimize behavioral performance for the online data collection environment. In this paradigm, participants repeatedly took the role of Player A and were told that they were randomly paired in every round with another mTurk worker as Player B. In every round both players would receive an initial endowment of 25 MUs. Player A would additionally receive 100 MUs, totaling the endowment of 125 MUs in each round. Player A was given the options to share x amount of MUs to Player B, from 0 to 100 in steps of 10. This decision was made by directly selecting a button on the screen corresponding to the number of MUs Player A would like to share. Player A had as much time as needed to make this decision. In baseline rounds (Fig. 2A), Player A could propose a transfer of x MUs, and Player B could only choose to accept the proposal. In this case, the transfer would be implemented as it was, reducing Player A’s available MUs by x MUs. In contrast, in the punishment condition (Fig. 2B) Player B had the option to accept or punish Player A by taking away y amount of MUs from Player A, which could vary from 0 to 125 MUs. This means, for example, if Player A gave nothing to Player B, Player B could reduce Player A’s earning to 0 by taking away all 125 MUs from Player A. Each participant completed eight rounds of baseline trials and another eight rounds of the punishment trials. These two types of trials were randomly intermixed in the experiment. On average, Player A earned 1016.49 (±245.36) MUs in total. These points were converted to additional cash bonus to their Amazon account at the end of the experiment (scaled from 0 to 1.5 US dollars for minimal to maximum amount of points). Although Player A was told to play this game with another mTurk worker, Player A was in fact interacting with a preprogrammed computer algorithm. In punishment rounds, this algorithm “punished” low transfer levels with the same probability and magnitude based on how a human partner would have responded in a real social interaction from previous studies (29, 30) (SI Appendix, Table S5).

Fluid intelligence.

We used the short version of RAPM to assess one’s reasoning and problem-solving skill (70, 71), which is often referred to as fluid intelligence (72). We selected one practice question from Set I (i.e., Problem 1) and 12 questions from Set II (i.e., Problems 1, 4, 8, 11, 15, 18, 21, 23, 25, 30, 31, and 35). These problems were presented sequentially from easy to difficult. The problem and options for the answer were simultaneously presented on the computer screen via a webpage browser. Participants could take as much time as they wanted to choose an answer and were encouraged to try to correctly solve as many problems as possible. We found that participants’ performance in this task were significantly correlated with visual WM capacity measure (r = 0.39 [0.31, 0.46], P < 0.001), which is highly consistent with what has been reported in the literature (15, 73).

Big Five personality.

To account for personality covariates associated with social-distancing compliance, we included a short-form Big Five personality inventory (74). Participants were asked to indicate the extent to which they agree with a statement about themselves (e.g., “I see myself as someone who is relaxed handles stress well) from “strongly disagree” to “strongly agree” on a five-point Likert scale. We used these self-report ratings to calculate participants’ scores on five predefined personality dimensions, which are extraversion, agreeableness, conscientiousness, neuroticism, and openness, based on the scoring guideline in a previous study (74). The correlations among Big Five components were consistent with those reported in the literature (39, 41).

Data Analysis.

We assessed the unique variance that WM capacity contributed to social-distancing compliance using multiple regression. We entered WM capacity as the last predictor in the regression model, after other covariates have been taken into account (3941). The amount of additional variance that WM capacity could explain for the outcome variable was therefore unlikely to be accounted for by other covariates. In the mediation analysis (45) for the relationship between WM capacity and social-distancing compliance, we used WM capacity as the predictor, social-distancing compliance as the outcome variable, and participants’ understanding of benefits over costs about social distancing as the mediator. Other covariates, such as age, gender, education, income level, depressed mood, anxious feelings, personality, and fluid intelligence were treated as background confounders. We used bias-corrected bootstrapping method to estimate the direct and indirect effects (75). All P values reported in this study are two-tailed.

Supplementary Material

Supplementary File
pnas.2008868117.sapp.pdf (124.1KB, pdf)

Acknowledgments

We thank Lawrence D. Rosenblum, Brent Hughes, Parisa Parsafar, and two anonymous reviewers for their suggestions on our study and all of the participants who contributed their time to participate in this study. W.X. is a recipient of the National Institute of Neurological Disorders and Stroke Competitive Postdoctoral Fellowship Award. This study was funded by an internal bridge fund from the Department of Psychology, University of California, Riverside (W.Z.).

Footnotes

The authors declare no competing interest.

This article is a PNAS Direct Submission.

Data deposition: Nonidentifiable data from all 1,159 participants and associated analytical scripts/files are available in the Open Science Framework data repository at https://osf.io/uhns4/.

This article contains supporting information online at https://www.pnas.org/lookup/suppl/doi:10.1073/pnas.2008868117/-/DCSupplemental.

Data Availability.

Nonidentifiable data from all 1,159 participants and associated analytical scripts/files are available in the Open Science Framework data repository at https://osf.io/uhns4/.

References

  • 1.US National Center for Immunization and Respiratory Diseases (NCIRD) , Division of Viral Diseases, How coronavirus spreads. https://www.cdc.gov/coronavirus/2019-ncov/prevent-getting-sick/how-covid-spreads.html. Accessed 1 May 2020.
  • 2.Chinazzi M. et al., The effect of travel restrictions on the spread of the 2019 novel coronavirus (COVID-19) outbreak. Science 368, 395–400 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Glass R. J., Glass L. M., Beyeler W. E., Min H. J., Targeted social distancing design for pandemic influenza. Emerg. Infect. Dis. 12, 1671–1681 (2006). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Chu C., Lee J., Choi D. H., Youn S. K., Lee J. K., Sensitivity analysis of the parameters of Korea’s pandemic influenza preparedness plan. Osong Public Health Res. Perspect. 2, 210–215 (2011). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.US National Center for Immunization and Respiratory Diseases (NCIRD) , Division of Viral Diseases, Interim U.S. Guidance for Risk Assessment and Work Restrictions for Healthcare Personnel with Potential Exposure to COVID-19. https://www.cdc.gov/coronavirus/2019-ncov/hcp/guidance-risk-assesment-hcp.html. Accessed 1 May 2020.
  • 6.Sanchez G. H., 24 Pictures of Americans failing horribly at social distancing during the coronavirus outbreak. BuzzFeedNews (2020) https://www.buzzfeednews.com/article/gabrielsanchez/americans-coronavirus-social-distancing-shelter-in-place. Accessed 23 March 2020.
  • 7.Betsch C., How behavioural science data helps mitigate the COVID-19 crisis. Nat. Hum. Behav. 4, 438 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Reluga T. C., Game theory of social distancing in response to an epidemic. PLoS Comput. Biol. 6, e1000793 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Cowan N., The magical number 4 in short-term memory: A reconsideration of mental storage capacity. Behav. Brain Sci. 24, 87–114, discussion 114–185 (2001). [DOI] [PubMed] [Google Scholar]
  • 10.Zhang W., Luck S. J., Discrete fixed-resolution representations in visual working memory. Nature 453, 233–235 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Luck S. J., Vogel E. K., Visual working memory capacity: From psychophysics and neurobiology to individual differences. Trends Cogn. Sci. 17, 391–400 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Lee C. S., Therriault D. J., The cognitive underpinnings of creative thought: A latent variable analysis exploring the roles of intelligence and working memory in three creative thinking processes. Intelligence 41, 1–15 (2010). [Google Scholar]
  • 13.Xie W. et al., Affective bias in visual working memory is associated with capacity. Cogn. Emotion 31, 1345–1360 (2017). [DOI] [PubMed] [Google Scholar]
  • 14.Mikels J. A., Reuter-Lorenz P. A., Affective working memory: An integrative psychological construct. Perspect. Psychol. Sci. 14, 543–559 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Fukuda K., Vogel E., Mayr U., Awh E., Quantity, not quality: The relationship between fluid intelligence and working memory capacity. Psychon. Bull. Rev. 17, 673–679 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Otto A. R., Raio C. M., Chiang A., Phelps E. A., Daw N. D., Working-memory capacity protects model-based learning from stress. Proc. Natl. Acad. Sci. U.S.A. 110, 20941–20946 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Czernatowicz-Kukuczka A., Jaśko K., Kossowska M., Need for closure and dealing with uncertainty in decision making context: The role of the behavioral inhibition system and working memory capacity. Pers. Individ. Dif. 70, 126–130 (2014). [Google Scholar]
  • 18.Bagneux V., Thomassin N., Gonthier C., Roulin J. L., Working memory in the processing of the Iowa Gambling Task: An individual differences approach. PLoS One 8, e81498 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Cui J. F. et al., Effects of working memory load on uncertain decision-making: Evidence from the Iowa Gambling Task. Front. Psychol. 6, 162 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Duncan J., Schramm M., Thompson R., Dumontheil I., Task rules, working memory, and fluid intelligence. Psychon. Bull. Rev. 19, 864–870 (2012). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Pereg M., Meiran N., Rapid instructed task learning (but not automatic effects of instructions) is influenced by working memory load. PLoS One 14, e0217681 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Engle R. W., Carullo J. J., Collins K. W., Individual differences in working memory for comprehension and following directions. J. Educ. Res. 84, 253–262 (1991). [Google Scholar]
  • 23.Morris A., Cushman F., A common framework for theories of norm compliance. Soc. Philos. Policy 35, 101–127 (2018). [Google Scholar]
  • 24.Andrighetto G., Conte R., Cognitive dynamics of norm compliance. From norm adoption to flexible automated conformity. Artif. Intell. Law 20, 359–381 (2012). [Google Scholar]
  • 25.Harvey M. D., Enzle M. E., A cognitive model of social norms for understanding the transgression-helping effect. J. Pers. Soc. Psychol. 41, 866–875 (1981). [Google Scholar]
  • 26.Cialdini R. B., Goldstein N. J., Social influence: Compliance and conformity. Annu. Rev. Psychol. 55, 591–621 (2004). [DOI] [PubMed] [Google Scholar]
  • 27.Stankov L., The structure among measures of personality, social attitudes, values, and social norms. J. Individ. Differ. 28, 240–251 (2007). [Google Scholar]
  • 28.Stamkou E. et al., Cultural collectivism and tightness moderate responses to norm violators: Effects on power perception, moral emotions, and leader support. Pers. Soc. Psychol. Bull. 45, 947–964 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Feng C., Cao J., Li Y., Wu H., Mobbs D., The pursuit of social acceptance: Aberrant conformity in social anxiety disorder. Soc. Cogn. Affect. Neurosci. 13, 809–817 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Schreier S.-S. et al., Social anxiety and social norms in individualistic and collectivistic countries. Depress. Anxiety 27, 1128–1134 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Harper C. A., Satchell L. P., Fido D., Latzman R. D., Functional fear predicts public health compliance in the COVID-19 pandemic. Int. J. Ment. Health Addict., 1–14 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Civai C., Ma I., The enhancement of social norm compliance: Prospects and caveats. J. Cogn. Enhanc. 1, 26–30 (2017). [Google Scholar]
  • 33.Gruszka A., Nęcka E., Limitations of working memory capacity: The cognitive and social consequences. Eur. Manage. J. 35, 776–784 (2017). [Google Scholar]
  • 34.West R., Michie S., Rubin G. J., Amlôt R., Applying principles of behaviour change to reduce SARS-CoV-2 transmission. Nat. Hum. Behav. 4, 451–459 (2020). [DOI] [PubMed] [Google Scholar]
  • 35.Ruff C. C., Ugazio G., Fehr E., Changing social norm compliance with noninvasive brain stimulation. Science 342, 482–484 (2013). [DOI] [PubMed] [Google Scholar]
  • 36.Kyllingsbaek S., Bundesen C., Changing change detection: Improving the reliability of measures of visual short-term memory capacity. Psychon. Bull. Rev. 16, 1000–1010 (2009). [DOI] [PubMed] [Google Scholar]
  • 37.Gold J. M., et al. , Intact attentional control of working memory encoding in schizophrenia. J. Abnorm. Psychol. 115, 658–673 (2006). [DOI] [PubMed] [Google Scholar]
  • 38.Johnson M. K. et al., The relationship between working memory capacity and broad measures of cognitive ability in healthy adults and people with schizophrenia. Neuropsychology 27, 220–229 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Gannon N., Ranzijn R., Does emotional intelligence predict unique variance in life satisfaction beyond IQ and personality? Pers. Individ. Dif. 38, 1353–1364 (2005). [Google Scholar]
  • 40.Olthuis J. V., Watt M. C., Stewart S. H., Anxiety Sensitivity Index (ASI-3) subscales predict unique variance in anxiety and depressive symptoms. J. Anxiety Disord. 28, 115–124 (2014). [DOI] [PubMed] [Google Scholar]
  • 41.Zhang J. W., Howell R. T., Do time perspectives predict unique variance in life satisfaction beyond personality traits? Pers. Individ. Dif. 50, 1261–1266 (2011). [Google Scholar]
  • 42.Xie W., Li H., Zou Y., Sun X., Shi C., A suicidal mind tends to maintain less negative information in visual working memory. Psychiatry Res. 262, 549–557 (2018). [DOI] [PubMed] [Google Scholar]
  • 43.Moran T. P., Anxiety and working memory capacity: A meta-analysis and narrative review. Psychol. Bull. 142, 831–864 (2016). [DOI] [PubMed] [Google Scholar]
  • 44.Xie W., Berry A., Lustig C., Deldin P., Zhang W., Poor sleep quality and compromised visual working memory capacity. J. Int. Neuropsychol. Soc. 25, 583–594 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 45.Mackinnon D. P., Fairchild A. J., Current directions in mediation analysis. Curr. Dir. Psychol. Sci. 18, 16–20 (2009). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Spitzer M., Fischbacher U., Herrnberger B., Grön G., Fehr E., The neural signature of social norm compliance. Neuron 56, 185–196 (2007). [DOI] [PubMed] [Google Scholar]
  • 47.Bavel J. J. V. et al., Using social and behavioural science to support COVID-19 pandemic response. Nat. Hum. Behav. 4, 460–471 (2020). [DOI] [PubMed] [Google Scholar]
  • 48.Murray J. D., Jaramillo J., Wang X. J., Working memory and decision-making in a frontoparietal circuit model. J. Neurosci. 37, 12167–12186 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.D’Esposito M., Postle B. R., The cognitive neuroscience of working memory. Annu. Rev. Psychol. 66, 115–142 (2015). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Moser D. A. et al., An integrated brain-behavior model for working memory. Mol. Psychiatry 23, 1974–1980 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Kane M. J., Engle R. W., The role of prefrontal cortex in working-memory capacity, executive attention, and general fluid intelligence: An individual-differences perspective. Psychon. Bull. Rev. 9, 637–671 (2002). [DOI] [PubMed] [Google Scholar]
  • 52.Gold J. M. et al., Reduced capacity but spared precision and maintenance of working memory representations in schizophrenia. Arch. Gen. Psychiatry 67, 570–577 (2010). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 53.Shipstead Z., Redick T. S., Engle R. W., Is working memory training effective? Psychol. Bull. 138, 628–654 (2012). [DOI] [PubMed] [Google Scholar]
  • 54.Klingberg T., Training and plasticity of working memory. Trends Cogn. Sci. (Regul. Ed.) 14, 317–324 (2010). [DOI] [PubMed] [Google Scholar]
  • 55.Engle R. W., Working memory capacity as executive attention. Curr. Dir. Psychol. Sci. 11, 19–23 (2002). [Google Scholar]
  • 56.Vogel E. K., McCollough A. W., Machizawa M. G., Neural measures reveal individual differences in controlling access to working memory. Nature 438, 500–503 (2005). [DOI] [PubMed] [Google Scholar]
  • 57.Shrigley R. L., Attitude and behavior are correlates. J. Res. Sci. Teach. 27, 97–113 (1990). [Google Scholar]
  • 58.Ajzen I., Fishbein M., Attitude-behavior relations: A theoretical analysis and review of empirical research. Psychol. Bull. 84, 888–918 (1977). [Google Scholar]
  • 59.Liu M., Wronski L., Trap questions in online surveys: Results from three web survey experiments. Int. J. Mark. Res. 60, 32–49 (2018). [Google Scholar]
  • 60.Buhrmester M. D., Talaifar S., Gosling S. D., An evaluation of Amazon’s Mechanical Turk, its rapid rise, and its effective use. Perspect. Psychol. Sci. 13, 149–154 (2018). [DOI] [PubMed] [Google Scholar]
  • 61.Xie W., Bainbridge W. A., Inati S., Baker C. I., Zaghloul K. A., Memorability of words in arbitrary verbal associations modulates memory retrieval in the anterior temporal lobe. Nat. Hum. Behav., 10.1038/s41562-020-0901-2 (2020). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Fritz M. S., Mackinnon D. P., Required sample size to detect the mediated effect. Psychol. Sci. 18, 233–239 (2007). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Faul F., Erdfelder E., Buchner A., Lang A.-G., Statistical power analyses using G*Power 3.1: Tests for correlation and regression analyses. Behav. Res. Methods 41, 1149–1160 (2009). [DOI] [PubMed] [Google Scholar]
  • 64.Stoet G., PsyToolkit: A software package for programming psychological experiments using Linux. Behav. Res. Methods 42, 1096–1104 (2010). [DOI] [PubMed] [Google Scholar]
  • 65.Stoet G., PsyToolkit: A novel web-based method for running online questionnaires and reaction-time experiments. Teach. Psychol. 44, 24–31 (2017). [Google Scholar]
  • 66.Xie W. et al., Schizotypy is associated with reduced mnemonic precision in visual working memory. Schizophr. Res. 193, 91–97 (2018). [DOI] [PubMed] [Google Scholar]
  • 67.Kroenke K., Spitzer R. L., Williams J. B., The PHQ-9: Validity of a brief depression severity measure. J. Gen. Intern. Med. 16, 606–613 (2001). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Spitzer R. L., Kroenke K., Williams J. B. W., Löwe B., A brief measure for assessing generalized anxiety disorder: The GAD-7. Arch. Intern. Med. 166, 1092–1097 (2006). [DOI] [PubMed] [Google Scholar]
  • 69.Buysse D. J., Reynolds C. F. 3rd, Monk T. H., Berman S. R., Kupfer D. J., The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Res. 28, 193–213 (1989). [DOI] [PubMed] [Google Scholar]
  • 70.Chiesi F., Ciancaleoni M., Galli S., Morsanyi K., Primi C., Item Response Theory analysis and differential item functioning across age, gender and country of a short form of the advanced progressive matrices. Learn. Individ. Differ. 22, 390–396 (2012). [Google Scholar]
  • 71.Arthur W., Day D. V., Development of a short form for the Raven Advanced Progressive Matrices test. Educ. Psychol. Meas. 54, 394–403 (1994). [Google Scholar]
  • 72.Raven J., Raven J. C., Court J. H., Manual for Raven’s Progressive Matrices and Vocabulary Scales: Section 4. The Advanced Progressive Matrices, (Harcourt Assessment, 1998). [Google Scholar]
  • 73.Conway A. R. A., Cowan N., Bunting M. F., Therriault D. J., Minkoff S. R. B., A latent variable analysis of working memory capacity, short-term memory capacity, processing speed, and general fluid intelligence. Intelligence 30, 163–183 (2002). [Google Scholar]
  • 74.Rammstedt B., John O. P., Measuring personality in one minute or less: A 10-item short version of the Big Five Inventory in English and German. J. Res. Pers. 41, 203–212 (2007). [Google Scholar]
  • 75.Williams J., MacKinnon D. P., Resampling and distribution of the product methods for testing indirect effects in complex models. Struct. Equ. Model. A Multidiscip. J. 15, 23–51 (2008). [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Supplementary File
pnas.2008868117.sapp.pdf (124.1KB, pdf)

Data Availability Statement

Nonidentifiable data from all 1,159 participants and associated analytical scripts/files are available in the Open Science Framework data repository at https://osf.io/uhns4/.


Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES