Skip to main content
PLOS ONE logoLink to PLOS ONE
. 2021 Sep 23;16(9):e0257428. doi: 10.1371/journal.pone.0257428

The social amplification and attenuation of COVID-19 risk perception shaping mask wearing behavior: A longitudinal twitter analysis

Suellen Hopfer 1,*, Emilia J Fields 1, Yuwen Lu 2, Ganesh Ramakrishnan 3, Ted Grover 4, Quishi Bai 2, Yicong Huang 2, Chen Li 2, Gloria Mark 4
Editor: Anat Gesser-Edelsburg5
PMCID: PMC8460003  PMID: 34555060

Abstract

Introduction

Twitter represents a mainstream news source for the American public, offering a valuable vehicle for learning how citizens make sense of pandemic health threats like Covid-19. Masking as a risk mitigation measure became controversial in the US. The social amplification risk framework offers insight into how a risk event interacts with psychological, social, institutional, and cultural communication processes to shape Covid-19 risk perception.

Methods

Qualitative content analysis was conducted on 7,024 mask tweets reflecting 6,286 users between January 24 and July 7, 2020, to identify how citizens expressed Covid-19 risk perception over time. Descriptive statistics were computed for (a) proportion of tweets using hyperlinks, (b) mentions, (c) hashtags, (d) questions, and (e) location.

Results

Six themes emerged regarding how mask tweets amplified and attenuated Covid-19 risk: (a) severity perceptions (18.0%) steadily increased across 5 months; (b) mask effectiveness debates (10.7%) persisted; (c) who is at risk (26.4%) peaked in April and May 2020; (d) mask guidelines (15.6%) peaked April 3, 2020, with federal guidelines; (e) political legitimizing of Covid-19 risk (18.3%) steadily increased; and (f) mask behavior of others (31.6%) composed the largest discussion category and increased over time. Of tweets, 45% contained a hyperlink, 40% contained mentions, 33% contained hashtags, and 16.5% were expressed as a question.

Conclusions

Users ascribed many meanings to mask wearing in the social media information environment revealing that COVID-19 risk was expressed in a more expanded range than objective risk. The simultaneous amplification and attenuation of COVID-19 risk perception on social media complicates public health messaging about mask wearing.

Introduction

On January 30, 2020, the International Health Regulations Committee of the World Health Organization declared the now recognized Coronavirus 2019 (COVID-19) a public health emergency of international concern [1]. The outbreak of severe acute respiratory syndrome Coronavirus 2 (SARS-CoV-2), the virus that causes COVID-19 respiratory disease, has spread across the globe including the United States, resulting in a staggering loss of life—more than 4 million deaths worldwide as of August 8 2021, with more than half a million deaths (616,700) in the United States [2]. In 2021, well over a year into the pandemic, the United States continues to experience COVID-19 cases and deaths, constituting a devastating public health and economic burden.

Facemask wearing as a key COVID-19 risk mitigation measure

Facemask wearing became one of the dominant nonpharmaceutical risk mitigation strategies to prevent the spread of COVID-19 in the absence of vaccines [3] and continues to play a key role in the prevention of the highly infectious SARS-CoV-2 virus and its variants, even with the emergency authorization of three COVID-19 vaccines. Despite evidence since March 2020 that wearing facemasks can effectively reduce droplet and airborne transmission of COVID-19 risk [4, 5], the acceptability of wearing face masks in the U.S. public has varied dramatically, with low mask-wearing compliance [6, 7]. Many factors contributed to the phenomenon of noncompliance with mask wearing, including that it was not a prior norm in the United States, that COVID-19 was an unfamiliar risk, and that the Centers for Disease Control and Prevention (CDC) explicitly discouraged the public to wear masks initially. Furthermore, public health messaging initially focused on surface rather than droplet and airborne transmission, contributing to the absence of a rationale for mask wearing as a protective behavior [8]. Moreover, wearing masks became highly politicized in the United States rather than a common sense measure, in part as the result of former President Donald Trump not role-modeling mask wearing and downplaying the seriousness of the public health risk of the coronavirus [9, 10]. The psychological literature has shown that risk perception, and not objective risk assessment, is a key important driver of behavior [1113]. Therefore, we turn to risk perception theory to explain the differential public response to mask wearing.

COVID-19 risk and the social amplification risk framework

The social amplification risk framework (SARF) describes the dynamic social processes underlying risk perception [14, 15]. Empirical investigations have examined the public response to risk in terms of how risk perception intensifies or attenuates as a result of various amplification stations (e.g., media, social institutions, interpersonal interactions, social media) [15, 16]. The tenets of SARF view risk perception as a process in which risk signals (defined as messages about a hazard that affect people’s perceptions about the seriousness or manageability of a risk) interact with psychological, social, institutional, and cultural processes in ways that intensify or attenuate perceptions of risk and its manageability, and shape risk behavior [17]. The experience of risk is, therefore, not only an experience of a physical threat, but also the result of processes by which groups and individuals learn to ascribe new meanings to risk and create subjective interpretations of risk [15]. We define COVID-19 risk perception based on Kasperson [14, 15] as a communication process situating risk perception cognitively, but also socially, culturally, and historically. We used this definition to describe what risk signals were discussed in mask-related tweets on Twitter, which can give insight into what shapes the public response to SARS-CoV-2 risk and mask-wearing risk mitigation efforts [15, 16].

We aimed to use SARF to address the gap in research on risk that previously was dominated by a focus on technical objective constructions of risk, resulting in discrepancies between expert and lay perceptions of risk [18]. SARF focuses on how information processes, institutional structures, social group behavior, and individual responses shape the social experience of risk and on message receiver reactions to risk information contributing to risk consequences [18]. SARF acknowledges that many risks are only indirectly experienced, resulting in exposure to various risk signals having the potential to greatly influence and shape developing risk perceptions.

The conceptual risk framework SARF posits that intensification or attenuation of risk occurs in two stages: in the initial transfer of information about the risk and in the response mechanisms of society (behavioral, economic, and symbolic impacts) [15]. According to SARF, at least four information mechanisms can contribute to the intensification of risk perceptions in the initial transfer of risk information: (a) volume of information about a risk; (b) ambiguity of information or the degree to which it is disputed; (c) the extent to which information is dramatized; and (d) the symbolic connotations of the information [15, 16]. In SARF, the metaphor of amplification from classical communication theory refers to how various social agents generate, receive, interpret, and pass on risk signals. This study applied SARF to the social media context to uncover and describe how the initial transfer of risk information (as shared on Twitter) gives insight into how individuals create and ascribe meaning to Covid-19 risk and mask wearing.

Only a handful of studies have applied SARF to understand how the social media context contributes to created interpretations of risk [1923]. Social media platforms have become an increasingly mainstream source for news and public health risk information, warranting investigation into how this context contributes to interpretations of risk [24]. Studies have examined how social media brought attention to a risk issue not covered by traditional media [19, 20], ranging from examining differential linguistic expressions of blame during the 2015 Zika crisis across languages (English, Spanish, and Portuguese) and platforms (Facebook and Twitter) [21] to organizational use of hyperlinks, images, and videos that amplify cancer risk perceptions [22]. Social media contexts are ripe for studying how individuals and stakeholders generate, receive, interpret, and pass on risk signals to understand how the response to and transformation of risk signals result in consequent adoption or rejection of risk mitigation behaviors.

Twitter as social media risk message amplifier

Social media contexts, now a mainstream news and public health information source for U.S. adults [24], are an especially important communication context, given their widespread adoption across the United States and the world for public health risk information [25, 26]. The US leads in Twitter users, with 68.7 million users turning to the social media platform daily for their news, including COVID-19 information [26]. These interpersonal platforms with a mass media reach play an increasingly important role in alerting people to disasters or pandemics [22, 24, 25]. The social media context consequently offers a space wherein not only are risk signals shared, but often risk messages are edited or passed on with new additional affordances and meanings ascribed to them that in turn, shape interpretation of risk and subsequent adoption of risk prevention behaviors [17]. Against this backdrop, we investigated how Twitter mask tweets described COVID-19 risk (explicitly and implicitly), how they intensified or attenuated COVID-19 risk perceptions, and how risk perceptions changed during the first 5 months of the pandemic. Our study aimed to gain a greater understanding of the factors shaping public COVID-19 risk perceptions, but also how findings can inform public health messaging strategies to increase message acceptance around mask wearing. On a theoretical level, the study aimed to advance insights into the effects of the social amplification and attenuation of risk as a result of how risk is conveyed on social media.

Study aims

Guided by the tenets of SARF, we posed the following research questions:

  • RQ1: What are the different ways in which mask tweets express COVID-19 risk perceptions?

  • RQ2: How do expressions heighten and attenuate the salience of COVID-19 risk?

  • RQ3: How do these expressions change over time?

Methods

Data collection

The data for the current study included tweets from the microblogging platform Twitter across the first 5 months of the pandemic (January 24 through July 7, 2020). Tweets containing keywords related to the Coronavirus (see S1 List for list of keywords) were filtered and stored via the Twitter search API version 1.1 [27], which searches against the past 7 days of tweet history, and then Twitter Filtered Stream API version 1.1 [28], which filters on a real-time tweet stream. With the two APIs combined, a continuous stream of ~1% of all tweets with the given keywords were collected. COVID-19 and coronavirus tweets were collected at large from the beginning of the pandemic (January 2020). From this set of coronavirus-related tweets, we then filtered for tweets that contained geolocation information associated with the tweets and filtered for locations in the US. The sample of tweets for this study was restricted to the US and English tweets. The research team made the decision to narrow the scope of analysis on mask tweets in the US given that mask wearing was controversial particularly in the US in the early phases of the pandemic with variation in risk response across states.

In addition, from all Coronavirus-related tweets, we derived a set of 150 of the most popular news agencies and COVID-19 news-sharing accounts and filtered tweets from these accounts from the set of US geolocated tweets (see S2 List for a list of news agencies). We did so to ensure our dataset primarily reflected discussions and information sharing from citizens. We further filtered our dataset to remove tweets that only contained hashtags or user mentions (i.e., “@” or “#” prefixes) with no other words and non-English tweets. The dataset we used for this analysis was user generated content only. The dataset of tweets therefore, did not include instances where a user retweeted another tweet. This step resulted in a cleaned dataset of 592,317 tweets. These US geolocated tweets were then filtered again to narrow the focus to tweets mentioning mask-related keywords: mask, masks, facemask, or facemasks. This step resulted in a final set of 7,024 geolocated and mask-related US tweets that we used for the analysis.

Data analysis

A manual qualitative content analysis of the 7,024 tweets reflecting 6,286 unique users was conducted using a phronetic iterative approach [29, 30]. This data analysis approach alternates between inductively analyzing data (i.e., tweet content) to identify how tweets expressed COVID-19 risk perception (labeling ideas with descriptive codes) and then using theory, i.e., SARF, to guide data analysis for how data intensified or attenuated Covid-19 risk perceptions and consequently, attitudes toward mask wearing [16]. Of the 7024 tweets, 1072 (15%) were coded as not relevant to expressing risk perception. These mask tweets were comprised of mask advertisements, tweets discussing other countries, or difficult to make sense of the tweets. Explicit and implicit expressions of risk perception were included in the codebook. Additionally, for each risk perception aspect, i.e., theme, tweets were analyzed for how they intensified or attenuated COVID-19 risk perception.

Codebook development

A team of three coders met weekly across 9 months to review tweets, discuss interpretations, and label codes to develop a codebook with examples and exclusion and inclusion criteria. Code names and the codebook criteria were developed inductively and iteratively over time (see S1 Table for codebook). To ensure that emergent codes related to risk perceptions were discovered (i.e., saturation of codes), coders reviewed randomly sampled batches of 150 mask tweets from each month across the 5 months of data. Each coder reviewed and coded their sample of tweets independently, followed by the coding team meeting to discuss and compare how they labeled descriptive codes and interpreted each tweet for expression of COVID-19 risk. The coding team then iteratively developed the codebook describing how mask tweets covered topics as they related to risk. The coding team reviewed and discussed approximately 950 mask tweets to agree on interpretations of mask tweets, discussed how tweets reflected expressions of risk explicitly and implicitly, and reviewed the multiple ideas reflected in each tweet (a tweet could be labeled with up to three codes). In the codebook, example tweets were included for each identified code and articulated inclusion and exclusion criteria to discriminate and clarify interpretation of mask tweets.

Intercoder reliability

Once saturation of code development was reached after covering the full timeline of the data (5 months), intercoder reliability regarding the identified codes was computed for randomly sampled and assigned batches of tweets. Fleiss’ Kappa, which calculates the degree of agreement in classifying nominal codes over that which would be expected by chance, was computed for each code to assess intercoder reliability among the three coders [31, 32]. Kappa ranges from 0 (no agreement) to 1 (perfect agreement), with .61–.80 indicating substantial agreement and .81–.99 indicating almost perfect agreement [33, 34]. Initial kappa estimates were low for some codes. The coding team discussed discrepancies in tweet interpretation and clarified the codebook. New batches of 150 tweets were then coded independently to retest intercoder reliability, repeating this process until intercoder reliability of at least .60 was obtained to indicate substantial agreement among coders [3234].

Mask tweet frequencies and proportions

Descriptive statistics were computed for each identified mask risk code [6] during the 5 months of data to identify and examine mask discussion volume trends over time. External events were plotted in parallel to map associations between external events and peaks of mask tweet discussions (e.g., mask guidelines changes, stay-at-home orders, etc.).

Three phases marked changes in response to COVID-19 risk perception across the first 5 months of the pandemic (January 24 through July 7, 2020). Phase 1 included mask tweets beginning January 24, 2020, (first data collection point) through April 3, 2020, when the CDC recommended mask wearing for the asymptomatic general public. Mask tweets surged during and after April 3 in response to the guidelines, which contradicted prior explicit guidelines for the asymptomatic public to not wear masks. Phase 2 was marked by mask tweets after April 3, 2020, including March 2020, during which the first state lockdown and school closures occurred (e.g., California), and including May, marked by the death of George Floyd on May 25 and the subsequent Memorial Day, when Black Lives Matter (BLM) protests erupted. Phase 3 included mask tweets after Memorial Day until July 7 (after the July 4 weekend), during which there were BLM protests, a staggered reopening of the economy, summer, and the steady increase in COVID-19 cases across the country.

Data analysis of additional twitter affordances

The dataset of tweets was filtered for presence of hyperlinks or URLs, mask hashtags, mentions, and tweets expressed as questions (interrogatory; tweets that contained a question mark). Data were additionally analyzed for how the mask hashtags qualitatively changed over time, and what figures were “mentioned” in mask tweets (e.g., political, government, and public health officials, journalists).

Results

Data included a sample of 7,024 geo-located mask tweets from the first 5 months of the pandemic in 2020 (see Fig 1 for proportion of mask tweets across phases). Tweets were expressed as questions, observation of others, personal experiences, comments on policies, hypothetical scenarios, expressions of attitudes, and sharing of hyperlinks, photos, videos, hashtags, and mentions. Mask tweets increased over time (Fig 1) witnessing peaks and lulls with an overall trend of increasing across the first five months of the pandemic. Analysis of mask tweet content discovered six derived themes (Fig 2) in which COVID-19 risk perception was expressed by the public as: (a) severity discussions about the novel SARS-CoV-2 virus (18.0% of mask tweets, κ = .64); (b) who is at risk (26.4%, κ = .64); (c) mask effectiveness (10.7%, κ = .75); (d) mask guidelines and policies (15.6%, κ = .82); (e) political legitimizing of Covid-19 risk (18.3%, κ = .74); and (f) mask behavior of others (31.6%, κ = .74).

Fig 1. Proportion of mask tweets (N = 7024) of 592,317 COVID-19 tweets between January 24 and July 7, 2020 across pandemic phases.

Fig 1

Fig 2. Six derived mask tweet COVID-19 risk perception codes.

Fig 2

Each mask tweet could be coded for more than one risk perception category therefore, percentages do not add up to 100%. Mask effectiveness (N = 749/7004; 10.7%); Mask guidelines & policies (N = 1091/7004; 15.6%); COVID-19 severity (N = 1260/7004; 18.0%); Political legitimizing of COVID-19 risk N = 1281/7004; 18.3%); Who is at risk (N = 1850/7004; 26.4%); and Mask behavior of others (N = 2214/7004; 31.6%).

Change in mask tweet expressions over time

Tweet frequency of the derived themes changed across the first 5 months of the pandemic in phases, indicating that some themes were more prevalent early on and others became more prevalent as the pandemic evolved (see Fig 3). Within the first phase of the pandemic, marked by January 24 until April 3rd of 2020, among mask discussions, “who is at risk” was the most discussed theme followed by severity perception discussions. Tweets about who is at risk persisted and increased in the second phase of the pandemic (through end of May) to then persist across the third phase (June and July summer) but relative to “mask behavior of others” became less of a topic. Severity discussion, which peaked initially, witnessed a modest drop as discussion topic (relative to mask behavior of others, who is at risk, politicization, and guidelines) but then steadily increased in volume after March and peaked in the third phase of the pandemic after Memorial Day and beyond through summer. The volume of mask effectiveness tweets increased moderately throughout the 5 months. Mask guidelines as a topic peaked in Phase 2 (April 3, 2020) when the CDC changed its mask guidelines and dropped thereafter. See Fig 4 for external real-world events that occurred as Twitter mask discussions and risk perception themes evolved over time. Politicization of mask wearing as a topic steadily increased across the first 5 months of the pandemic. Discussions about “mask wearing behavior of others” steadily increased over time, dramatically increasing with the onset of summer in June. Information seeking expressed in tweets as questions persisted across the first 5 months, peaking in Phase 2 during state and school lockdowns (3.6% of tweets in Phase 1, 7.3% in Phase 2, and 5.6% in Phase 3).

Fig 3. Frequency of the six COVID-19 risk perception themes for the three major phases of the early pandemic response between January 24 and July 7, 2020.

Fig 3

The three phases are: Evolving COVID-19 risk (1/24/20–04/03/20), School and economic shutdown (04/04/20–05/25/20), and Gradual Economic Reopening (05/26/20–07/07/20).

Fig 4. COVID-19 risk perception themes and external events in 2020.

Fig 4

Data points are aggregated by 7-day periods (weeks). For each month in the graph, there are 4 data points. Each data point represents the frequency for a certain label during the past 7-day period.

Use of hashtags to amplify messages were used among 32.6% of twitter users (N = 2286/7004 tweets) with a total number of hashtags used (N = 5811/7004) reflecting 82.9%. Use of mentions to amplify or attenuate mask messages were used 39.6% (N = 2772/7004) with a total number of mentions (N = 4817/7004) reflecting 68.8%. Use of hyperlinks in mask tweets comprised 45.4% (N = 3182/7004).

We describe next how the six derived mask-wearing Twitter discussions were expressed and how tweets intensified and attenuated COVID-19 risk perception.

COVID-19 severity perceptions

Sense making of the new COVID-19 health risk was expressed in part through COVID-19 severity perception. Mask tweets expressed the severity of the emerging pandemic in a range of ways, from discussions about emergent social behaviors (e.g., hoarding of masks) to sharing reports of hospitalizations, hotspots, and deaths to comparisons with known risks like flu or automobile accidents. Early mask tweets (January 30, 2020) expressed little fear or concern by some in public settings, e.g., “the fear of the Wuhan virus is none on the Kriger train (northern California) today and no one is wearing a mask” to later in the pandemic, in June 2020, when tweets referred to second waves. Assessments of severity began with questioning and information seeking, e.g.: “Can we take a timeout and start gathering information on the Coronavirus? Where can you get masks? How to disinfect your work/home? What to teach your kids about other kids? CDC?” (February 24, 2020, Maryland).

Amplification of COVID-19 risk related to its perceived severity was expressed in a number of ways. Early pandemic phase mask tweets expressed severity by discussing mask wearing by the public as unusual and signaling alarm; rationing of mask supplies for short-staffed health care workers; hoarding and panic prescription filling; sharing media or public health reports of increases in coronavirus cases, hospitalizations, deaths, and hotspots; and mass production of masks signaling the magnitude of the evolving risk. Later pandemic phases expressed severity also by numbers and magnitude of harm, i.e., spreading cases, but also by overwhelmed hospital capacity, including intensive care unit bed capacity at maximum, increasing deaths, and hotspots.

In addition to tweet content amplifying risk perceptions, how tweets were shared also amplified risk perceptions. For example, tweet expressions used ALL CAPS to denote intensity; directed tweets at public officials through the use of mentions, e.g., @governors @POTUS, of those deemed responsible for (and failing) to manage the risk; used hashtags that expressed negative emotion, e.g., #scary; and shared photographs (e.g., empty grocery and supply shelves) and hyperlinks to news stories that amplified risk perception. The following exemplars illustrate the intensification of Covid-19 risk perception:

Sharing reports of COVID-19 cases in March 2020

Taking a plane back to Manhattan where the first case of coronavirus has just been confirmed‚ is triggering major anxiety. @Mabel_Syrup, can you remind us what face masks we should buy to protect ourselves? (March 2, 2020, FL).

Short-staffed paramedics and emergency medical technicians

FDNY short-staffed paramedics and EMTs expect to be overwhelmed by the coronavirus. N95 masks are being rationed, exposed medics aren’t being tested, and more then 150 FDNY members are now in quarantine https://t.co/5pYiScfMHf (March 20, 2020, NY).

Mask wearing alarming

“Not going to lie, people wearing masks kinda freaks me out! (May 3, 2020, MN).

Sharing of case and death counts

We just passed 10 MILLION Cases of #coronavirus The death toll is at 500,000. That’s a staggering 5% mortality rate (not to mention the quality of life of many of the survivors) People opting out of masks imagine killing 1 of every 20 of your friends. 2 Kids per classroom. Dead https://t.co/X1mGsWkoSV (June 29, 2020, CA).

Attenuation of perceived COVID-19 risk severity was equally expressed. Risk expressions downplayed COVID-19 risk in the following ways: (a) comparisons with familiar risks like influenza, i.e., “the flu” or car accidents; (b) tweets from regional parts of the country that were not yet witnessing the spread of the COVID-19 virus like rural and Midwestern states; (c) tweets claiming COVID-19 risk was not real; (d) tweets expressing case numbers were exaggerated; and (e) tweets about continuing routine habits (e.g., continuing with air travel), as shown by these examples:

Flu comparisons downplay COVID-19 risk

The coronavirus is the same level virus as the flu strand lol. Y’all gotta chill. . .If you’re using soap and water, wearing mask around sick people and in crowded areas you should be ok. Go on that trip. (March 3, 2020, TX).

Rural states not yet experiencing COVID-19

My state of Indiana had 54 common flu deaths, and zero COVID19 deaths. There was no statewide closing of bars and restaurants over the 54 common flu deaths, no buying up of toilet paper, surgical masks or hand sanitizer. It all needs to be put into perspective (March 16, 2020, IN).

Reported exaggeration of hospitalizations

Total current covid hospitalizations in Georgia are 783, that’s 0.0007% of the population. Can we stop with the mask and the fear now? https://t.co/Ss57URVrEV (June 7, 2020, GA).

Mask effectiveness

Debates about mask effectiveness implicitly and explicitly expressed COVID-19 risk perceptions. Mask effectiveness tweets disputed COVID-19 transmission routes, sharing “evidence” through news stories or academic articles and anecdotal hearsay from a range of “experts.” Anecdotal evidence ranged from repeating what public health officials stated to sharing what “the neighbor who is a TSA employee and knows the latest updates” said to sharing evidence that masks work because people in close proximity did not get infected. Finally, personal opinions were commonly shared. Other mask effectiveness tweets discussed the size of virus particles, conflating the size of the SARS-CoV-2 virus with air pollution particulate matter or how masks could be altered (e.g., coating masks with salt to neutralize the virus). Mask effectiveness conversations, therefore, shared a mix of anecdotal to verifiable evidence shaping interpretations of COVID-19 risk. Example tweets illustrate the different “evidence sharing” and “expert sources” mentioned.

Sharing expert source evidence about debate and transmission route

LA County health officials say coronavirus is not a problem in SoCal; people shouldn’t worry about it. They add that those masks people are wearing provide no protection against *any* respiratory illnesses. The key is thorough and frequent hand washing. #coronavirus (January 31, 2020, CA).

Surface transmission emphasis

Coming from a public health professional, using masks to prevent COVID-19 is NOT effective. You can still obtain the virus through touching. Our main culprit is our hands and the only effective prevention as of right now is hand washing and social distancing. #COVID2019 https://t.co/kjEGIXLaqR (March 17, 2020, NY).

Sharing scientific evidence (academic) of mask effectiveness

A new peer reviewed study found that public use of face masks prevented 66,000 coronavirus infections in NYC between April 6th and May 9th. The infection fatality rate for NYC is 1.4%. In one month, in one city, face masks prevented almost 1000 deaths. https://t.co/ZiPFpxziRe (June 30, 2020, MN).

Other mask effectiveness discussions expressed uncertainty about the effectiveness of different mask types and who masks protect. These expressions were often accompanied by explicit calls to wear a mask and expressions of lost credibility and trust in public health institutions due to discrepant messaging. At the same time, other mask tweets doubting their effectiveness made judgements about individuals wearing masks (e.g., stating that people wearing masks look like fools).

Who is at risk?

Tweets about who is at risk included sharing (a) media reports about who is at risk of COVID-19 in the United States; (b) personal experiences of getting sick; (c) family and friend networks experiencing COVID-19 illness or not; and (d) discussions about subgroups at risk of acquiring COVID-19 or blamed for spreading COVID-19 risk. Descriptions of personal experiences with COVID-19 amplified risk perceptions when the experiences involved describing severe or adverse COVID-19 symptoms, whereas asymptomatic COVID-19 experiences attenuated risk perceptions. Sharing of adverse personal experiences prompted users to endorse mask wearing to mitigate risk.

Personal network COVID-19 experience tweet

My BFF’s dad died last night. Alone, without his family. Because of COVID19 care homes are locked down. They were only allowed to see him once in the past 6 wks and only for a few minutes. Let that sink in before you go out without a mask to celebrate Memorial Day (May 25, 2020, CA).

Secondhand COVID-19 experience tweet

I was pleased to see my Uber driver wearing a mask tonight—then he told me his mother had just died of #COVID19—I just listened while he told me the whole story of her life—I’m just numb. I was coming back from the White House—it was the most real thing I had heard all day (March 26, 2020, Washington D.C.).

At the same time, although learning that COVID-19 could be deadly, others shared stories that COVID-19 risk did not result in serious illness.

Personal network not experiencing severe disease

Since COVID19 started I have been out literally EVERY WEEKEND around crowds of people, no mask on. . .yet I have never experienced any symptoms. No cough, fever, nothing. . .I’m healthy as a horse. Why is that? (June 9, 2020, NC).

Subgroups mentioned included travelers (both for spreading the virus and putting themselves at risk); older adults and those in long-term care facilities (being vulnerable); doctors, nurses, paramedics, first responders (i.e., health care workers) being vulnerable; those who are immunocompromised and fighting cancer; and essential workers like plant workers. In later phases of the pandemic, tweets described additional subgroups like young adults, black lives matter (BLM) protestors, travelers, and children as responsible for spreading the coronavirus and putting others at risk when not wearing masks. Stories of subgroups involved both subgroups vulnerable to disease risk and being blamed for putting others at risk.

Health care workers at risk due to absence of workplace protocols

I am very, very worried about #COVID19—I work in a large ER. In my opinion we should all be wearing N95 masks. We aren’t even being encouraged to wear masks because of the shortage of masks. N95 masks are on a need to have basis. . .and I’m not sure who makes that decision. (March 10, 2020, GA).

Young people being blamed for spreading COVID-19

@GregAbott_TX Let me get this straight, you’re blaming young people for Texas’ RAPID covid spike, when you’re the one who opened the state way too soon, downplayed the need to wear masks, & have taken away the ability for mayors to enforce masks & distancing guidelines #f*ckyou. (June 16, 2020, TX).

Mask guidelines and policies

Mask tweets expressed the contradictory public health guidelines issued by the CDC and public health officials and discrepant messaging and behavior by government officials.

Discrepant mask guidelines

Seems they want everyone to get sick. For three months they tell everyone not to wear a mask while the airborne Coronavirus spreads uncontrollably. Then when they finally tell people to wear a mask they recommend using a method that is least effective. https://t.co/yXdJ5rjf7d https://t.co/UFNycLreAL (April 4, 2020, DC).

Workplace protocol changes in select work environments signaled the prioritization of COVID-19 risk. Tweets described workplace mask mandates for occupations from construction and subway workers to police and restaurant workers.

Workplace policies recognizing risk (subway workers)

@NYCTSubway workers are given one mask and one pair of gloves for an entire week while continuing to work. I had no idea that’s all the PPE they get. Ironically, the majority of these subway workers are, you guessed it, black and latino. #ShutTheNYCSubwayDown https://t.co/8x4VzufIYs (April 18, 2020, NY).

Tweets ranged from reactions to mandatory mask wearing in some workplace settings while not enough enforcement in other settings and feeling at risk because others at work were not wearing masks.

Political legitimizing of risk

In this theme, mask tweets centered on (a) reactions to government (White House) messaging; (b) discussions about the lack of mask role-modeling by government authorities; and (c) state policy messaging by governors, mayors, and state and county public health agencies. Mask tweets referenced, through mentions, government and public health authorities, ranging from the former president, federal administrators, and the World Health Organization to governors and local public health agencies (see Table 1). Tweets across states and time reflected the evolving policies and conflicting messages shaping risk perception. Tweets mirrored in many cases the ongoing power struggle between the White House, which initially downplayed COVID-19 risk, and the CDC. Mask tweets also commented on former President Trump not role-modeling mask wearing and not implementing a federal plan to mitigate COVID-19 risk.

Table 1. Government, health, and other institutions mentioned (@) in mask tweets.

International public health organizations World Health Organization
Government institutions Centers for Disease Control and Prevention
National Institute of Health
Federal Emergency Management Agency
US Department of Health and Human Services
US Department of State
Federal Bureau of Investigation
Central Intelligence Agency
Department of Justice
Former President Trump
State representatives Katie Porter (CA)
Jimmy Gomez (CA)
State public health departments California (first state to implement shelter-in-place policy)
Michigan
Ohio
County public health officials Dr. Barbara Ferrer (Los Angeles County public health director)
Governors Gavin Newsom (CA)
Andrew Cuomo (NY)
Mayors Eric Garcetti (Los Angeles, CA)
U.S. public health institutions American Public Health Association
Academic institutions Johns Hopkins University
Georgia Southern University
UCLA Health
University of Birmingham
Media sources Rachel Maddow (CNN)
NPR (local)
The New York Times
John Oliver (comedian and TV host)
Fareed Zakaria
Physicians Dr. Anthony Fauci
Dr. Amy Acton (director of Ohio Department of Health who stepped down after receiving threats for mask policies)
Dr. Sanjay Gupta
Private individuals Bill Gates
Former President Barack Obama
2020 presidential candidates Bernie Sanders
Joe Biden
Elizabeth Warren
Mike Bloomberg
Economists Scott Minerd
Mohamed El-Erian
Noriel Roubini
Apps Weather Channel (coronavirus tracking)

Former President Trump and Vice President Mike Pence not role-modeling mask wearing

Good lord—all the president and VP have to do is wear masks and encourage others to do so as well. But that would mean they are leaders. https://t.co/2XiBjHu9Lx

(May 2, 2020, GA).

Former President Trump downplaying COVID-19 risk

trump on @espn yesterday said that he wants sports fans to go back to normal, no masks and on top of each other. Is this the official @WhiteHouse advise? Does @HHSGov and @CDCgov have any opinion on this? @maddow @NicolleDWallace (May 18, 2020, NV).

Growing distrust in government authority

I believe this doctor over the person in the Oval Office for COVID19 guidance!! Thank you Dr. Fauci for your service. @DrAnthony Fauci says he wears a mask to be a symbol of what “you should be doing https://t.co/h2NHL0hsVd (May 27, 2020, TN).

Power struggles between government and public health authorities

Watching the coronavirus WH task force briefing and you can see it behind his mask but Dr. Fauci is FED UP with the government (June 26, 2020, TX).

Partisan comments about mask wearing emerging

Republicans, do any of you support wearing masks to reduce the spread of covid? It seems like your head honcho has politicized something that’s just common sense responsibility (June 27, 2020, NC).

Tweets discussed politics as it relates to risk for Americans, with discussions linking political ideologies and personal mask-wearing behavior.

Political ideology shaping response to public health recommendations

Wearing masks should not be a political issue. #COVID19 does not discriminate based on political ideology. Wearing masks work and the work we have done collectively has helped save lives (May 18, 2020, TX).

Partisan reactions to mask wearing

COVID became overplayed BS those liberal people who get mad for others not wearing masks r the same ones ok with mass protesters out an about not wearing masks. . .https://t.co/GIsrxHCP7Z (June 4, 2020, AZ).

Tweets covered messaging, policies, and handling of the crisis by American political figures including governors, mayors, and public health officials. Tweets also discussed mask mandates and observations of mask-wearing behavior by politicians at any level.

Mentions of governors in mask-wearing comments

@GovMikeDeWine [Ohio] CDC recommends healthy people should not wear masks. If you would like to continue to wear a mask please move to China. This is the United States of America and we should not be forced to wear masks (June 14, 2020, OH).

Mask behavior of others

Composing the largest proportion of mask tweets, the theme of “mask behavior of others” described mask behavior in the context of daily life, including travel or commuting to work, social settings like restaurants and shopping, and people attending music concerts (see Table 2 for locations of mask-wearing observations). Twitter discussions changed over time, with early tweets describing alarm at observing mask wearing (January and February 2020), when mask wearing was not yet normative in the United States, to later pandemic phases (April to June 2020), when tweets expressed dismay at others not wearing masks after it was recommended for the general public to prevent the spread. Early observations (February 6, 2020) described the varying levels of risk perception tweeting, e.g., about one passenger on a commuter train who wore a mask next to another person showing little concern and making a peanut butter and jelly sandwich. Later phases (May 15, 2020) illustrated how “social cues of others” contributed to shaping interpretations of risk, e.g., “Bruh if covid-19 is so mf serious why aren’t they wearing masks?” (May 15, 2020, NC) and “I went to the dollar store and a bunch of ppl weren’t wearing masks and they were just chilling in the store, this don’t make sense” (May 2, 2020, TX).

Table 2. Locations of mask-wearing observations signaling risk in public settings, 2020.

Airports (passengers, airport employees)
Subway, trains, light rail, buses
Cruise ships
Entertainment or recreation (theme parks)
Pharmacies
Grocery stores
Hardware stores
Restaurants
Bookstores
Beauty and nail shops
Strip clubs
Schools
Nursing homes
Sports venues (baseball fields)
Hospitals
Manufacturing plants
Meatpacking plants
Retailers

Mask wearing in public alarming people in early pandemic phase

Why are some people wearing masks on Philadelphia trains? It is freaking me out. #Philadelphia #coronavirus (February 3, 2020, PA).

Observing others not wearing masks

@YNB There were so many people out shopping without masks yesterday that I predict our second awful wave of COVID19 will hit by July 4. There’s where your “independence” gets you! (May 24, 2020, CA).

Tweets about observations of others not wearing masks were often accompanied by calls to wear masks using hashtags and altruistic appeals (“take care of your neighbors and wear your mask tomorrow, wearing a mask says I respect you and the wellness of those you love and care for #BeSafeKentucky”) or guilt appeals (“Arkansas high school party triggers outbreak, if you are not wearing a mask you are putting everyone at risk of getting sick, #selfish, #mask4all, #wearamask”). Over time, as COVID-19 risk became more evident across the country by the rising number of deaths and geographic spread, the emotional tone of tweets expressed increasing anger by some, and the nature of hashtags and use of expletives reflected this: “It’s crazy that over 72,000 people have died in a couple of months from COVID-19 and you can’t wear a f*ing mask #selfish” (May, 2020, OK). Even the governor of California, Gavin Newsom, shared an expletive hashtag on June 22, 2020: “#wearadamnmask” (see Table 3 for how mask hashtags changed during the first 5 months of the pandemic). Observation of others also included improper mask wearing: “I see so many people wearing masks but not over their nose, WTH?” (June 23, 2020, CA).

Table 3. Mask hashtags.
February 17 #mask
February 24 #N95mask
March 2 #facemask
March 20 #PPE
March 21 #maskshortage
March 23 #maskforall
April 4 #wearamask
April 4 #MasksSaveLives
April 30 #newnormal
May 11 #maskup”City” (PHL) (HOUSTON)
June 1 #nomask
June 15 #maskupAZ
June 22 #wearadamnmask
June 26 #realmenwearmasks
July 10 #heroeswearmasks

Mask tweets about the mask behaviors of others also included role-modeling mask wearing. Explicit mentions of role modeling referenced journalists and celebrities, e.g., “good to see Sid Hartman sporting a @twins #Minneapolis mask” (April 8, 2020 MN) whereas other high-profile political pundits were observed not role modeling: “Coronavirus stricken George Stephanopoulos ignores mask mandate during Hamptons stroll” (April 21, 2020, NY).

Observations of mask wearing becoming normative over time were expressed in a variety of ways: “We’re all just doing this? All of us wearing masks and acting like this is completely normal? Cool.” (May 1, 2020, IA); discussions of mask wearing as a daily ritual when leaving home, like grabbing keys, wallet, phone, and a mask; sharing internal thoughts, e.g., “I never thought I’d be comparing people’s masks as I grocery shop” (April 9, 2020, VT), and using hashtags like “#NewNormal.” These tweets reflected an increasing acceptance of Covid-19 risk as part of daily life.

Expressions of tweets ranged from commentary to judgements, calls to wear or not wear masks, and hypothetical discussions about others’ mask-wearing behavior and potential consequences (e.g., putting others at risk). The tweets of medical, scientific, or public health figures (e.g., Dr. Anthony Fauci), journalists, celebrities, or those in a personal network either modeling or observing behavior of others expressed reactions to mask wearing becoming normative over time, e.g., “So now we need our hat, keys, coat and mask to leave the house? #CoronavirusOutbreak” (April 11, 2020, NC). Other examples illustrate how mask wearing was initially not normative and provoked certain reactions to mask wearing becoming normative and eliciting different reactions later in the pandemic:

Sharing experience of wearing mask when no one else was

Now the CDC recommends everyone to wear masks and if you don’t have a mask, wear a scarf around your mouth and nose. Let me tell you, I went to CVS dressed like that and people looked at me like I was a criminal. Hard pass. (April 4, 2020, PA).

Behavior of others

This is not acceptable! #AmericanAirlines @AmericanAir has my husband and daughter inside the plane for almost 3 hours @LGAairport due to mechanical issues. There are people with NO masks inside the plane #pandemic #flight1788 #CoronavirusOutbreak (June 7, 2020, NY).

Discussion

This empirical study described through Twitter the public response to mask wearing and perceived COVID-19 risk during a critical time in the evolution of the SARS-CoV-2 outbreak between January and July 2020. We investigated how mask tweets expressed COVID-19 risk perception, focusing on the antecedents that shaped risk perception and how they changed dynamically over time. We did this through the perspective of citizens who actively participated in shaping risk perceptions as “individual amplification or attenuation stations,” by responding to, commenting on, and actively sharing risk messages with select networks, as documented on social media. Psychology and communication research have shown that perceived not objective risk motivates behavior [12, 13, 35, 36]. For this reason, it is important to understand the how COVID-19 risk perception was diffused, amplified and attenuated as the pandemic crisis unfolded. As Twitter users shared mask tweets with their networks, and included hyperlinks, hashtags and or mentions these communication acts (as well as what content was passed on) shaped COVID-19 risk perceptions, which and may or may not have had consequences for mask-wearing.

We discuss implications of the six derived themes reflecting social media conversations about COVID-19 risk, how risk was expressed, and how it changed over time from risk severity perceptions to mask effectiveness debates, questions and discussions about who is at risk, debates about mask guidelines and policies, the political legitimizing of risk by government officials (or lack thereof), and the role of mask behavior of others in shaping risk response. The themes reflect subjective rather than objective constructions of risk.

We examined the flurry of Twitter discussions of COVID-19 risk and related communication as it unfolded in real time, shaping risk perceptions, responses, and consequent risk mitigation mask-wearing behaviors. Our analysis of mask tweets during 2020 describe a history of the American societal reaction to COVID-19 risk and show that risk perceptions were expressed in a much more expanded range than “objective, rationale” risk. While mask effectiveness tweets debated transmission routes, other mask tweets particularly “behavior of others” attest to the social experiences that contributed to constructions of COVID-19 risk that in turn, motivate behavior. Twitter users took advantage of the affordances of the social media platform to document, engage, amplify, and attenuate COVID-19 risk perceptions, including making sense of the unfamiliar risk. Mask tweets reflected the mediated and shared experiences of COVID-19, passing on information through weak and strong network ties, adding hashtags and hyperlinks to amplify or attenuate messages, and using mentions to draw the attention of various government authorities and stakeholders. Tweets expressed both the social experiences and the isolating and threatening experiences that COVID-19 posed as parts of the country experienced lockdowns, shelter-in-place orders, and school closures while the virus spread. Responses to mask wearing evolved from initial signals of alarm to calls for all to wear masks as desperate pleas to mitigate the very real and collective risk to society increased.

Severity of COVID-19 risk was expressed in various ways because the risk was initially unclear. COVID-19 severity perception was intensified by descriptions of increases in hospitalizations, deaths, intensive care unit beds at capacity, and geographic hotspot discussions. However, it was also downplayed by comparisons with the flu, rural states not yet experiencing COVID-19, and reports of exaggerations or that COVID-19 is a hoax. Severity assessment as an aspect of risk perception has been recognized in multiple health behavior change theories [37, 38]. Amplification occurred in risk expressions as feelings, e.g., through expressions of dread and negative emotions (anxiety and fear in both content and hashtags, e.g., #scary), discussions about hoarding and rationing of masks, and observations about mask wearing signaling alarm while attenuation occurred in expressions of ambivalence about mask wearing.

Mask effectiveness debates peaked end of March through early April 2020, when the CDC issued guidelines for the asymptomatic general public to wear masks in public settings [39]. Mask effectiveness debates heightened the uncertainty surrounding the science and transmission of SARS-CoV-2 (contact, droplet, airborne), casting doubt on recommendations. Early in the pandemic, surface transmission was emphasized by public health and government officials, with an emphasis on hand washing and cleaning surfaces [8]. Public health officials did not mandate mask wearing early and even explicitly recommended not wearing masks for the general asymptomatic public [39]. Mask effectiveness tweets explicitly and implicitly shared the relatively more “objective” evidentiary appeals that signaled risk and contributed to interpretations of risk (implicitly related to transmission routes).

Debates brought attention to COVID-19 risk and heightened uncertainty around whether the recommended risk mitigation behavior was warranted, with several studies having been reported since to justify the policy of mask wearing for SARS-CoV-2 transmission control [5, 8, 4042]. Discussions about risk also centered on not only transmission routes, but also who is vulnerable.

A continuous assessment of the unfamiliar and evolving COVID-19 risk was expressed in tweets about who is at risk to assess risk susceptibility in the sense-making process. Discussions both amplified and attenuated risk. People sharing experiences of family members or the users themselves getting very sick or dying amplified risk perceptions, whereas others sharing that they did not get sick despite being in public settings or large gatherings attenuated risk perceptions. Tweets about who is at risk represented the second largest volume of tweets after those discussing the behavior of others. In these tweets, individuals learned about the unfamiliar COVID-19 risk through the mediated experiences of others in lieu of direct experience.

Risk perception literature refers to the learning of risk through mediated, shared experience of others as an availability heuristic, wherein vivid examples are judged as reflecting higher risk [43, 44] and a scenario is activated when people are confronted with a new and complex risk with which they have limited personal experience [4446]. Personal stories served to make salient and amplify the invisible and psychologically distant risk for some. In construal level theory [47], the perception of risk is in part shaped by subjective and psychological proximity, with more direct exposure and experience to risk resulting in greater risk perceptions if the hazard (disease, in this case) is observed.

Discussion of subgroups and who is vulnerable signaled risk perception as group identity (e.g., travelers, health care workers, older adults, essential workers, children, young adults, men). Children were initially deemed at low risk and spared severe disease. Discussions initially centered on health care workers and those living in long-term care facilities, followed by essential workers. Individuals discussed changing workplace protocols or alternatively, no change in workplace setting mask-wearing protocols and policies. Understanding how social identity shapes risk perceptions has played a significant role in understanding and effectively approaching behavior change across behaviors—for example, smoking cessation [4852]. Twitter discussions suggest that social and political identities shaped COVID-19 risk attitudes and consequent response to risk mitigation recommendations [53].

Discrepant federal guidelines represented another way in which the public discussed and made sense of COVID-19 risk. The public takes its cues about which risks to prioritize, in part, from government and authority institutions. Risk governance theory recognizes the role of risk regulations by social institutions drawing boundaries around what is considered acceptable and not acceptable risk [5456]. Risk governance theory recognizes that the public is not homogeneous and that different subgroups will perceive risk differently [56, 57]. For this reason, identifying social determinants of risk perceptions becomes increasingly important in explaining risk response.

Discussions about the CDC mask guidelines peaked in early April, when the CDC issued its recommendation for the asymptomatic public to wear masks in public settings (April 3, 2020). Mask tweets expressed the discrepancies in CDC guidelines, reacting to the about-face and months-late recommendations. Public response to the CDC changing its official guidelines signaled that citizens felt the risk was more widespread than publicly acknowledged by government authorities, resulting in lost credibility and trust in the government institution. The CDC director, Robert R. Redfield, stated on February 27, 2020, “There is no role for these masks in the community,” adding, “These masks need to be prioritized for health care professionals that as part of their job are taking care of individuals.” Also, U.S. Surgeon General Dr. Adam Jerome tweeted on February 29 to not purchase masks: “Seriously people—STOP BUYING MASKS! They are NOT effective in preventing general public from catching #Coronavirus, but if healthcare providers can’t get them to care for sick patients, it puts them and our communities at risk! https://t.co/UxZRwxxKL9.”. When the CDC released guidelines to wear masks in public on April 3, 2020, Twitter reactions referenced the discrepant messaging and spiked [39].

Government institutional messaging from not only federal public health institutions like the CDC but also the U.S. government contributed to COVID-19 risk perception and mask-wearing attitudes. Tweets by former President Trump, former Vice President Pence, and various White House officials and governors were discussed on Twitter in relation to masks. Mask tweets amplified COVID-19 risk perception through explicit mentions of government officials, especially governors. When former President Trump did not wear a mask and played down COVID-19 risks, these messages and the absence of mask role modeling resulted in politicization of the handling and management of COVID-19 risk mitigation. Risk governance theory recognizes how risk response is shaped by social interactions among actors including government, whose messaging is no longer a centrally controlled creation [54].

Tweets reflected a range of responses referencing the politicization of mask wearing. Mask wearing being ascribed many meanings and deeply connected to social and cultural practices has also been observed since from interviews with from health experts across the globe [58]. Mask wearing was consequently discussed on Twitter not only as protecting against COVID-19 as a collective risk, but also as a form of government control. Mask tweets mentioning government authorities and politicians attest to the significant role government officials play in acknowledging, legitimizing, and prioritizing competing risks for the public. Politicization of mask wearing in the United States resulted in attenuation of risk perceptions for some and intensification for others as mistrust grew. Politicization began with former President Trump downplaying COVID-19 risk, not acknowledging its seriousness, and not role-modeling mask wearing. By not wearing a mask, the president’s actions symbolically signaled Covid-19 as lower risk priority.

Although government mask guidelines typically serve to sanction and legitimize risk, politicization in the case of COVID-19 under the Trump administration undermined the credibility that institutional signaling plays in legitimizing a public health risk as a prioritized threat [59]. As sociologist Ulrich Beck argued, we live in a risk society with everyday competing risks, and in this capacity, institutional messaging serves to legitimize risks that warrant prioritization [60]. With the science of COVID-19 risk evolving and not clearly communicated, the public expressed and directed questions about whether mitigation measures such as mask wearing were necessary at political, government and public health officials amplifying risk and confusion.

Tweets about the mask behavior of others comprised the largest category of mask conversations related to COVID-19 risk perceptions on Twitter. Tweets observing mask wearing in public settings during travel (air, cruise ship, or commuting on public transport) in early 2020 signaled and intensified risk perceptions by visibly linking risk typically associated with hospital settings to public settings and social activities (e.g., travel, grocery store visit) whereas later phases reflected to some degree normalizing mask wearing. This change in mask wearing from a medical to public setting reflected a dramatic shift in the public’s psychological bearing and grasping of COVID-19 risk and is in part reflected in mask wearing reactions. This experience has in fact also been observed in other countries across the globe despite other customs [58].

The public and collective nature of COVID-19 risk led to social relational norms shaping risk perception as the pandemic’s toll on society grew over time. Social norms shaping risk perception and consequent behaviors have been observed across health behaviors [6163]. Over time, mask wearing shifted from being a personal, individual behavior change to reflecting social responsibility at the collective level. Over a third of mask conversations on Twitter reflected observations of others wearing or not wearing masks over time. Former President Trump not serving as a role model with respect to mask wearing led to partisanship regarding the public health recommendation to wear masks and resulted in some citizens questioning public health guidelines and even whether COVID-19 risk was real [9]. Furthermore, the meaning ascribed to mask wearing in the politicized context changed over time, with mask wearing signaling social identity for some, whereas for others, it signaled the collective effort to mitigate spread of risk (after April 3, 2020).

Changes in workplace norms and policies were also discussed in mask tweets and shaped risk perception by signaling, through workplace protocols, recognition of the public health risk of coronavirus as real, serious, and to be prioritized. This was observed by tweets of employees, especially essential workers like Uber drivers, restaurant workers, office workers, subway workers, construction workers, aviation maintenance workers, and plant workers. Risk signals from workplace policies play an important role in sanctioning a risk as legitimate and consequently, contributing to interpretations of risk.

SARF insights: Social media mechanisms of amplification and attenuation

SARF focuses on receiver reactions to risk messages to gain insight and explain divergence in meanings that individuals ascribe to risk. This study contributes to the risk perception literature by identifying how the public discussed COVID-19 risk, i.e., citizens who shared unsolicited and authentic tweets reflecting their thoughts, and uncovering how social experiences of risk contributed to shaping risk perceptions. Many tweets reflected responses and reactions to the social behavior of others and political officials, interacting to shape dynamic and evolving public COVID-19 risk perceptions and negotiating and contributing to drawing boundaries and rules for acceptable behavior as it related to the novel COVID-19 risk. Amplification (i.e., intensification and attenuation) occurred simultaneously on Twitter as citizens exchanged risk information explicitly and implicitly.

Mechanisms of information transmission on Twitter that contributed to amplification and attenuation of COVID-19 risk in mask tweets occurred both through structural affordances of the microblogging platform (mentions, retweets, hyperlinks, images, videos) and also through volume and the way content was shared. Discussion about ambiguity in guidelines, disputes about the science of COVID-19 transmission, power struggles between government and public health officials, politicization, and social identity amplified and shaped risk perception (e.g., with mask wearing taking on new meaning for some). Debates between experts and government officials functioned to heighten uncertainty about the severity and prioritization of COVID-19 risk, the reliability of recommendations, and the trustworthiness of basic facts downplaying risk perceptions. Debates likely also increased public doubt about the state of knowledge and mask recommendations. Dramatization by former President Trump refusing to role-model mask wearing led to both heightened and attenuated risk perceptions. In contrast to increased media attention about the 2014–2016 Ebola virus outbreak [64] that reflected a negligible risk to U.S. citizens, risk from COVID-19 was downplayed by the government when, in fact, the real risk to the U.S. public steadily increased and was deadly, killing more than half a million people [2].

Our study describes six ways in which COVID-19 risk was discussed in mask tweets on social media, a platform that functions as a risk amplification and attenuation station through the nature of the content but also through mentions to government officials, journalists, and politician stakeholders (e.g., @POTUS, @Trump, @governor) [65]. SARF contends that social amplification of risk occurs at two stages: in the initial transmission of information about a risk (we examined the social media context) and in the response mechanisms of society (behavioral, economic, and symbolic impacts). Amplification and attenuation occurred simultaneously on Twitter, attesting to the multiple ways in which information flow in this environment functions in complex ways. User engagement in social media contexts is uncontrolled and can thereby complicate dissemination of official public health messaging.

Implications for public health messaging

This study makes salient that citizens ascribed many meanings to mask wearing and COVID-19 risk. Not only were many meanings ascribed, but also risk perceptions were shaped by many levels of influence from relational aspects such as behavior of others to workplace policies and government guidelines. Mask wearing was interpreted not only as a risk mitigation measure as it was intended, but also as symbolic of political ideology, government control for some–suggesting evidence for social constructions of COVID-19 risk.

The simultaneous amplification and attenuation of COVID-19 risk perception in mask tweets complicates the potential for effective public health messaging. Tailored messaging delivered to subgroups is likely warranted given the many meanings ascribed to mask wearing. A social relational approach is indicated based on mask behavior of others playing a role in risk perceptions. For example, to reach young adults, the largest unvaccinated group to date, public health messaging may be more effective by tapping into social identity and social relational norms given the role of mask behavior of others and in-group identity having influence. Collective responsibility messaging delivered by in-group members may be needed to effectively reach a particularly subgroup whether young adults, a particular subgroup who identifies with a race/ethnicity, or political affiliation.

Results indicate COVID-19 risk perception is shaped by institutional and guideline and policy level messaging. These results suggest that another public health messaging approach emphasizing structural determinants of risk that shifts messaging away from individual responsibility may have better success of acceptance given the mixed messaging occurring at the individual level. Public health messaging emphasizing workplace policies setting the norms for masking may have the best chance for success. This has been observed in the effects of policy level masking [66].

Given that the American public turns to social media platforms for crisis risk information and response, investment in monitoring social media sites as amplification and attenuation stations for public health risk is warranted. Public health officials will need to invest in building sites of influence and trust on social media platforms like Twitter. Rapidly relaying credible, accurate and timely information during disasters is increasingly expected [24]. Building trust and credibility on social media offers an opportunity to build public health influence to increase adherence with recommended behaviors that mitigate real risks. The United States was one of the few countries where mask wearing became politicized and controversial early in the pandemic [9].

Limitations

Although the study provides theoretical and practical implications for future research, it is necessary to note some limitations. First, the study was based on a random ~1% sample of coronavirus and subsequent mask keyword-related tweets to examine COVID-19 risk perceptions. Different Twitter data-sampling strategies have shown that a random sample detected the same number of themes as a topic sample, suggesting that it was useful to qualitatively assess frequencies [67]. A second limitation involves the biases inherent in the data source of Twitter users, who represent citizens many of whom are young adults (ages 18 to 29 and comprise the largest group at 42%), more likely to identify as Democrat, to be highly educated, have higher incomes, slightly more likely to be men (62%), and more likely to be concentrated in urban and suburban geolocations [6870]. Twitter users reflect a range of stakeholders, including media organizations. Therefore, we filtered out the top 100 media organizations from the final mask tweet sample to reflect predominantly citizens tweeting about masks and mask behavior. We also manually read and analyzed the 7,000-plus mask tweets to confirm the tweets were sensical and not generated by bots. A third limitation is that Twitter data covered the first 5 months of 2020 pandemic and may not generalize to Twitter discussions about later points in the pandemic after July 2020. Having said this, Twitter volume related to COVID-19 peaked during the first 5 months, representing a critical time period in which to analyze key conversational themes emerging about COVID-19 risk. Results may be generalizable to early critical stages of a public health crisis. Future research investigating how structural social media message attributes (e.g., hyperlinks, images, videos, mentions, retweets) amplify and attenuate risk perceptions, in addition to a content will contribute to elaborating on the dynamic communication process shaping risk perception on social media. Retweets were not available in our dataset given Twitter policy at the time of data collection. We did capture the proportion of tweets using hyperlinks, mentions, hashtags and questions to begin to understand the use of social media structural communication strategies in addition to content.

Conclusions

As social media grows in its function as a mainstream news platform, especially for accessing public health information during disasters and pandemics, public health and government officials will benefit from monitoring social media contexts that play a role in shaping citizen risk response. With Twitter being the most popular social network for news consumptions and having 69 million monthly active users in the US alone [70], it serves as a useful vehicle for learning about real-time public reactions to public health crises. Intensification and attenuation of COVID-19 risk communication on Twitter unfolded in unique, rapid, and broad ways during the first 5 months of the COVID-19 pandemic, contributing to diverging constructions of COVID-19 risk and consequently, divergent adherence to the recommended risk mitigation behavior of mask wearing. Individuals communicated their personal experiences, and real-time reactions to the emerging COVID-19 risk, sharing not only content, but directing reactions to the emerging risk, behavior of others and response to changing guidelines with the use of mentions, videos (both of observation of others and personal videos) as collective pleas were made to wear masks, as well as the emergence of mask hashtags about shortage of personal protective equipment (PPE) for healthcare providers to collective risk appeals with hashtags about masking for all or mask up “a city” and making appeals to social identities with #realmenwearmasks.

Results can be generalized to early critical stages of public health crises regarding factors that may influence risk perception. Particularly under conditions of high uncertainty, and ambiguity, normalizing expected risk mitigation recommendations (behavior of others) plays a critical role. Attention to how a public health threat is communicated with respect to signals of risk severity, who is at risk and group identity, behavior of others (e.g., norms, workplace policies), and the extent to which institutional messaging legitimizes and prioritizes public health risk in an environment of competing risks will set the tone for message acceptance. Counter to prior research, which suggested that public health messaging should focus on increasing severity and threat [6], our results suggest this approach will fall short of the desired response.

Mask tweets were dynamic and reflected many meanings and questions in the communication of COVID-19 risk over time. While hyperlinks contextualized tweets, mentions at public officials served to direct questions or blame, rhetorical questions reflected uncertainty and hashtags took on emotional nature as impacts of the real COVID-19 risk became more dire with time. The six derived themes identified reflect the multiple factors shaping risk perception dynamically in the sense-making process. Attention to social and group identity constructions of risk, normalizing public health recommendations through workplace policy and shifting away from individual responsibility in a politicized climate may prove advantageous for effective public health messaging. Our results indicate that citizens ascribed many meanings to masking and the simultaneous amplification and attenuation of COVID-19 risk complicates public health messaging. The social, psychological, and institutional experience of risk (behavior of others, norms, role modeling and messaging of government) come into play as much if not more so than objective risk perceptions and need to be taken into account in public health messaging when the goal involves increasing compliance with recommended risk mitigation behaviors.

Supporting information

S1 List. Coronavirus keywords.

(DOCX)

S2 List. Top 150 news agencies filtered.

(DOCX)

S1 Table. Risk perception codebook.

(DOCX)

Data Availability

According to Twitter agreement, we release IDs (Tweet and User ID) of the 7k mask tweets, but their content. The IDs are published in the file https://github.com/ISG-ICS/Geolocated_USA_tweets_w_mask_IDs/blob/main/geolocated_USA_tweets_w_mask_full%20-%20geolocated_USA_tweets_w_mask_IDs_only.csv

Funding Statement

Mark, G., Li, C., Hopfer, S. were awarded an National Science Foundation Covid19 award #2027254. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.WHO, Statement on the second meeting of the International Health Regulations (2005) Emergency Committee regarding the outbreak of novel coronavirus (2019-nCoV). 2020, WHO: Geneva, Switzerland. [Google Scholar]
  • 2.Dong E. and Gardner L. An interactive web-based dashboard to track COVID-19 in real time. Lancet Infectious Disease. 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Feng S., et al., Rational use of face masks in the COVID19 pandemic. The Lancet. 2020. 8: 434–436. doi: 10.1016/S2213-2600(20)30134-X [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Leung N.H.K., et al., Respiratory virus shedding in exhaled breath and efficacy of face masks. Nature Medicine, 2020. 26: p. 676–680. doi: 10.1038/s41591-020-0843-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Stutt R.O.J.H., et al., A modeling framework to assess the likely effectiveness of facemasks in combination with lock down in managing the COVID19 pandemic. Proceedings Royal Society A, 2020. 476: p. 1–21. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Kasting M.L., et al., Public perceptions of the effectiveness of recommended non-pharmaceutical intervention behaviors to mitigate the spread of SARS-CoV-2. PloS ONE, 2020. 15(11): p. e0241662. doi: 10.1371/journal.pone.0241662 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Haischer M.H., et al., Who is wearing a mask? Gender, age, and located related differences during the COVID-19 pandemic. PloS ONE, 2020. 15(10): p. e0240785. doi: 10.1371/journal.pone.0240785 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Zhang R., et al., Identifying airborne transmission as the dominant route for spread of COVID19. PNAS, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Milosh M., et al., Unmasking partisanship: Polarization undermines public response to collective risk. 2020, Becker Friedman Institute for Economics at University of Chicago: Chicago, IL. [Google Scholar]
  • 10.Milosh M., et al., Political polarization impedes the public policy response to COVID19. 2020. [Google Scholar]
  • 11.Slovic P., The perception of risk. Science, 1987. 236: p. 280–5. doi: 10.1126/science.3563507 [DOI] [PubMed] [Google Scholar]
  • 12.Slovic P., et al., Affect, risk, and decision-making. Health Psychology, 2005. 24(4): p. S35–40. [DOI] [PubMed] [Google Scholar]
  • 13.Rimal R.N. and Juon H.S., Use of the risk perception attitude framework for promoting breast cancer prevention. Journal of Applied Social Pscyhology, 2010. 40(2): p. 287–310. [Google Scholar]
  • 14.Kasperson R.E., et al., The social amplification of risk: a conceptual framework. Risk Analysis, 1988. 8: p. 177–187. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Kasperson J.X., et al., The social amplification of risk: assessing fifteen years of research and theory, in The social amplification of risk, Pidgeon N., Kasperson J.E., and Slovic P., Editors. 2003, Cambridge University Press: Cambridge, UK. p. 13–47. [Google Scholar]
  • 16.Kasperson R.E., The social amplification of risk: progress in developing an integrative framework, in Social Theories of Risk, Krimsky S. and Golding D., Editors. 1992, Praeger: Westport, CT. p. 153–78. [Google Scholar]
  • 17.Renn O., Risk amplification and the social amplification of risk communicating risks to the public, in Communicating risks to the public: Technology, Risk, and Society, Kasperson J.E. and Stallen P.J.M., Editors. 1991, Springer: Dordrecht. p. 287–324. [Google Scholar]
  • 18.Strekalova Y. and Krieger J., Social amplification of risk in health and risk messaging, in The Oxford Encyclopedia of Health and Risk Message Design and Processing, Parrott R., Editor. 2018, Oxford university press: Oxford, UK. p. 67–83. [Google Scholar]
  • 19.Chung I.J., Social amplification of risk in the Internet Environment. Risk Analysis, 2011. 31(12): p. 1883–1896. doi: 10.1111/j.1539-6924.2011.01623.x [DOI] [PubMed] [Google Scholar]
  • 20.Fellenor J., et al., The social amplification of risk on Twitter: the case of ash dieback disease in the United Kingdom. Journal of Risk Research, 2018. 21(10): p. 1163–1183. [Google Scholar]
  • 21.Wirz C.D., et al., Rethinking social amplification of risk: Social media and Zika in Three Languages. Risk Analysis, 2018. 38(12): p. 2599–2624. doi: 10.1111/risa.13228 [DOI] [PubMed] [Google Scholar]
  • 22.Strekalova Y. and Krieger J., Beyond words: Amplification of cancer risk communication on social media. Journal of Health Communication, 2017. 00: p. 1–9. doi: 10.1080/10810730.2017.1367336 [DOI] [PubMed] [Google Scholar]
  • 23.Ng Y.J., Yang J., and Vishwanath A., To fear or not to fear? Applying social amplification of risk framework on two environmental health risks in Singapore. Journal of Risk Research, 2018. 21(12): p. 1487–1501. [Google Scholar]
  • 24.Shearer E., Social media outpaces print newspapers in the US as a news source. 2018: Pew Research Center. [Google Scholar]
  • 25.Oh S., Lee S.Y., and Han C., The effects of social media use on preventive behaviors during infectious disease outbreaks: The mediating role of self-relevant emotions and public risk perception. Health Communication, 2020. doi: 10.1080/10410236.2020.1724639 [DOI] [PubMed] [Google Scholar]
  • 26.Sinnenberg L., et al., Twitter as a tool for health research: a systematic review. American Journal of Public Health, 2017. 107(1): p. e1–e8. doi: 10.2105/AJPH.2016.303512 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Twitter search API v1.1. 2021.
  • 28.Twitter Filtered Stream API v1.1. 2021, Twitter.
  • 29.Tracy S.J., Data analysis basics: A phronetic iterative approach, in Qualitative research methods: collecting evidence, crafting analysis, communicating impact, Tracy S.J., Editor. 2019, John Wiley and Sons: Hoboken, NJ. p. 208–235. [Google Scholar]
  • 30.Tracy S.J., A phronetic iterative approach to data analysis in qualitative research. Journal of Qualitative Research, 2018. 19(2): p. 61–76. [Google Scholar]
  • 31.Fleiss J.L., Measuring nominal scale agreement among many raters. Psychological Bulletin, 1971. 76: p. 378–382. [Google Scholar]
  • 32.O’Connor C. and Joffe H., Intercoder reliability in qualitative research: Debates and practical guidelines. International Journal of Qualitative Methods, 2020. 19: p. 1–13. [Google Scholar]
  • 33.Hallgren K.A., Computing inter-rater reliability for observational data: an overview and tutorial. Tutor Quantitative Methods Psychology, 2012. 8(1): p. 23–34. doi: 10.20982/tqmp.08.1.p023 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Zapf A., et al., Measuring inter-rater reliability for nominal data—which coefficients and confidence intervals are appropriate? Medical Research Methodology, 2016. 16(93): p. 1–10. doi: 10.1186/s12874-016-0200-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Breakwell G.M., The psychology of risk. 2014, Cambridge, UK: Cambridge University Press. [Google Scholar]
  • 36.ter Bogt T.F.M., et al., Body mass index and body weight perception as risk factors for internalizing and externalizing problem behavior among adolescents. Journal of Adolescent Health, 2006. 39(1): p. 27–34. doi: 10.1016/j.jadohealth.2005.09.007 [DOI] [PubMed] [Google Scholar]
  • 37.Paek H. and Hove T., Risk perception and risk characteristics, in The Oxford Encyclopedia of Health and Risk Message Design and Processing, Parrott R., Editor. 2017, Oxford University Press: Oxford, UK. p. 504–514. [Google Scholar]
  • 38.Rimal R.N. and Real K., Perceived risk and efficacy beliefs as motivators of change: Use of the risk perception attitude (RPA) framework to understand health behaviors. Human Communication Research, 2003. 29(3): p. 370–399. [Google Scholar]
  • 39.Fisher K.A., et al., Factors associated with cloth face covering use among adults during the COVID19 pandemic—United States, April and May 2020. Morbidity and mortality weekly report, 2020. 69: p. 933–937. doi: 10.15585/mmwr.mm6928e3 [DOI] [PubMed] [Google Scholar]
  • 40.Rader B., et al., Mask-wearing and control of SARS-CoV-2 transmission in the USA: A cross-sectional study. Lancet Digital Health, 2021. 3(3): p. e148–e157. doi: 10.1016/S2589-7500(20)30293-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Spinelli M.A., et al., Importance of non-pharmaeceutical interventions in lowering the viral inoculum to reduce susceptibility to infection by SARS-CoV-2 and potentially disease severity. Lancet, 2021. doi: 10.1016/S1473-3099(20)30982-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Greenhalgh T., et al., Ten scientific reasons in support of airborne transmission of SARS-CoV-2. The Lancet, 2021. doi: 10.1016/S0140-6736(21)00869-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Sunstein C.R., The availability heuristic, intuitive cost benefit analysis, and climate change. Climate Change, 2006. 77: p. 195–210. [Google Scholar]
  • 44.Kahneman D., Slovic P., and Tversky A., Judgment under uncertainty: Heuristics and biases. 1982, New York: Cambridge University Press. [DOI] [PubMed] [Google Scholar]
  • 45.Tversky A. and Kahneman D., Availability: A heuristic for judging frequency and probability. Cognitive psychology, 1973. 5: p. 207–232. [Google Scholar]
  • 46.Mase A.S., Cho H., and Prokopy L.S., Enhancing the social amplification of risk framework (SARF) by exploring trust, the availability heuristic, and agricultural advisors’ belief in climate change. Journal of Environmental Psychology, 2015. 41: p. 166–176. [Google Scholar]
  • 47.Trope Y. and Liberman N., Construal level theory of psychological distance. Psychological Review, 2010. 117: p. 440. doi: 10.1037/a0018963 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Tombor I., et al., Smoker identity and its potential role in young adults’ smoking behavior: A meta-ethnography. Health Psychology, 2015. 34(10): p. 992–1003. doi: 10.1037/hea0000191 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Haslam C., et al., The new psychology of health: Unlocking the social cure. 2018, London, UK: Routledge. [Google Scholar]
  • 50.Wynne B., Misunderstood misunderstanding: Social identities and public uptake of science. Public understanding of science, 1992. 1(3): p. 281–304. [Google Scholar]
  • 51.Hecht M.L., Jackson R.L., and Pitts M.J., Culture: Intersections of Intergroup and Identity Theories, in Intergroup Communication: Multiple Perspectives, Harwood J. and Giles H., Editors. 2005, Peter Lang: New York. p. 21–42. [Google Scholar]
  • 52.Hecht M.L., et al., The communication theory of identity, in Theorizing about intercultural communication, Gudykunst W.B., Editor. 2005, Sage Publications: Thousand Oaks. p. 257–278. [Google Scholar]
  • 53.Cruwys T., Stevens M., and Greenaway K.H., A social identity perspective on Covid-19: Health risk is affected by shared group membership. British Journal of Social Psychology, 2020. 59: p. 584–593. doi: 10.1111/bjso.12391 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Lidskog R., Risk Governance, in The Oxford Encyclopedia of Health and Risk Message Design and Processing, Parrott R., Editor. 2018, Oxford University Press: Oxford, UK. p. 490–504. [Google Scholar]
  • 55.Engdahl E. and Lidskog R., Risk, communication and trust: towards an emotional understanding of trust. Public understanding of science, 2014. 23(6): p. 703–717. doi: 10.1177/0963662512460953 [DOI] [PubMed] [Google Scholar]
  • 56.Van Asselt M.B.A. and Renn O., Risk governance. Journal of Risk Research, 2011. 14(14): p. 431–449. doi: 10.1007/s13280-010-0134-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Van Asselt M.B.A. and Van Bree L., Uncertainty, precaution, and risk governance. Journal of Risk Research, 2011. 14(4): p. 431–408. [Google Scholar]
  • 58.Martinelli L., et al., Face masks during the COVID19 pandemic: A simple protection tool with many meanings. Frontiers in Public Health, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Lundgren R.E. and McMakin A.H., Constraints to effective risk communication, in Risk communication: A handbook for communicating environmental, safety, and health risks, 5th edition. 2013, IEEE Press Wiley Piscataway, NJ. p. 37–55. [Google Scholar]
  • 60.Lundgren R.E. and McMakin A.H., Risk communication: A handbook for communicating environmental, safety, and health risks, 5th edition. 2013, Piscataway, NJ: IEEE Press Wiley. 393. [Google Scholar]
  • 61.Leary M.R., Tchividjian L.R., and Kraxberger B.E., Self-presentation can be hazardous to your health: Impression management and health risk. Health Psychology, 1994. 13: p. 461–470. doi: 10.1037//0278-6133.13.6.461 [DOI] [PubMed] [Google Scholar]
  • 62.Brady J., et al., A systematic review of the salient role of feminine norms on substance use among women. Addictive Behaviors, 2016. 62: p. 83–90. doi: 10.1016/j.addbeh.2016.06.005 [DOI] [PubMed] [Google Scholar]
  • 63.Rimal R.N. and Real K., How behaviors are influenced by perceived norms: A test of the theory of normative social behavior. Communication Research, 2005. 32(3): p. 389–414. [Google Scholar]
  • 64.Fung I., et al., Ebola and the socal media. The Lancet, 2014. 384(9961): p. 2207. [DOI] [PubMed] [Google Scholar]
  • 65.Renshaw S.L., et al., Cutting through the noise: Predictors of successful online message retransmission in the first 8 months of the Covid-19 pandemic. Health Security, 2021. 19(1): p. 31–43. doi: 10.1089/hs.2020.0200 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Adjodah D., et al., Association between COVID-19 outcomes and mask mandates, adherence, and attitutes. PLOS ONE, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Le G.M., et al., Perceptions of cervical cancer prevention on Twitter uncovered by different sampling strategies. PloS One, 2019. 14(2): p. e0211931. doi: 10.1371/journal.pone.0211931 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Steinert-Threlked Z., Twitter as Data. Cambridge Elements: Quantitative and computational methods in social science. 2018, New York, NY: Cambridge University Press. [Google Scholar]
  • 69.Ruths D. and Pfeffer J., Social media for large studies of behavior. Science, 2014. 346(6213): p. 1063–1064. doi: 10.1126/science.346.6213.1063 [DOI] [PubMed] [Google Scholar]
  • 70.Auxier B. and Anderson M., Social media use in 2021. 2021, Pew Research Center. [Google Scholar]

Decision Letter 0

Anat Gesser-Edelsburg

1 Jul 2021

PONE-D-21-17166

The Social Amplification of Covid-19 Risk Perception Shaping Mask Wearing Behavior: A Longitudinal Twitter Analysis

PLOS ONE

Dear Dr. Hopfer,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Aug 15 2021 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Prof. Anat Gesser-Edelsburg, Ph.D.

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. We note that you have indicated that data from this study are available upon request. PLOS only allows data to be available upon request if there are legal or ethical restrictions on sharing data publicly. For more information on unacceptable data access restrictions, please see http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions.

In your revised cover letter, please address the following prompts:

a) If there are ethical or legal restrictions on sharing a de-identified data set, please explain them in detail (e.g., data contain potentially sensitive information, data are owned by a third-party organization, etc.) and who has imposed them (e.g., an ethics committee). Please also provide contact information for a data access committee, ethics committee, or other institutional body to which data requests may be sent.

b) If there are no restrictions, please upload the minimal anonymized data set necessary to replicate your study findings as either Supporting Information files or to a stable, public repository and provide us with the relevant URLs, DOIs, or accession numbers. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories.

We will update your Data Availability statement on your behalf to reflect the information you provide.

3. Please include captions for your Supporting Information files at the end of your manuscript, and update any in-text citations to match accordingly. Please see our Supporting Information guidelines for more information: http://journals.plos.org/plosone/s/supporting-information.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: No

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: No

Reviewer #3: Yes

Reviewer #4: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

Reviewer #4: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: The paper represents a useful application of the social amplification risk framework to COVID-19 risk perception related to mask-wearing on the basis of a sample of messages on twitter. The qualitative review of themes and how the messages changed over time were interesting and seem well conducted. The way that the data was used to answer the research questions was clear, with both examples and graphs. However, the analysis in the paper suffered greatly from a lack of clear connection between the excellent research questions and data and the conclusions, and many conclusions were simply not supported by the analysis performed. Despite these issues, and other issues highlighted below, with further clarification and some additional work, this analysis will be a useful contribution to the literature on both COVID-19 risk perception, and social media analysis of public response.

Specific concerns and suggestions:

- Statements in the discussion about implications seem unconnected to the actual analyses. This is true in man places, but as one example, while it is very clear from other literature and experience that “...an information-deficit model approach to public health messaging... will unlikely be sufficient,” what part of the analysis justifies the claim in the paper that “Findings also suggest” this point? Other claims that seem unrelated to the analysis, which should be removed or more clearly tied to the analysis, include “group mask-wearing norms and policies normalizing mask wearing play critical roles,” and “Investment in monitoring social media sites as amplification stations for public health risk is warranted.”

- All of the figures would benefit from significantly more explanatory text, so that they can be read and understood without closely reading the paper. Additionally, figure 4 would be greatly improved if the time-intervals were clarified. There seems to be a surprising periodicity, and I can only assume this is because of (uneven) time-period binning. Otherwise, this should be explained.

Methodological questions:

- The low intercoder reliability seems to imply that the concepts and interpretations were unclear even to the coders. Is there a literature on twitter qualitative analysis that can provide comparative numbers in other studies, or some reason (other than lack of construct clarity or overlap) to think that this isn't a defect in the analysis? Also, the specific method used seems difficult. It seems some specific source or justification is needed for applying Fleiss's Kappa in this multi-categorical assignment case. (A statistician should be consulted.)

The dataset was filtered to remove tweets that only contained hashtags or user mentions. Does this exclude when a reply message is intended to highlight a tweet? Does this exclude quote-tweets with only a hashtag or mention?

The keyword list was clearly designed to catch non-English tweets, but then the tweets were geolocated and only English tweets were included. This should be explained. Several top news propagators are also clearly not-US based or used by US twitter accounts. This should be explained as well. (Presumably, the data collection is being used for other projects, which is fine, but should be stated)

Given the global nature of the risk and spread, it seems strange that discussion of masks in places other than the US should be automatically coded as non-relevant. Can you explain this choice?

Minor technical issues:

Data availability upon request is insufficient, as the guidelines state. Despite twitter terms of service restricting sharing the full dataset publicly, the tweet ids can be made fully public to allow reconstruction of the dataset without requesting data. If this is not done, a clear justification is needed. (Also, the availability statement also states that the codebook would be available upon request, but it is in fact included as appendix S3.)

The ethics statement should have a review number, or a date and the format in which the exemption was provided.

Reviewer #2: The manuscript is worthwhile for its qualitative summary and categorized of raw voices exchanged on twitter about U.S. people's reactions to issues related to Covid-19. In addition, a transition of the people's risk perception can be understood along a timeline, and there are interesting contextual considerations specific to qualitative research methods. While some of the conclusions, such as the need to build a presence and trust of public health officials delivering the messages and the importance of public figures role models, seem a bit lacking novelty, devising messaging according to the social and group identity of the recipient, rather than increasing the severity and threat is a new recommendation.

I would like to confirm a few points.

- How much influence does twitter have on what range of people compared to other media?

- Does the difference in expertise of the three coders affect the results of the analysis? It would be better to clarify the background of the coders.

- Although the overall appearance rate of “Covid desensitization” is low, why was it extracted as one category and the kappa coefficient remained low at 0.28?

- How does "tailoring public health messaging by psycho-behavioral profiles to effectively reach heterogenous subgroups regarding Covid-19 risk." in the discussion specifically refer to?

Reviewer #3: I wish to congratulate the authors to this thorough analysis of a new aspect of risk communication that derives very useful recommendation for public health risk communication. The application of the conceptual framework of SARF is a useful theory to undertake this very interesting investigation.

Reviewer #4: First of all, I would like to pay tribute to the authors for completing this study. The author used Twitter data to examine the social dynamics of risk perceptions regarding mask-wearing in the COVID-19 era. The author found seven categories of Tweet content, which seem to represent the history of American society's reaction to COVID-19. This study allows us to think about how risk perceptions are diffused in a crisis, which could be important findings for determining public health strategies. However, although I mostly agree with the publication of your manuscript, a few concerns remain.

1.

You defined risk perception as a communication process situating risk perception cognitively and socially, culturally, and historically. This definition was based on Kasperson’s discussion. Therefore, we could rephrase this definition to a communication process in which risk signals against COVID-19 interact with psychological, social, institutional, and cultural processes in ways that intensify or attenuate perceptions of risk and its manageability and shape risk behavior.

Based on the above definition, you discussed how the communication process of risk occurs in society by analyzing the content of tweets. However, was the analysis design of this study in ways that would allow you to explore such communication processes? Your analysis did not address the features of Twitter's communicable tools such as mentions, retweets, and replies and thus did not adequately discuss the relationships within and between the seven extracted themes. Is it possible that the results represent the size of the reaction to social events rather than describing risk perception as a communicative process? Please add a discussion of the communication process within or across themes with the limitations of this study's analysis.

2.

The process of risk perception includes intensify and attenuate perceptions. In fact, Figure 4 shows that the tweets for each risk perception theme repeatedly increase and decrease. However, your discussion was biased towards an increase in risk perception. It would be better if you also discussed attenuating risk perception.

These comments may contain my misunderstanding. If so, please point it out.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: David Manheim

Reviewer #2: No

Reviewer #3: No

Reviewer #4: Yes: Tomoyuki Kobayashi

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2021 Sep 23;16(9):e0257428. doi: 10.1371/journal.pone.0257428.r002

Author response to Decision Letter 0


18 Aug 2021

We thank the reviewers for their time and feedback. The now separate document as requested, the response to reviewers, includes a point by point response to all reviewer questions.

Attachment

Submitted filename: ResponsetoReviewers.pdf

Decision Letter 1

Anat Gesser-Edelsburg

1 Sep 2021

The Social Amplification and Attenuation of COVID-19 Risk Perception Shaping Mask Wearing Behavior: A Longitudinal Twitter Analysis

PONE-D-21-17166R1

Dear Dr. Hopfer,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Prof. Anat Gesser-Edelsburg, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional): Please address reviewer #1 minor comments during the proofreading stage.

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: No

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for your revisions and addressing the various concerns, especially the explanation about the statistical issues with various intercoder reliability measures. I believe the paper is an excellent contribution, and I'm happy to see the improvements which were made.

3 very minor points:

- The github repo, https://github.com/ISG-ICS/Geolocated_USA_tweets_w_mask_IDs, has a readme.md with several spelling errors in the title of the paper.

-The statement about the data is missing the word "not" - "According to Twitter agreement, we release IDs (Tweet and User ID) of the 7k mask tweets, but [NOT] their content."

- Line 816, the added word "and" seems like it should be removed, and on 817, I believe you want to add the word "are" - ", and [ARE] more likely".

Reviewer #2: #1 Thank you for your response. The representativeness of twitter users was confirmed in the limitation section.

#2 Thank you. It’s confirmed.

#3 As you answered, I think qualitative research is also about finding important events in a small number of cases, so I look forward to further research.

#4 The recommendations for public health messaging suggested by this study have been revised to make them easier to understand.

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: Yes: David Manheim

Reviewer #2: No

Acceptance letter

Anat Gesser-Edelsburg

15 Sep 2021

PONE-D-21-17166R1

The Social Amplification and Attenuation of COVID-19 Risk Perception Shaping Mask Wearing Behavior: A Longitudinal Twitter Analysis

Dear Dr. Hopfer:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Prof. Anat Gesser-Edelsburg

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 List. Coronavirus keywords.

    (DOCX)

    S2 List. Top 150 news agencies filtered.

    (DOCX)

    S1 Table. Risk perception codebook.

    (DOCX)

    Attachment

    Submitted filename: ResponsetoReviewers.pdf

    Data Availability Statement

    According to Twitter agreement, we release IDs (Tweet and User ID) of the 7k mask tweets, but their content. The IDs are published in the file https://github.com/ISG-ICS/Geolocated_USA_tweets_w_mask_IDs/blob/main/geolocated_USA_tweets_w_mask_full%20-%20geolocated_USA_tweets_w_mask_IDs_only.csv


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES