Skip to main content
IEEE - PMC COVID-19 Collection logoLink to IEEE - PMC COVID-19 Collection
. 2020 Aug 3;8:142173–142190. doi: 10.1109/ACCESS.2020.3013933

Feeling Positive About Reopening? New Normal Scenarios From COVID-19 US Reopen Sentiment Analytics

Jim Samuel 1, Md Mokhlesur Rahman 2, G G Md Nawaz Ali 3,, Yana Samuel 4, Alexander Pelaez 5, Peter Han Joo Chong 6, Michael Yakubov 7
PMCID: PMC8545342  PMID: 34786280

Abstract

The Coronavirus pandemic has created complex challenges and adverse circumstances. This research identifies public sentiment amidst problematic socioeconomic consequences of the lockdown, and explores ensuing four potential public sentiment associated scenarios. The severity and brutality of COVID-19 have led to the development of extreme feelings, and emotional and mental healthcare challenges. This research focuses on emotional consequences - the presence of extreme fear, confusion and volatile sentiments, mixed along with trust and anticipation. It is necessary to gauge dominant public sentiment trends for effective decisions and policies. This study analyzes public sentiment using Twitter Data, time-aligned to the COVID-19 reopening debate, to identify dominant sentiment trends associated with the push to reopen the economy. Present research uses textual analytics methodologies to analyze public sentiment support for two potential divergent scenarios - an early opening and a delayed opening, and consequences of each. Present research concludes on the basis of textual data analytics, including textual data visualization and statistical validation, that tweets data from American Twitter users shows more positive sentiment support, than negative, for reopening the US economy. This research develops a novel sentiment polarity based public sentiment scenarios (PSS) framework, which will remain useful for future crises analysis, well beyond COVID-19. With additional validation, this research stream could present valuable time sensitive opportunities for state governments, the federal government, corporations and societal leaders to guide local and regional communities, and the nation into a successful new normal future.

Keywords: COVID-19, coronavirus, feeling, reopen, textual analytics, sentiment analysis, Twitter, new normal

I. Introduction

The anxiety, stress, financial strife, grief, and general uncertainty of this time will undoubtedly lead to behavioral health crises. - Coe & Enomoto, on COVID-19 [1].

COVID-19 has become a paradigm shifting phenomenon across domains and disciplines, affecting billions of people worldwide, directly or indirectly. The current COVID-19 pandemic disaster has led to escalating emotional, mental health, and economic issues with significant consequences, and this presents a serious challenge to reopening and recovery initiatives [2][4]. Based on the classification of novel coronaviruses (nCoV), the 2019–2020 novel coronavirus is officially termed “Severe acute respiratory syndrome coronavirus 2”, also called as “SARS-CoV-2” and “2019-nCoV”. The present study uses SCoV2 (short for SARS-CoV-2) to represent the virus, and COVID-19 to represent the resulting disease [5]. In the United States (US) alone, as of June 24, 2020, COVID-19 has infected well over 3.8 million people and has taken over 142,000 lives, and continues to spread and claim more lives [6]. Moreover, as a result of the “Lockdown” (present research uses Lockdown as the term representing the conditions resulting from state and federal government SCoV2 response regulations and advisories restricting government, organizational, personal, travel and business functionalities), over 30 million people lost their jobs, along with a multi-trillion dollar economic impact [7]; furthermore these alarming numbers are increasing as the Lockdown continues. There is tremendous dissatisfaction among common people due to the continued physical, material and mental health challenges presented by the Lockdown, evidenced by the growing number of protests across the US [8]. There appears to be a significant sentiment, and a strong desire in people to go back to work, satisfy basic physical, mental and social needs, and eagerness to earn money, as shown in the descriptive public sentiment summary graph in Fig. 1. However, there is also a significant sentiment to stay safe, and many prefer the stay-at-home Lockdown measures to ensure lower spread of SCoV2 [9]. Public sentiment has a significant impact on policy and politicians, and cannot be ignored [10][12]. Therefore, to a consequential measure, the reopening of America, and its states and regions will be influenced by perceived public sentiment.

FIGURE 1.

FIGURE 1.

Reopening public sentiment summary.

The objective of this research is to develop a novel sentiment polarity based public sentiment scenarios (PSS) framework, which is expected to remain useful for future crises analysis, well beyond COVID-19. This novel sentiment polarity analysis driven PSS framework could present valuable time sensitive public sentiment insights opportunities for governments, government agencies, corporations and societal leaders to guide regions, small and large, from crises scenarios into successful equilibria scenarios (Fig. 10). Hence, it is important to address the question: What is the dominant public sentiment in America concerning the reopening and in some form, going forward into a new normal?. This study uses the term “new normal” to represent the potentially transformed socioeconomic systems [13], as result of COVID-19 issues, amidst the likelihood of multiple future waves of the SCoV2 pandemic. There is a fear that the current SCoV2 wave will see a spike in COVID-19 infections with reopening and associated loosening of Lockdown restrictions. The present study analyzed public sentiment using tweets from the first nine days of the month of May, 2020, with a keyword “reopen” from users with country denoted as USA, to gauge public sentiment along eight key dimensions of anger, anticipation, disgust, fear, joy, sadness, surprise and trust, as visualized in Fig. 1. Twitter data and tweets text corpus have been widely used in academic research and by practitioners in multiple disciplines, including education, healthcare, expert and intelligent systems, and information systems [14][19]. Sentiment analysis with tweets presents a rich research opportunity, as hundreds of millions of Twitter users express their messages, ideas, opinions, feelings, understanding and beliefs through Twitter posts. Sentiment analysis has gained prominence in research with the development of advanced linguistic modeling frameworks, and can be performed using multiple well recognized methods, and tools such as R with readily available libraries and functions, and also through the use of custom textual analytics programming to identify dominant sentiment, behavior or characteristic trait [20][22]. Tweets analytics have also been used to study, and provide valuable insights on a diverse range of topics from public sentiment, politics and pandemics to stock markets [10], [23][27].

FIGURE 10.

FIGURE 10.

Sentiment analysis of new normal scenarios.

There are strong circumstantial motivations, along with urgent time-sensitivity, driving this research article. Firstly, as stated above, the US has seen a large number of SCoV2 cases and deaths, and the numbers continue to increase [6]. Secondly, there have been significant economic losses and mass psychological distress due to unprecedented job loss for tens of millions of people. These circumstantial motivations led us to our main research motivation: discovery of public sentiment towards reopening the US economy. The key question we seek to address is, what are the public sentiments and feelings about reopening the US economy? Public sentiment trends insights would be very useful to gauge popular support, or the absence thereof, for any and all state level or federal reopening initiatives.

Scientists, researchers and physicians are suggesting that the reopening process should be on a controlled, phased and watchful basis. The general recommendation is that it should be done in three phases [28]: Phase 1: slow down the virus spread through complete Lockdown and very strict measures (for instance, mandatory stay-at-home orders, which have been active in many states). Phase 2: reopen on a state-by-state, business-by-business, and block-by-block basis with caution. People would still be required to maintain social distancing, use PPE (personal protective equipment) and strict public hygiene. All of these would need to be implemented while protecting the most vulnerable sections of the population, using potential strategies such as the “relax-at-home” or “safe-at-home” mode. Moreover, the states would be expected to increase testing, tracing and tracking of COVID-19 cases, and ensure ample PPE supplies. Phase 3: It would be possible for people to go back to near-normal pre-SCoV2 lifestyles, when proven vaccines and/or antibodies become commonly available, and mass-adoption sets in. Early research shows that 90% of transmissions have taken place in closed environments, such as homes, workplaces, restaurants, social gatherings and public transport, and such prevalence in critical social spaces contributed to increased fear sentiment [29], [30].

From a current sentiments analysis perspective, since a large ratio of people need to start work, return to their businesses and jobs, and restart the economy, a quick reopening is perceived as being strongly desirable. However, there is fear regarding potential future outbreaks of the COVID-19 pandemic, and this presents a cognitive dilemma with implications for mental health and emotional conditions. Information and information formats have an impact on human sentiment, behavior and performance, and it is possible to associate underlying feeling or belief to express performance and communication [31]. The present research addresses the COVID-19 public sentiment trend identification challenge by generating insights on popular sentiment about reopening the economy, using publicly available tweets from users across the US. These publicly downloadable tweets were filtered with “reopen” as the keyword, and insights were generated using textual data visualization, starting with the word cloud Fig. 2 to gain a quick overview of the textual corpus, as such textual visualizations have the potential to provide both cross-sectional and narrative perspectives of data [32]. Textual analytics were used to discover most frequently used words, phrases, and prominent public sentiment categories.

FIGURE 2.

FIGURE 2.

Wordcloud summary of tweets data.

The original contributions of this paper fall into two categories, the first category of contributions is time sensitive, applied in nature, and provides COVID-19 reopening phase findings which have immediate relevance to researchers, practitioners, government officials and managers. The second category, has long term theoretical and methodological research relevance, and thus contributes to researchers and practitioners studying and governing environments with public sentiment sensitive scenarios, including public crises of various kinds such as potential future pandemics or a socioeconomic crisis. This study provides a valuable time sensitive finding, demonstrating the relative strength of positive sentiment supporting a quick reopening, against negative sentiment towards reopening. This study also develops the PSS framework which can be used by researchers and practitioners to study and manage future crises scenarios. Given the urgency of the COVID-19 situation in the US and worldwide, this study is aimed at supporting the discovery of critically time-sensitive and desperately needed COVID-19 recovery and reopening insights, which can contribute to real-world applications and solutions. Consequentially, this research is part of our COVID-19 solutions research stream, which has enthusiastically embraced the generation of insights using rapid exploratory analytics and logical induction, with timely and significantly practical implications for policy makers, local, state and federal governments, organizations and leaders to understand and prepare for sentiment-sensitive scenarios. This research has thus aimed to discover the most critical insights, optimized to time constraints, through sentiment-sensitive reopening scenarios analysis. The rest of the paper is organized as follows. Section II highlights the scenario analysis of past and current events and public sentiment. Section III demonstrates the adopted method for analyzing public sentiment. Section IV is dedicated for in-depth discussion, pointing out limitations and opportunities of this research. Finally, Section V concludes this paper.

II. Scenario Analysis: COVID-19 Sentiment Fallout

In alignment with this study’s dominant research goal of developing a sentiment polarity analysis driven PSS framework for generating insights into managing recovery phases of crises scenarios such as pandemics, we employ a research strategy including textual analytics for exploratory insights using Twitter data, specifically reopening tweets in the post-COVID-19 context. We then use sentiment analysis to identify the dominant sentiment and validate it using statistical measures so that we can map the statistically validated sentiment to the PSS framework (Fig. 10). Though the PSS framework is contextualized specifically to COVID-19 reopening scenarios, the PSS framework is easily adaptable to other crises scenarios where public or human sentiment would be a valuable factor, and this is elaborated upon in the discussion section.

Past research has illustrated the dramatic growth in public fear sentiment using textual analytics for identifying dominant sentiments in SCoV2 tweets [24]. Public fear sentiment was driven by a number of alarming facts as described in the subsections below. To start with, we list a number of initiatives aimed at understanding, explaining and predicting various aspects of the SCoV2 phenomena. A number of works made early prediction of the spread of COVID-19 [4], [33]. Zhong et al. [4] made the early prediction of the spread of the SCoV2 using simple epidemic model called SIR (Susceptible-Infected-Removed) dynamic model. The model works with two key parameters: the infection rate and the removal rate. The infection rate is the number of infections by one infective by unit time and the removal rate is the ratio of the removed number to the number of infectives, where the removed number includes recovered and dead infectives. Y. Aboelkassem [33] used a Hill-type mathematical model to predict the number of infections and deaths and the possible reopening dates for a number of countries. The model works based on the three main estimated parameters: the steady state number (the saturation point), the number of days when the cases attain the half of the projected maximum, and Hill-exponent value. Li et al. [34] categorized COVID-19 related social media posts into seven situational information categories. They also identified some key features in predicting the reposted amount in each information category. The predictive accuracy of different supervised learning methods were different: the accuracy of SVM (Support Vector Machine), Naive Bayes, and Random Forest were 54%, 45% and 65%, respectively.

A. COVID-19 People Sentiment-Impact: Fear

In the US, concurrent to the physical healthcare problem, extant research observes the mass fear sentiment about Coronavirus and COVID-19 phenomena to be on a significant growth curve from the time the study started tracking the sentiment, in the February and climbing steeply towards March, 2020 [24]. According to the Center for Disease Control and Prevention (CDC), this was also around the same time that a massive number of people started seeking medical attention for COVID-19 conditions [35]. Fig. 3a shows the percentage of patient-visits for COVID-19-like illnesses (CLI) and Influenza-like illnesses (ILI), as compared to the total number of emergency department visits from December 1, 2019 to April 26, 2020, in the US (source, CDC [35]). It clearly indicates that a significant number of people began using emergency facilities for CLI and ILI from around March of 2020, and this corresponds with the growth of fear and panic sentiments associated with COVID-19. However, by late April, we see the emergency visits curve relaxing along with a decline in the number of new infections in many states in the US. Fig. 3b exhibits COVID-19- associated weekly hospitalizations per 100,000 of the US population among different age categories from March 04 to May 02, 2020 in the US. It shows that from the second week of March, a significant number of people aged over 65 years needed to be hospitalized; and the hospitalizations count peaks by the middle of April. It clearly shows that this age group is amongst the most vulnerable to the COVID-19 outbreak. The age group of 50–64 years follows as the second most impacted, and the age group of 18–49 years follows as being the third most impacted. However, COVID-19 had a very limited impact on the 0–17 years age group. Healthcare experts and researchers continue to monitor, develop and apply solutions that are helping physical recovery. From a current mental healthcare and sentiment tracking perspective, we did not find any reports highlighting changes to early stage COVID-19 fear and panic sentiment, nor clear updates on sentiment trends from extant literature. Hence, having identified an important gap, this present research identifies changes in public sentiment by collecting and analyzing Twitter data for the first part of May 2020, as described in the methods section.

FIGURE 3.

FIGURE 3.

Impact of COVID-19 outbreak on medical resources in the US (source, CDC [35]).

B. Societal Sentiment-Impact: Despair

The whole is often greater than the sum of its parts - this adage holds true regarding the adverse collective psychological, sentimental and mental healthcare impact of the SCoV2 and COVID-19 phenomena on human society and societal structures. While there was a significant growth in fear and anxiety on the individual level, collectively as a society, these took the shape of panic and despair, as evidenced in panic-buying driven shortages of items in supermarkets for which there were no supply chain disruptions, indicating that these shortages were driven by adverse public sentiment. Certain American states and regions were more drastically impacted than the others. COVID-19 had a severe impact on New York and New Jersey, followed by Massachusetts, Illinois, Michigan and California as shown in Fig. 4 (source, worldometers [6]). So far New York and New Jersey have seen the maximum number of deaths (Fig. 4a). Interestingly, if we notice the death of despair prediction for 2020–2029 as shown in Fig. 4b, New York and New Jersey are not in the most affected list, instead some states, which perhaps have fewer economic opportunities, and aging population, will suffer the most [36]. The prediction shows that the most likely states to bear a negative impact in the long run will be New Mexico, Nevada, Wyoming, Oregon, Florida and West Virginia, due to the looming socioeconomic fallout of COVID-19. This implies a longer term and more complex mental healthcare challenge, as states begin their journey to recovery - it will be vital for governments and relevant organizations to track, understand and be sensitive to shifts in public sentiment at the local and national levels.

FIGURE 4.

FIGURE 4.

COVID-19 outbreak by states as of May 7, 2020 (source, worldometers [6]).

C. Economic-Downturn Sentiment-Impact: Confusion

The SCoV2 pandemic has caused significant global disruptions, leading to continuing losses valued at trillions of US dollars due to the closure of many businesses and entire industries, such as hospitality and air travel. However, confusion is rampant due to counter efforts by governments, nationalized monetary policy interventions, and large scale financial assistance to individual citizens, organizations and businesses. For example, the US government has successfully provided multi-trillion dollar interventions, including stimulus checks, small business assistance and a wide range of concessions and equity market support mechanisms. Such initiatives make it difficult for investors, and individuals to gauge the fundamental value of many assets as government policy intervention can support systemic market shifts, and disrupt forecasts. Risks in the global financial market have elevated substantially due to investors’ anxiety and assets price variability [37][39]. Data analysis on daily COVID-19 cases and stock market returns for 64 countries demonstrated a strong negative return with increasing confirmed cases [40]. The stock market reacted strongly in the early days of confirmed cases compared to a certain period after the initial confirmed cases. In contrast, the reaction of individual stock markets is closely related to the severity of the local outbreaks, which leads to economic losses, high volatility and unpredictable financial market conditions, and tweets textual analytics have been used to gauge associated sentiment [25], [39]. All of these COVID-19 effects lead to a delicate market equilibrium, immersed in a fair degree of confusion, positively supported by expectation of government intervention, and limited by the negative consequences of COVID-19.

Also, COVID-19 has caused a severe interruption in the functioning of businesses and institutions, leading to loss of employment, diminished income opportunities and disruption of labor markets, leading to significant increase in distress [41]. A prolonged pandemic may lead to mass unemployment and irreversible business failures [39]. According to the International Labor Organization (ILO), the global unemployment rate will increase by 3%~13%, subsequently it will increase underemployment and reduce economic activities such as global tourism [42]. Adams-Prassl et al., [41] studied comparative job losses and found that about 18% and 15% of people lost their jobs in early April, 2020, in the US and UK, respectively, whereas only 5% people lost their job in Germany. They also predicted that the probability of an individual losing a job is about 37% in the US and 32% in the UK and 25% in Germany, in May, 2020. Evidently, people are worried and anxious about their livelihood and future income, driving a sense of urgency for reopening the economy. Fig. 5 demonstrates how the unemployment situation in the US has been affected by the COVID-19 pandemic (source, US Department of Labor [7]). By the middle of March, 2020, many people started losing their jobs and by late April around 16% of the population became unemployed. By June of 2020, over 30 million people lost their jobs in the US, and this number continues to grow as the Lockdown continues. The global economic downturn caused by COVID-19 is estimated to be the worst since the great recession in 2008 [42]. COVID-19 related shutdowns are expected to lead to 20%-25% output declines in advanced economies (e.g., US, Canada, Germany, Italy, France) with an anticipated 33% drop in consumer expenditure, and a potential 2% decline in annual GDP growth rate [43]. It is projected that the annual global GDP growth will be reduced to 2.4% in 2020 with a negative growth rate in the first quarter of 2020, from a weak rate of 2.9% in 2019 [37]. Compared to the pre-COVID-19 period, it is estimated that about 22% of the US economy would be threatened, 24% of jobs would be in danger and total wage income could be reduced by around 17% [44].

FIGURE 5.

FIGURE 5.

Unemployment situation in the US due to COVID-19 (source, US Department of Labor [7]).

III. Method and Current Sentiment Analytics

Thus far, this study has used secondary data and extant research to motivate, inform and direct the research focus towards current sentiment analytics on the subject of reopening the US economy. Previous sections have summarized key aspects of the extensive socioeconomic damage caused by the SCoV2 pandemic, and highlighted associated psychological and sentiment behavior challenges. For the purposes of the main data analysis, this research uses a unique Twitter dataset of publicly available data specifically collected for this study using a custom date range and filtered to be most relevant to the reopening discussion. While public sentiment has changed from apathy, disregard and humor in the earliest stages of the SCoV2 pandemic, to fear in February and March of 2020, and despair in March and April of 2020, yet there is a lack of clarity on the nature of public sentiment surrounding reopening of the economy. The analysis of Twitter data uses textual analytics methods that includes discovery of high frequency key words, phrases and word sequences, that reflect public thinking on the topic of reopening. These publicly posted key words, phrases and word sequences also allow us to peek into the direction of evolving public sentiment. Anecdotal tweets provide insights into special cases and they provide a peek into influential tweets and logical inflection points. In the final parts of the data analysis, the study provides insights into dominant current sentiment, with sentiment analysis using the R programming language, associated sentiment analysis libraries (R packages) and lexicons.

A. Method

The present study used Twitter data from May 2020 to gauge sentiment associated with reopening. 293,597 tweets, with 90 variables, were downloaded with a date range from 04/30/2020 to 05/08/2020, using the rTweet package in R and associated Twitter API, using the keyword “reopen”. This follows standard process for topic specific data acquisition and the dataset was saved in.rds and.csv formats for descriptive data analysis [45], [46]. The complete data acquisition and analysis were performed using the R programming language and relevant packages. The dataset was cleaned, filtered out potential bot activity and subset by country to ensure a final subset of clean tweets with country tagged as US. It is possible that the process omitted other tweets from the US which were not tagged by country as belonging to the US. Furthermore, for ethical and moral purposes, we used custom code to replace all identifiable abusive words with a unique word text “abuvs” appended with numbers to ensure a distinct sequence of characters. While we wanted to avoid the display of abusive words in an academic manuscript, we still believed it to be useful to retain the implication that abusive words were used, for further analysis. After the filtering, cleaning and stopwords processes, a final dataset consisting of 2507 tweets and twenty nine variables was used for all the Twitter data analysis, textual analytics and textual data visualization in this paper. A visual summary of the key words in the textual corpus of the filtered tweets is provided in the word cloud visualization in Fig. 2.

1). N-Grams Word Associations

The text component of the dataset, consisting of filtered tweets only was used to create a text corpus for analysis and data visualization. Word frequency and N-grams analysis were used to study the text corpus of all the tweets, to discover dominant patterns, and are summarized in Fig. 6. Word frequency analysis revealed an anticipated array of high frequency words, which included: economy, states, businesses, COVID, open, back, work, country, reopening, plan and governor. N-grams, which focus on the identification of frequently used word pairs and word sequences revealed interesting patterns. The most frequent Bigrams (two word sequences) included: open economy, reopen country, social distancing, time reopen, states reopen and want reopen. These largely indicate positive sentiment towards reopening. The most frequent Trigrams (three word sequences) included: get back work, people want reopen, stay home order and want reopen country. These trigrams also indicate medium to strong support for the reopening. The most frequent “Quadgrams” (four word sequences) included: can’t happen forever, goin worse lets get, and constitutional rights must stop. Quadgrams reveal more complex sentiment, with positive but weak support for reopening. For example, ‘can’t happen forever’ most likely implies that the Lockdown cannot last indefinitely, and ‘constitutional rights must stop’ most likely implying that intrusive Lockdown measures are not appreciated.

FIGURE 6.

FIGURE 6.

N-Grams.

2). Descriptive Analysis of Tweets

Descriptive analysis was used to explore the data, and Tables 1 and 5 summarize the reopening Twitter data features associated with sentiment analysis. Table 1a ranks the dominant Twitter user names mentioned in the reopening tweets data, and Table 1b ranks the leading hash tags used in the data. The text of the tweets was also analyzed in conjunction with other variables in the dataset to gain insights into behavioral patterns, which included grouping by technology (device used to post tweet) and analysis of key words usage by such technological classification. We grouped tweets into two technology-user classes: iPhone users and Android users, to explore potential behavioral aspects. Extant research supports such a classification of technology users for analyzing sentiment, psychological factors, individual differences and technology switching [24], [47][49]. We identified 1794 Twitter for iPhone users, and 621 Twitter for Android users, in our dataset and ignored smaller classes, such as users of web client technologies. For the purposes of relative analysis, we normalized the technological groupings so as to ensure comparison of ratio intrinsic to each group, and to avoid the distortion caused by unequal number of users in the two technology-user classes. Our analysis and grouped data visualizations revealed some interesting patterns as summarized in Fig. 7. Twitter for iPhone users had a marginally higher ratio of ‘reopen’ mentions, while they were at par with Twitter for Android users in their references to ‘business’ and ‘time’ urgency words. Twitter for iPhone users tended to use more abusive words, while Twitter for Android users tended to post more tweets referencing ‘work’, ‘Trump’, ‘Politics’, ‘COVID-19’ and ‘economy’. Negative sentiment is usually tagged to the use of abusive words, positive sentiment is currently associated with reopening words and either positive or negative sentiment could be associated with political, work, business and economy words, subject to context and timing. This reveals that, technology user groups may differ in their sentiment towards reopening and that by itself could merit additional research focus.

TABLE 3. Shapiro-Wilk Normality Test for Sentiment Scores.
Shapiro-Wilk Normality Test
Null Hypothesis Normally distributed data
Shapiro-Wilk statistic 0.97841
P-Value 2.20E-16
Conclusion Reject Null that Data is normal
TABLE 1. Twitter Data Features: Mentions and Hashtags.
(a) Mention count.
Tagged Rank
realDonaldTrump 1
GovMikeDeWine 2
NYGovCuomo 3
GavinNewsom 4
GovLarryHogan 5
TABLE 5. Twitter Data Features: Locations.
(a) Tagged.
Location Rank
Los Angeles, CA 1
Brooklyn, NY 2
Chicago, IL 3
Florida, USA 4
Pennsylvania, USA 5
Manhattan, NY 6
North Carolina, USA 7
Houston, TX 8
San Francisco, CA 9
FIGURE 7.

FIGURE 7.

Tweets grouped by device type.

3). Illustrative Tweets and Sentiment

“Reopen everything now!!!!” 5/3/2020, 21:46 Hrs, Twitter for iPhone

“NO state is ready to reopen” 5/2/2020, 23:55 Hrs, Twitter for Android

It is important to connect textual analytics discoveries, such as word frequencies and N-grams sequences, to context and demonstrate potential ways in which the popular words and word sequences are being used. To that purpose, this section presents and discusses a few notable tweets associated with the N-grams and descriptive textual analytics. Name mentions, abusive words and hashtags in the tweets displayed in this paper have been deleted or replaced to maintain confidentiality, research ethics and relevance, and spellings, though incorrect have been retained as posted originally. We observed tweets with high positive sentiment and emotional appeal such as “What a beautiful morning to reopen the economy!” and “Ready to use common sense and reopen our country”. Some of the tweets focused on humor: “More importantly when do the bars reopen”, “Day 50: I find it amusing that skinheads are the ones calling to reopen hair salons”, “The first weekend the bars reopen is going to kill more people than the coronavirus” and “First karaoke song when the bars reopen will be a whole new world”. A large number of tweets referenced jobs, work and businesses, such as: “Then tell the states to reopen. That is the only way to create jobs”, “How about you just reopen the state?”, “WE ARE BEGGING YOU TO OPEN UP THE ECONOMY BUT YOU DONT CARE! Our jobs won’t be there if you keep this going!” and “I don’t want to get it but we must all reopen and get back to work”.

Many tweets were political: “History will also show that during the pandemic the Democrats did nothing to reopen the country or economy but continued to collect a paycheck while 30% was unemployed”, “Trump thinks he needs the states to reopen for his reelection” and celebrities were not spared of the negative sentiment: “Melinda Gates, multi-billionaire hanging out comfortably at home, insists America not reopen the economy until at least January and until America implements paid family medical leave. #outOfTouch” and “Bill Gates laughs when he hears about the economy falling because he wants you to die”. Some tweets expressed skepticism: “This is not hard. The economy won’t get better even if you open up EVERYTHING because consumer consumption is based on CONFIDENCE. Economics 101 y’all. America ain’t ready to reopen”, “The need to reopen the economy is definitely evidence that capitalism will kill us all” and “What happens when the 20% win and stores reopen and the other 80% still refuse to show up?”. Frustration was evident in some tweets “i never want to hear the words ‘reopen’ and ‘economy’ ever again”, and some tweets appealed to logic: “The cure can’t be worse than the virus. It’s time to reopen America”, “If they haven’t been preparing by now, it’s their problem. Many others have spent their time getting ready to Reopen”, “But we don’t have proof that will happen. When is a good time to reopen? It will always be risky” and “More will be devistated if we don’t reopen. Follow the protocol set out and get us back to work”. Also, some quoted caution: “I do believe there will be serious soul searching in a few weeks, as states reopen and coronavirus case numbers explode”, while other tweets emphasized individual rights: “It is really past time to reopen our country and to allow US citizens our constitutional rights” and “Reopen. Let owner make a living. No one is being forced To go there. Bring back choice”. As evident, many strong, complex and diverse emotions are expressed in these tweets examples, and it is nearly impossible to manually estimate cumulative sentiment classes or scores for large tweets datasets. However, with the development of standardized sentiment scoring and classification technologies, it has become efficient to perform sentiment analysis on large and unstructured data, and current research leverages relevant functions in R to perform sentiment analysis on reopening data.

B. Sentiment Analysis

The scaling up of computing technologies over the past decade has made it possible for vast quantities of unstructured data to be analyzed for patterns, including the identification of human sentiment expressed in textual data. Sentiment analysis is one of the main research insights-benefits from textual analytics as it extracts potentially intended sentiment meaning from the text being analyzed. Early stage past research used custom methods and researcher defined protocols to identify both sentiment and personality traits such as dominance, through the analysis of electronic chat data, and standardized methods to assign positive and negative sentiment scores [21], [50][52]. Sentiment analysis assigns sentiment scores and classes, by matching keywords and word sequences in the text being analyzed, with prewritten lexicons and corresponding scores or classes. For this research, we used R and well known R packages Syuzhet and sentimentr to classify and score the reopening tweets dataset [53], [54]. Equivocality has been identified as a confounding factor in information processing and sentiment analysis [55]. However, standardized sentiment analysis tools provide a fair estimate. The R package Syuzhet was used to classify the tweets into eight sentiment classes as shown in Fig. 1. Syuzhet also measures positive and negative sentiment by a simple sum of positive and negative values assigned to the text, and therefore a single complex enough tweet may simultaneously be scored as having a positive score of 2 and a negative score of −1. Sentir measures words and associated word sequence nuances, providing a score ranging from around −1 to 1, and the values could be less than −1 or greater than 1. The final sentiment score from sentiment package is a summation of sentiment values assigned to parts of the sentence (or textual field) and can be less than −1 or more than 1, as shown in Fig. 9. An analysis of the reopening tweets displayed 48.27% of positive sentiment, 36.82% of negative sentiment and 14.92% of neutral sentiment, with sentiment. The sentiment analysis, combining scores from sentiment and the classification provided by Syuzhet, highlighting trust and anticipation reflected a largely positive sentiment towards reopening the economy. This is illustrated by the delineated daily sentiments progression in Fig. 8.

FIGURE 9.

FIGURE 9.

Positive and negative sentiment about reopening.

FIGURE 8.

FIGURE 8.

Progression of sentiments: trust, anticipation, sadness and fear.

1). The Influence of Public Sentiment Scenarios (PSS)

Public sentiment is a powerful latent force and has multidimensional influence on society. Prudence in public policy mandates that governments “cannot simply ignore public sentiment without risking the loss of legitimacy or credibility” [10], [56]. Public sentiment can even tend to influence judiciary decisions, drive emergencies policy formation and be highly motivational [10], [57][59]. Public sentiment can also be influential by region or class, such as investor sentiment influencing prices, volumes and volatility in stock markets [11], [60]. Sentiment analysis has been measured using tweets features such as hashtags, and it has been used for design policy and education policy as well [61][63]. Given the breadth and depth of the influence of public sentiment, it is an important factor to study to better understand the emerging post-COVID-19 new normal scenarios. Therefore, we analyze four potential sentiment and reopening timing scenarios in the section below, and discuss potential consequences. Furthermore, we validate the descriptive finding of greater positive sentiment, than negative sentiment, towards reopening using statistical analysis to highlight the most likely scenario.

2). PSS Analysis

There is a high level of uncertainty regarding future events, and questions surrounding the effectiveness of available healthcare facilities in protecting the populace against a potential second wave of SCoV2 remain. There is a serious concern that an unfettered and undisciplined reopening of the US economy may lead to rapid spreading of the SCoV2 and a corresponding steep increase in COVID-19 cases and deaths. However, it is also clear that states cannot keep businesses and services closed indefinitely. This situation needs to be addressed from multiple perspectives, and there are numerous efforts underway to develop solutions for phased openings and preparation for the new normal. The present study seeks to leverage the insights discovered through timely sentiment analytics of the reopening tweets data, and apply the findings to the “Open Now”, including planned and phased openings, versus “Open (indefinitely) later”, including advocacy of maintaining complete shutdown, by analyzing four potential new normal scenarios (Fig. 10):

  • a)

    Scenario 1: Positive public sentiment trend and reopen now

  • b)

    Scenario 2: Positive public sentiment trend and reopen later

  • c)

    Scenario 3: Negative public sentiment trend and reopen now

  • d)

    Scenario 4: Negative public sentiment trend and reopen later

These new normal scenarios are highlighted and discussed on a ceteris-paribus basis, that is we only consider sentiment variance and reopening timing, holding all else equal, such as the progression of COVID-19, healthcare and social distancing protocols, and all other necessary precautions, preparations and “ongoing intensive deep sanitization cycles, physical-distance protocols and associated personal and community paraphernalia” [59].

3). Positive PSS a. and b

Extant research has demonstrated the validity of using tweets sentiment analysis to understand human behavior [24]. Sentiment analysis of the reopening tweets data has indicated dominant sentiment trends for trust and anticipation, and a larger proportion of positive sentiment. Scenario a is a valuable new normal setting from a leadership and policy perspective, as it provides the enthusiasm and public support that is required for the massive efforts that will be needed to restore the economy and revive it back into action. A positive and supportive public attitude will also help the government, and public and private organizations in implementing healthcare protocols more effectively than if positive sentiment were missing. Scenario b in contrast will be a missed new normal opportunity, where in spite of positive public sentiment trends, there is failure to reopen in a timely manner. There are risks associated with any decision or strategy that could be applied, however, the risk of losing the support of positive public sentiment is too significant to be ignored. There is a likelihood, that the positive sentiment and forward looking energy to reopen, restart businesses, rejoin work and push ahead, may be dominated by fear, panic and despair once again due to prolonged socioeconomic stress and financial loss. It will remain important for societal leaders and responsible agencies to seize positive sentiment trends indicating support for reopening, and make the most of it, especially in the absence of deterministic healthcare and socioeconomic solutions.

4). Negative PSS c. and d

If negative public sentiment were to dominate, then it would have the potential to hinder both a quick reopening, and any effective reopening at any later stage. Many tweets have expressed extreme negative sentiment, such as “[Abusive word] people reopen the whole freaking country and let everybody die...” and “we are all going to die”. Interestingly sentiment analysis showed that, though the number of positive sentiment tweets were higher, the negativity of the negative sentiment score tweets were more extreme than the positiveness of the positive sentiment score tweets. The extreme negative tweet had a sentiment score of ~1.51, and the extreme positive sentiment score was ~1.36, implying that though fewer tweets were negative, the intensity of their linguistic expression was higher. Scenario c would lead to a volatile start to the new normal scenario, as it would lead to a reopening without adequate public sentiment support. Reopening now with the absence of a dominant positive public sentiment trend could generate a number of adverse effects, including failure of businesses that attempt to reopen. It is still possible that with some quick reopening associated successes and positive information flows, reopening now under scenario c may still lead to a limited measure of new normal success as the economy restarts and businesses and individuals are empowered to create economic value. However, scenario d, ceteris-paribus, has the potential to lead to the most adverse new normal scenarios. Scenario d is a combination of dominant negative public sentiment trends, where sentiment categories such as fear and sadness dominate, and negative sentiment scores peak along with a delayed opening without time constraints. Indefinite Lockdown has never been an option, and the strategy has been to flatten the curve through Lockdown and distancing measures, so as to create a buffer time zone for healthcare facilities to prepare and cater to the infected, and for governments to make plans and preparations for optimal post-reopening new normal scenarios. Scenario d therefore has the potential to lead to significant uncertainty and confusion. Scenarios c and d can both, to varying degrees, lead to growth in negative public sentiment trends, creating long term mental healthcare challenges, coupled with rapidly deteriorating economic fundamentals.

In summary, current reopening data analytics indicate a positive public sentiment trend, which allows for the the more favorable outcomes with PSS a and b, which can lead to optimal new normal scenarios that maximize the benefits of reopening, while limiting related risks.

C. Statistical Analysis of Sentiment Values

While it is evident that the data visualizations and descriptive measures support the notion that positive sentiment on reopening is stronger than negative sentiment, it is necessary to validate this. We validate our descriptive insights first with a Proportion test on the ratio of positive tweets to negative tweets, and verify this using an Exact Binomial test as shown in Tables 2a and 2b. The Proportion test for the count of positive tweets being in the minority, indicated that such a null hypothesis could be safely rejected with a P-Value < 0.0001. So also, the Proportion test for the count of negative tweets being in the majority, indicated that such a null hypothesis could also be safely rejected with a P-Value < 0.0001. Both these results, for secondary validation, were verified using Exact Binomial tests, which provided similar results. Tests for both positive and negative proportions are useful because of the number of neutral scores as indicated by the histogram, Fig 11a.

TABLE 2. Statistical Tests for Positive and Negative Sentiment Counts.

(a) Proportion test for majority count for positive sentiment.
Proportion Test Exact Binomial test
Null Hypothesis Positive ≤ 50% of Sentiment Count Positive ≤ 50% of Sentiment Count
Alternative Hypothesis Positive sentiment >50% Positive sentiment >50%
P-Value 5.11E-10 4.84E-10
Conclusion Reject Null Hypothesis Reject Null Hypothesis

FIGURE 11.

FIGURE 11.

Statistical analysis of sentiment values.

The Proportion test results supported our alternative hypotheses, indicating that the positive sentiment proportion was significantly greater than the negative sentiment proportion. The study also analyzed the intensity of sentiment by comparing the mean of the positive sentiment scores to the mean of the negative sentiment scores as shown in Table 4. The Wilcoxon signed rank test was used as the sentiment scores were not normally distributed as indicated by the Histogram and QQ plot in Figs. 11a and 11b, respectively. Though sections a and b of Table 4 are complimentary, they are presented due to the number of neutral scores which could have affected the significance of either positive or negative sentiment means. The Wilcoxon signed rank test showed that the null hypothesis of the mean score being greater than 0 could not be rejected (Table 4b) with a P-Value close to 1, and that the null hypothesis of the mean score being negative, less than 0, could be rejected with a P-Value < 0.0001 (Table 4a). Thus the significance measures of the positive sentiment scores were supported both by proportion, as well as by the intensity represented by the mean score.

TABLE 4. Wilcoxon Signed Rank Test.

(a) Wilcoxon signed rank test for positive mean of sentiment scores.
Wilcoxon signed rank test*
Alternative hypothesis: true location is greater than 0
V 1294974
P-Value 1.70E-08
Conclusion Reject Null Hypothesis

IV. Discussion: Limitations, Risks and Opportunities

As is evident from the descriptive analytics, the analytical validation method, and the PSS framework developed and used in this research, the present study is of a significantly applied nature and employs a pragmatic lens to view the potential reopening scenarios. This pragmatic perspective towards applying validated sentiment analysis for understanding and gaining insights into potential reopening scenarios can be generalized for application to other crises, and thus to create many opportunities for future research and theoretical development, as well as for public sentiment sensitive policy making and governance. This is further detailed under the subsection on opportunities. The present research has a few limitations, which must be kept in mind for any application of public sentiment trends insights and new normal scenarios presented in this research. These limitations also present opportunities for future studies and further extension of this research. Post-COVID-19 reopening and recovery are complex challenges with significant uncertainties and unknowns - this is a new systemic crisis for which the world has no established solutions or proven models to depend on. Needless to say, any reopening endeavor or the absence thereof, any action or inaction, are all fraught with significant risks. We identify and discuss some of these risks from a sentiment association perspective. The subsections below provide elaborations on the limitations of this research, risks and opportunities for future work.

A. Limitations

There are two areas of limitations of this research: quality of data and variance in sentiment analysis tools. Twitter data has been used extensively in research and in practice. However, the data is susceptible to bot activity and also to data errors caused voluntarily or inadvertently by users who provide inaccurate data. For example, Tables 5a and 5b are both location variables, and apart from the fact that they are poorly tagged, they do not provide a reliable interpretation of actual location of the user. Extensive cleaning and data preparation are necessary, which is often time and resource consuming, especially with textual data. Furthermore, though large volumes of public Twitter data can be acquired with reasonable effort, the quality of data can be affected by bot activity, repeat posts and spam posts. Though the reopening tweets data used for the present research was cleaned and well prepared prior to analysis, following standard processes, yet the likelihood that the algorithmic processes did not successfully address all issues remains. Secondly, the tools available for sentiment analysis are subject to a measure of error, and are subject to the scope of the underlying lexicons. That is also the reason why using multiple lexicons could lead to somewhat different results depending on the context and the complexity of the underlying textual corpus [64]. This limitation in sentiment analysis tools can usually be mitigated by analyzing a larger number of tweets. This research was intended to be descriptive and directional in nature and therefore, multiple data sources were not used. Ideally, public sentiment must be gauged through multiple listening mechanisms, using data from multiple social media platforms and public communications, to provide a better representation of the population for sentiment analysis.

B. Reopening Risks

Fear became a prominent public sentiment as awareness of the seriousness and devastating effects of SCoV2 pandemic increased [24]. This sentiment was not unjustified, due to diverse risks associated with the pandemic. COVID-19 has a higher transmissibility with a reproduction number (R0) of 2.0 - 6.47 (average R0 is 3.58) which indicates that the disease can be transmitted to 2.0 - 6.47 people from an average infected person [65], [66]. This transmissibility rate is higher than recent infection diseases such as SARS (Severe Acute Respiratory Syndrome) and Ebola which have a reproduction number of 2 – 5 [65]. Hence, COVID-19 is highly contagious, especially within enclosed spaces such as trains, buses, restaurants, crowded factory floors, indoor markets, dormitories, classrooms and similar spaces. However, it is also well known that COVID-19 devastatingly impacts only the vulnerable parts of the population (commonly known as those with preexisting conditions and the elderly with weak immune systems), and this awareness has led to growing concerns and protests for reopening businesses and workplaces around the world. It is a public health issue to assess the safety of workplaces, and estimate their likelihood to transmit contagious diseases rapidly through a variety of activities (e.g., customer and patient dealings, close contact interaction with colleagues) [67], [68]. For example, healthcare workers (90% are exposed more than once a month and 75% are exposed more than once a week) bear a higher risk of getting infected, and thus may constitute a sub-segment for sentiment analysis, which can aid mental health evaluation. Besides, some other occupations (e.g., police, firefighters, couriers, social workers, daycare teachers, and construction workers) have a higher number of exposed workers in the US. Self-isolation can significantly reduce ICU beds requirements, and flatten the disease outbreak curve. With a R0 of 2.5 and without self-isolation, 3.8 times the number of ICU beds would be required in the US to treat critically affected people [5]. In contrast, about 20% of self-isolation by infected persons, could reduce ICU beds requirements by 48.4%. With a RO of 2, self-isolation can reduces ICU bed requirements by 73.5%. Knowledge of infectious disease transmission in workplaces, social distancing and stay at home practices are critical safeguards from rapid spread of infections [67]. Thus, for reopening workplaces and sustaining the economy, it is crucial to adopt appropriate protective measures (i.e., PPE, mandatory influenza symptoms sick leave) besides adequate workplace settings (i.e., emergency preparedness, risk mitigation plans, personal hygiene) to reduce risk and spreading of COVID-19 [5], [69]. Sentiment analysis can help track and manage public sentiment, as well as local or groups sentiments, subject to availability of suitable and timely data, and thus contribute to risk mitigation.

To prevent rapid transmission of COVID-19, most of the affected countries around the world implemented varying forms of Lockdown policies (e.g., quarantine, travel ban, social distancing), with significant economic consequences [39], [66], [70]. During this Lockdown period, people were forced to stay at home, and many lost their jobs, leading to significant emotional upheavals. Two recent surveys demonstrated that numerous small businesses have shut down due to COVID-19 [71], [72]. Collecting data from 5,800 small businesses, Bartik et. al. [71] found that about 43% of them are temporarily closed, and on average they reduced their employee counts by 40% as compared to the beginning of the year. According to the US Chamber of Commerce, about 24% of all small businesses are already closed, and another 40% of those who have not closed are quite likely to close by June of 2020. Despite these alarming numbers, about 46% of those surveyed believe that within a period of six to twelve months, the US will return to a state of normalcy [72]. About 25% of all workers in the US, such as those who are employed in information technology, administration, financial, and engineering sectors can perform work from home [73]. In contrast, about 75% of workers, such as those employed in healthcare, industrial manufacturing, retail and food services, etc. are unable to perform work from home due to the nature of their work which mandates physical presence. Consequently, a large portion of the workers are at risk of adverse health outcomes. Reopening the economy will exacerbate the situation with a higher potential for COVID-19 transmission. Not reopening the economy has the potential to create irreversible socioeconomic damage which can subsequently lead to greater loss of lives and more pain, along with diminished long term capabilities to fight the SCoV2 pandemic, and other crises, should they persist or new crises arise. Sentiment analysis, and PSS analysis can inform and enlighten decision makers to make better decisions, and thus help mitigate risks in crisis, disaster and pandemic circumstances.

C. Opportunities

Technology supported sentiment analysis presents numerous opportunities for value creation through serving as a support mechanism for high quality decision making, and for increasing awareness leading to risks mitigation. For researchers and academicians, this study presents a new sub-stream of research which provides a way to use sentiment analysis in crisis management scenario analysis. Though this research, by intention, does not seek to develop a prominent new theory, yet it has strong potential for adding theoretical value to future research based on two key contributions that this study makes with direct theoretical implications and relevance. First, this study develops the PSS framework, which can be used for theory development and validation in multiple domains, such as decision support systems (DSS) and information systems (IS). Both IS theories, as well as DSS theories can be informed and influenced by the novelty of PSS. As an illustration, the theory of Structuration could be adapted into a new theoretical framework to study the iterative nature of how PSS can influence policy and governance, and how policy and governance can in turn influence subsequent formation of PSS [74]. Secondly, the study illustrates a novel application of identification and validation of dominant public sentiment for PSS usage.

Recent research has demonstrated that information facets and categories can influence human thinking and performance, and hence can impact feelings. This presents an opportunity for future research to perform sentiment analysis with multiple information facets at varying levels to examine potential behavioral variations [75]. This study also provides pandemic specific public sentiment insights to researchers specifically interested in pursuing the SCoV2 pandemic and COVID-19 studies. Academicians can expand the current study using additional sentiment analysis tools and customized crisis relevant sentiment analysis lexicons. There is also an easy opportunity for researchers to gain rapid insights by repeating this study for future time periods and thus help develop a sequence of reopening and recovery relevant public sentiment analysis studies. Such an approach would also be very useful for practitioners who have a strong need for recognizing market sentiment for a wide range of business decisions.

Practitioners can make use of this study in at least two ways: the first is a direct application of the positive public sentiment finding of this study, after additional context specific validation and due diligence, to inform and improve organizational decisions; and the second is to utilize the logic of the methods presented in this research for situation specific and localized sentiment trends based scenario analysis related to organizational decisions. For example, the four new normal scenarios schema can be customized and adapted to business situations, where modified sentiment estimation methods can be used to gauge specific consumer segment sentiment and used to inform products (or services) design, manufacturing (or process) and marketing decisions. The [positive sentiment: negative sentiment] X [action 1 (now): action 2 (later)] matrix, from the PSS Analysis section provides a conceptual scenario analysis strategy which has high potential for scaling and adaptation.

V. Conclusion and Future Work

“We shall draw from the heart of suffering itself the means of inspiration and survival.” – Churchill [59]

Big data and technology aided sentiment analysis is a valuable research mechanism to support insights formation for the reopening and recovery process. Sentiment analysis tools can be effectively used to gauge public sentiment trends from social media data, especially given the high levels of trust in social media posts among many networks [76]. This concluding section elaborates upon the two categories of contributions, mentioned in the introduction section. Within the first category of contributions focused on COVID-19 reopening specific findings, we make a significant contribution by identifying the relative prominence of positive sentiment over negative sentiment, towards a quick reopening of the US economy. As a contribution, this study discovered positive public sentiment trends for the early part of May, 2020, on the topic of reopening post COVID-19. Specifically, the study discovered high levels of trust sentiment and anticipation sentiment, mixed with relatively lower levels of fear and sadness. Positive sentiment count dominated negative sentiment count, though negative tweets used more extreme language. While sentiment analysis provides insights into public feelings, it is only one part of a complex set of contributions which will be required to effectively move into the new normal. Sentiment analysis based on the tweets data used in this study, appears to indicate public sentiment support for reopening. The message that “it is time to reopen now” was prominent in the reopening tweets data. The findings are statistically validated and this research contributes to the body of knowledge on COVID-19 reopening strategies, with the findings of the PSS framework, which can also serve as a strategic application framework for practitioners.

The second category of contributions adds value to theory and research in the long term, and is focused on methodology, and the conceptualization and generalizability of PSS. This study makes a significant contribution by developing a unique public sentiment driven framework for scenario analysis. The PSS is a highly flexible and easily adaptable framework, and can be widely used by future researchers and practitioners, including international agencies such as World Health Organization (WHO), on a broad range of research topics and diverse public sentiment sensitive scenarios, respectively. For example, our current research project involves the use of PSS, adapted to the topic of fake news, for an investigation into the role of public sentiment towards fake news phenomena. Similarly, researchers can use PSS adaptations for theory development and validation in the context of public sentiment, and practitioners can use the PSS framework to gain insights on a wide range of public sentiment sensitive scenarios, including racial justice, and unusual events which trigger rapid changes in public sentiment. Furthermore, we believe that this research contributes to the sentiment component of the recent call for cyberpsychology research, and well developed sentiment analysis tools and models can help explain and classify human behavior under pandemic and similar crisis conditions [77]. Positive public support sentiment will remain critical for successful reopening and recovery, and therefore additional initiatives tracking sentiment and evaluating public feelings effectively will be extremely useful. Sentiments can be volatile and localized, and hence technological and information systems initiatives with real-time sentiment tracking and population segmentation mechanisms will provide the most valuable public sentiment trends insights. A high level of positive public sentiment resilience will be needed for a successful new normal. This research conceptualized a useful sentiment polarity based PSS framework, as mapped in Fig. 10, which will be sustainable for future crisis-events analysis, well beyond COVID-19. With additional research and validation, the research strategy utilized in this paper can be easily replicated with necessary variations, and applied on future data from multiple social media sources, to manage future crises, and presently to generate critical and timely insights that can help form an optimal post-COVID-19 new normal.

Biographies

graphic file with name jsamu-3013933.gif

Jim Samuel possesses M.B.A. (Finance) and M. Arch. degrees, and obtained his Ph.D. degree in information systems from Baruch College & Graduate Center, City University of New York. He is currently an Associate Professor with the School of Business, University of Charleston. His primary research interests include human intelligence and artificial intelligence interaction, textual analytics, applied machine learning, and socioe-conomic implications of artificial intelligence. He leads multiple analytics and applied artificial intelligence initiatives, including corporate consulting and global research collaborations.

graphic file with name rahma-3013933.gif

Md. Mokhlesur Rahman received the Bachelor of Urban and Regional Planning (B.URP) degree from the Department of Urban and Regional Planning (URP), Bangladesh University of Engineering and Technology (BUET), in 2009, and the M.Sc. degree in urban planning from the Department of Urban Planning and Design (DUPAD), The University of Hong Kong (HKU), Hong Kong. After graduation from HKU, he started working at the Khulna University of Engineering & Technology (KUET) as a Lecturer, in December 2014, and promoted to an Assistant Professor, in February 2017. He is currently a Graduate Student and a Research Assistant with The University of North Carolina at Charlotte and doing research on transportation engineering and planning.

graphic file with name ali-3013933.gif

G. G. Md. Nawaz Ali (Member, IEEE) received the B.Sc. degree in computer science and engineering from the Khulna University of Engineering and Technology, Bangladesh, in 2006, and the Ph.D. degree in computer science from the City University of Hong Kong, Hong Kong, in 2013, with the Outstanding Academic Performance Award. From October 2015 to March 2018, he was a Postdoctoral Research Fellow with the School of Electrical and Electronic Engineering, Nanyang Technological University (NTU), Singapore. He is currently working as an Assistant Professor with the Department of Applied Computer Science, University of Charleston, Charleston, WV, USA. Prior to joining UCWV, he was a Postdoctoral Fellow with the Department of Automotive Engineering, The Clemson University International Center for Automotive Research (CU-ICAR), Greenville, SC, USA, from March 2018 to July 2019. He is a reviewer of a number of international journals, including the IEEE Transactions on Intelligent Transportation Systems and Magazine, the IEEE Transactions on Vehicular Technology, the IEEE Interntet of Things (IoT) Journal, IEEE Access, and Wireless Networks. His current research interests include vehicular cyber physical systems (VCPSs), wireless broadcasting, mobile computing, and network coding.

graphic file with name ysamu-3013933.gif

Yana Samuel received her M.S. degree in higher education from Western Washington University. She is currently pursuing her doctoral degree in education with North-eastern University, Boston, MA, USA. She is also a Scholar-Practitioner and Founder of SheLovesAI. Her research interests include cognition differences, bias, resilience, and women in technology. She has published award winning research. She is in the process of building the SheLovesAI initiative, focusing on understanding and improving the success of women in advanced technologies. Her current research interests include developing resilience theory frameworks, phenomenological insights generation, and on the applications of resilience models to education and learning.

graphic file with name pelae-3013933.gif

Alexander Pelaez is currently an Associate Professor of information technology and business analytics with Hofstra University. His research interests include online purchases and group dynamics as well as the use of social networking and mobile technologies. His work has been published in the International Journal of Electronic Commerce, the Journal of Management Systems, and advises corporations on analytics.

graphic file with name chong-3013933.gif

Peter Han Joo Chong (Senior Member, IEEE) received the Ph.D. degree from the University of British Columbia, Canada, in 2000. From July 2000 to January 2001, he worked with the Advanced Networks Division, Agilent Technologies Canada Inc., Canada. From February 2001 to May 2002, he was a Research Engineer with the Nokia Research Center, Finland. He is currently an Associate Head of School (Research) and the Head of the Department of Electrical and Electronic Engineering, School of Engineering, Computer and Mathematical Sciences, Auckland University of Technology, New Zealand. He is also an Adjunct Professor with the Department of Information Engineering, The Chinese University of Hong Kong, Hong Kong. He was previously an Associate Professor (tenured) with the School of Electrical and Electronic Engineering, Nanyang Technological University, Singapore, from 2002 to 2016. From 2011 and 2013, he was an Assistant Head of the Division of Communication Engineering. From 2013 to 2016, he was a Director of Infinitus, Centre for Infocomm Technology. His research interests are in the areas of mobile communications systems, including MANETs/VANETs, V2X, the Internet of Things/Vehicles, artificial intelligence for wireless networks, and 5G networks.

graphic file with name yakub-3013933.gif

Michael Yakubov received his Bachelor of Arts degree in criminal justice from Kean University, and obtained his master's degree in public administration. He is currently pursuing a doctoral degree in education with Wilmington University. He is an accomplished Higher Education Administrator with extensive knowledge in the fields of enrollment management, student retention, and academic program management. His experiences span across several academic institutions, including William Paterson University, Rowan College, and Caldwell University, where he has served in the roles of an Assistant Director, the Director, an Assistant Dean, and the Dean.

References

  • [1].Coe E. H. and Enomoto K.. (2020). Returning to Resilience: The Impact of COVID-19 on Mental health and Substance Use. McKinsey & Company. Accessed: May 16, 2020. [Online]. Available: https://www.mckinsey.com/industries/healthcare-systems-and-services/our%-insights/returning-to-resilience-the-impact-of-covid-19-on-behavioral-health [Google Scholar]
  • [2].Goldmann E. and Galea S., “Mental health consequences of disasters,” Annu. Rev. Public Health, vol. 35, no. , pp. 169–183, Mar. 2014. [DOI] [PubMed] [Google Scholar]
  • [3].Waheed A., Goyal M., Gupta D., Khanna A., Al-Turjman F., and Pinheiro P. R., “CovidGAN: Data augmentation using auxiliary classifier GAN for improved covid-19 detection,” IEEE Access, vol. 8, pp. 91916–91923, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [4].Zhong L., Mu L., Li J., Wang J., Yin Z., and Liu D., “Early prediction of the 2019 novel coronavirus outbreak in the mainland China based on simple mathematical model,” IEEE Access, vol. 8, pp. 51761–51769, 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [5].Moghadas S. M., Shoukat A., Fitzpatrick M. C., Wells C. R., Sah P., Pandey A., Sachs J. D., Wang Z., Meyers L. A., Singer B. H., and Galvani A. P., “Projecting hospital utilization during the COVID-19 outbreaks in the united states,” Proc. Nat. Acad. Sci. USA, vol. 117, no. 16, pp. 9122–9126, Apr. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [6].(2020). Coronavirus Cases: United States. Accessed: Jul. 18, 2020. [Online]. Available: https://www.worldometers.info/coronavirus/country/us/
  • [7].(2020). Unemployment Insurance Weekly Claims Data. Accessed: May 12, 2020. [Online]. Available: https://oui.doleta.gov/unemploy/claims.asp
  • [8].(2020). Tensions Over Restrictions Spark Violence and Defiance Among Protesters as Trump Pushes States to Reopen. Accessed: May 14, 2020. [Online]. Available: https://www.washingtonpost.com/nation/2020/05/13/protest-violence-coron%avirus/
  • [9].(2020). What You Can Do. Accessed: May 14, 2020. [Online]. Available: https://www.cdc.gov/coronavirus/2019-ncov/need-extra-precautions/what-y%ou-can-do.html
  • [10].Höchtl J., Parycek P., and Schöllhammer R., “Big data in the policy cycle: Policy decision making in the digital era,” J. Organizational Comput. Electron. Commerce, vol. 26, nos. 1–2, pp. 147–169, Apr. 2016. [Google Scholar]
  • [11].Colón-De-Armas C., Rodriguez J., and Romero H., “Investor sentiment and US presidential elections,” Rev. Behav. Finance, vol. 9, no. 3, pp. 227–241, Oct. 2017. [Google Scholar]
  • [12].Davies W.. (2016). The Age of Post-Truth Politics. Accessed: Jun. 21, 2020. [Online]. Available: https://www.nytimes.com/2016/08/24/opinion/campaign-stops/the-age-of-po%st-truth-politics.html [Google Scholar]
  • [13].Sneader K. and Singhal S.. (2020). Beyond Coronavirus: The Path to the Next Normal. Accessed: May 15, 2020. [Online]. Available: https://www.mckinsey.com/industries/healthcare-systems-and-services/our%-insights/beyond-coronavirus-the-path-to-the-next-normal [Google Scholar]
  • [14].Mohammadi E., Thelwall M., Kwasny M., and Holmes K. L., “Academic information on Twitter: A user survey,” PLoS ONE, vol. 13, no. 5, May 2018, Art. no. e0197265. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [15].Sinnenberg L., Buttenheim A. M., Padrez K., Mancheno C., Ungar L., and Merchant R. M., “Twitter as a tool for health research: A systematic review,” Amer. J. Public Health, vol. 107, no. 1, p. 143, Jan. 2017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [16].Ghiassi M., Zimbra D., and Lee S., “Targeted Twitter sentiment analysis for brands using supervised feature engineering and the dynamic architecture for artificial neural networks,” J. Manage. Inf. Syst., vol. 33, no. 4, pp. 1034–1058, Oct. 2016. [Google Scholar]
  • [17].Lim S. and Tucker C. S., “Mining Twitter data for causal links between tweets and real-world outcomes,” Expert Syst. Appl., X, vol. 3, Sep. 2019, Art. no. 100007. [Google Scholar]
  • [18].Yu H., Hu Y., and Shi P., “A prediction method of peak time popularity based on Twitter hashtags,” IEEE Access, vol. 8, pp. 61453–61461, 2020. [Google Scholar]
  • [19].Wang X., Kang Q., An J., and Zhou M., “Drifted Twitter spam classification using multiscale detection test on K-L divergence,” IEEE Access, vol. 7, pp. 108384–108394, 2019. [Google Scholar]
  • [20].Saif H., He Y., Fernandez M., and Alani H., “Contextual semantics for sentiment analysis of Twitter,” Inf. Process. Manage., vol. 52, no. 1, pp. 5–19, Jan. 2016. [Google Scholar]
  • [21].Samuel J., Holowczak R., Benbunan-Fich R., and Levine I., “Automating discovery of dominance in synchronous computer-mediated communication,” in Proc. 47th Hawaii Int. Conf. Syst. Sci., Jan. 2014, pp. 1804–1812. [Google Scholar]
  • [22].Chandra Pandey A., Singh Rajpoot D., and Saraswat M., “Twitter sentiment analysis using hybrid cuckoo search method,” Inf. Process. Manage., vol. 53, no. 4, pp. 764–779, Jul. 2017. [Google Scholar]
  • [23].Ansari M. Z., Aziz M. B., Siddiqui M. O., Mehra H., and Singh K. P., “Analysis of political sentiment orientations on Twitter,” Procedia Comput. Sci., vol. 167, pp. 1821–1828, Jan. 2020. [Google Scholar]
  • [24].Samuel J., Ali G. G. M. N., Rahman M. M., Esawi E., and Samuel Y., “COVID-19 public sentiment insights and machine learning for tweets classification,” Information, vol. 11, no. 6, p. 314, Jun. 2020, doi: 10.3390/info11060314. [DOI] [Google Scholar]
  • [25].Kretinin A., Samuel J., and Kashyap R., “When the going gets tough, the tweets get going! an exploratory analysis of tweets sentiments in the stock market,” Amer. J. Manage., vol. 18, no. 5, pp. 2–26, 2018. [Google Scholar]
  • [26].Jianqiang Z., Xiaolin G., and Xuejun Z., “Deep convolution neural networks for Twitter sentiment analysis,” IEEE Access, vol. 6, pp. 23253–23260, 2018. [Google Scholar]
  • [27].Saad S. E. and Yang J., “Twitter sentiment analysis based on ordinal regression,” IEEE Access, vol. 7, pp. 163677–163685, 2019. [Google Scholar]
  • [28].Rushe D. and Holpuch A.. (2020). How Will the US Reopen? Slowly, Bit by Bit, but We May Never Return to ‘Normal. Accessed: Apr. 29, 2020. [Online]. Available: https://www.theguardian.com/world/2020/apr/29/how-will-us-reopen-corona%virus [Google Scholar]
  • [29].Erin B.. (2020). The Risks—Know Them—Avoid Them. Accessed: May 11, 2020. [Online]. Available: https://www.erinbromage.com/post/the-risks-know-them-avoid-them [Google Scholar]
  • [30].Qian H., Miao T., Liu L., Zheng X., Luo D., and Li Y., “Indoor transmission of SARS-CoV-2,” Medrxiv, to be published. [Online]. Available: https://www.medrxiv.org/content/early/2020/04/07/2020.04.04.20053058 [DOI] [PubMed]
  • [31].Samuel J., “Information token driven machine learning for electronic markets: Performance effects in behavioral financial big data analytics,” J. Inf. Syst. Technol. Manage., vol. 14, no. 3, pp. 371–383, 2017. [Google Scholar]
  • [32].Conner C., Samuel J., Kretinin A., Samuel Y., and Nadeau L., “A picture for the words! Textual visualization in big data analytics,” in Proc. Northeast Bus. Econ. Assoc. (NBEA) Annu., vol. 46, 2019, pp. 37–43. [Google Scholar]
  • [33].Aboelkassem Y., “COVID-19 pandemic: A Hill type mathematical model predicts the US death number and the reopening date,” MedRxiv, to be published. [Online]. Available: https://www.medrxiv.org/content/early/2020/04/17/2020.04.12.20062893
  • [34].Li L., Zhang Q., Wang X., Zhang J., Wang T., Gao T.-L., Duan W., Tsoi K. K.-F., and Wang F.-Y., “Characterizing the propagation of situational information in social media during COVID-19 epidemic: A case study on weibo,” IEEE Trans. Comput. Social Syst., vol. 7, no. 2, pp. 556–562, Apr. 2020. [Google Scholar]
  • [35].CDC. (2020). Emergency Department Visits Percentage of Visits for COVID-19-Like Illness (CLI) or Influenza-Like Illness (ILI). Accessed: May 12, 2020. [Online]. Available: https://www.cdc.gov/coronavirus/2019-ncov/covid-data/covidview/05082020%/covid-like-illness.html
  • [36].Stephen P., John W., and Benjamin M.. (2020). Projected Deaths of Despair During COVID-19. Accessed: May 12, 2020. [Online]. Available: https://wellbeingtrust.org/areas-of-focus/policy-and-advocacy/reports/p%rojected-deaths-of-despair-during-covid-19/
  • [37].(Mar. 2020). The World Economy at Risk. Accessed: Jun. 21, 2020. [Online]. Available: https://www.oecd.org/berlin/publikationen/Interim-Economic-Assessment-2-March-2%020.pdf
  • [38].Papadamou S., Fassas A., Kenourgios D., and Dimitriou D., “Direct and indirect effects of COVID-19 pandemic on implied stock market volatility: Evidence from panel data analysis,” Univ. Library Munich, Munich, Germany, MPRA Paper 100020, May 2020, Accessed: May 15, 2020. [Online]. Available: https://ideas.repec.org/p/pra/mprapa/100020.html [Google Scholar]
  • [39].Zhang D., Hu M., and Ji Q., “Financial markets under the global pandemic of COVID-19,” Finance Res. Lett., 2020, Art. no. 101528. [DOI] [PMC free article] [PubMed]
  • [40].Ashraf B. N., “Stock markets’ reaction to COVID-19: Cases or fatalities?” Res. Int. Bus. Finance, 2020, Art. no. 101249. [DOI] [PMC free article] [PubMed]
  • [41].Adams-Prassl A., Boneva T., Golin M., and Rauh C., “Inequality in the impact of the coronavirus shock: Evidence from real time surveys,” J. Public Econ., to be published. [Online]. Available: http://ftp.iza.org/dp13183.pdf
  • [42].Figari F. and Fiorio C. V., “Welfare resilience in the immediate aftermath of the COVID-19 outbreak in Italy,” in Proc. EUROMOD Inst. Social Econ. Res., EUROMOD Working Papers EM6/20, Apr. 2020, pp. 1–20. [Online]. Available: https://ideas.repec.org/p/ese/emodwp/em6-20.html [Google Scholar]
  • [43].OECD, “Evaluating the initial impact of COVID-19 containment measures on economic activity,” OECD, Paris, France, Tech. Rep., 2020. [Google Scholar]
  • [44].Maria del Rio-Chanona R., Mealy P., Pichler A., Lafond F., and Farmer D., “Supply and demand shocks in the COVID-19 pandemic: An industry and occupation perspective,” 2020, arXiv:2004.06759. [Online]. Available: http://arxiv.org/abs/2004.06759
  • [45].Pépin L., Kuntz P., Blanchard J., Guillet F., and Suignard P., “Visual analytics for exploring topic long-term evolution and detecting weak signals in company targeted tweets,” Comput. Ind. Eng., vol. 112, pp. 450–458, Oct. 2017. [Google Scholar]
  • [46].Samuel Y., George J., and Samuel J., “Beyond STEM, how can women engage big data, analytics, robotics and artificial intelligence? An exploratory analysis of confidence and educational factors in the emerging technology waves influencing the role of, and impact upon, women,” 2020, arXiv:2003.11746. [Online]. Available: http://arxiv.org/abs/2003.11746
  • [47].Miller G., “The smartphone psychology manifesto,” Perspect. Psychol. Sci., vol. 7, no. 3, pp. 221–237, May 2012. [DOI] [PubMed] [Google Scholar]
  • [48].Shaw H., Ellis D., Kendrick L.-R., and Wiseman R., “Individual differences between iphone and Android smartphone users,” Brit. Psychol. Soc., Tech. Rep., 2016.
  • [49].Lin T.-C. and Huang S.-L., “Understanding the determinants of Consumers’ switching intentions in a standards war,” Int. J. Electron. Commerce, vol. 19, no. 1, pp. 163–189, Oct. 2014. [Google Scholar]
  • [50].He W., Wu H., Yan G., Akula V., and Shen J., “A novel social media competitive analytics framework with sentiment benchmarks,” Inf. Manage., vol. 52, no. 7, pp. 801–812, Nov. 2015. [Google Scholar]
  • [51].Ravi K. and Ravi V., “A survey on opinion mining and sentiment analysis: Tasks, approaches and applications,” Knowl.-Based Syst., vol. 89, pp. 14–46, Nov. 2015. [Google Scholar]
  • [52].Samuel J., Kashyap R., and Kretinin A., “Going where the tweets get moving! an explorative analysis of tweets sentiments in the stock market,” in Proceedings of the Northeast Business & Economics Association. New Brunswick, NJ, USA: NBEA, 2018. [Google Scholar]
  • [53].Jockers M. L.. (2015). Syuzhet: Extract Sentiment Plot Arcs From Text. [Online]. Available: https://github.com/mjockers/syuzhet [Google Scholar]
  • [54].Rinker T. W., Sentimentr: Calculate Text Polarity Sentiment. New York, NY, USA: Buffalo, 2019. [Online]. Available: http://github.com/trinker/sentimentr [Google Scholar]
  • [55].Samuel J., “An analysis of technological features enabled management of information facets,” Ph.D. dissertation, IS, Zicklin School Bus., Graduate Center, City Univ. New York, New York, NY, USA, 2016. [Google Scholar]
  • [56].Fischer F. and Miller G. J., Handbook Public Policy Analysis: Theory, Politics, Methods. Abingdon, U.K.: Routledge, 2017. [Google Scholar]
  • [57].Black R. C., Owens R. J., Wedeking J., and Wohlfarth P. C., “The influence of public sentiment on supreme court opinion clarity,” Law Soc. Rev., vol. 50, no. 3, pp. 703–732, Sep. 2016. [Google Scholar]
  • [58].Li S., Liu Z., and Li Y., “Temporal and spatial evolution of online public sentiment on emergencies,” Inf. Process. Manage., vol. 57, no. 2, Mar. 2020, Art. no. 102177. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [59].Samuel J., “Eagles & lions winning against coronavirus! 8 principles from winston churchill for overcoming COVID-19 & fear,” in Proc. SSRN, 2020, pp. 1–2, doi: 10.2139/ssrn.3591528. [DOI] [Google Scholar]
  • [60].Sul H. K., Dennis A. R., and Yuan L. I., “Trading on Twitter: Using social media sentiment to predict stock returns,” Decis. Sci., vol. 48, no. 3, pp. 454–488, Jun. 2017. [Google Scholar]
  • [61].Alfina I., Sigmawaty D., Nurhidayati F., and Hidayanto A. N., “Utilizing hashtags for sentiment analysis of tweets in the political domain,” in Proc. 9th Int. Conf. Mach. Learn. Comput. ICMLC, 2017, pp. 43–47. [Google Scholar]
  • [62].Wang Y. and Fikis D. J., “Common core state standards on Twitter: Public sentiment and opinion leaders,” Educ. Policy, vol. 33, no. 4, pp. 650–683, Jun. 2019. [Google Scholar]
  • [63].Chen Y., Silva E. A., and Reis J. P., “Measuring policy debate in a regrowing city by sentiment analysis using online media data: A case study of Leipzig 2030,” Regional Sci. Policy Pract., 2020.
  • [64].Samuel J., Garvey M., and Kashyap R., “That message went viral?! Exploratory analytics and sentiment analysis into the propagation of tweets,” 2020, arXiv:2004.09718. [Online]. Available: http://arxiv.org/abs/2004.09718
  • [65].Liu Y., Gayle A. A., Wilder-Smith A., and Rocklöv J., “The reproductive number of COVID-19 is higher compared to SARS coronavirus,” J. Travel Med., vol. 27, no. 2, pp. 1–4, Mar. 2020. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [66].Yu K. D. S. and Aviso K. B., “Modelling the economic impact and ripple effects of disease outbreaks,” Process Integr. Optim. Sustainability, vol. 4, no. 2, pp. 183–186, Jun. 2020. [Google Scholar]
  • [67].Edwards C. H., Tomba G. S., and de Blasio B. F., “Influenza in workplaces: Transmission, workers’ adherence to sick leave advice and European sick leave recommendations,” Eur. J. Public Health, vol. 26, no. 3, pp. 478–485, Jun. 2016. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [68].Webster R. K., Liu R., Karimullina K., Hall I., Amlôt R., and Rubin G. J., “A systematic review of infectious illness presenteeism: Prevalence, reasons and risk factors,” BMC Public Health, vol. 19, no. 1, p. 799, Dec. 2019. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • [69].Dryhurst S., Schneider C. R., Kerr J., Freeman A. L. J., Recchia G., Van Der Bles A. M., Spiegelhalter D., and van der Linden S., “Risk perceptions of COVID-19 around the world,” J. Risk Res., pp. 1–13, 2020.
  • [70].Moser C. A. and Yared P., “Pandemic lockdown: The role of government commitment,” Nat. Bur. Econ. Res., Cambridge, MA, USA, Tech. Rep. 27062, Apr. 2020. [Online]. Available: http://www.nber.org/papers/w27062 [Google Scholar]
  • [71].Bartik A. W., Bertrand M., Cullen Z. B., Glaeser E. L., Luca M., and Stanton C. T., “How are small businesses adjusting to COVID-19? Early evidence from a survey,” Nat. Bur. Econ. Res., Cambridge, MA, USA, Tech. Rep. 26989, Apr. 2020. [Online]. Available: http://www.nber.org/papers/w26989 [Google Scholar]
  • [72].of Commerce U. C., “Special report on coronavirus and small business,” MetLife & U.S. Chamber of Commerce, Washington, DC, USA, Tech. Rep., Apr. 2020. [Online]. Available: https://www.uschamber.com/report/special-report-coronavirus-and-small-b%usiness [Google Scholar]
  • [73].Baker M. G., “Who cannot work from home? Characterizing occupations facing increased risk during the COVID-19 pandemic using 2018 BLS data,” Medrxiv, to be published, doi: 10.1101/2020.03.21.20031336v2. [DOI]
  • [74].Giddens A., The Constitution Society: Outline Theory Structuration. Berkeley, CA, USA: Univ of California Press, 1984. [Google Scholar]
  • [75].Samuel J., Holowczak R., and Pelaez A., “The effects of technology driven information categories on performance in electronic trading markets,” J. Inf. Technol. Manage., vol. 28, nos. 1–2, pp. 1–14, 2017. [Google Scholar]
  • [76].Shareef M. A., Kapoor K. K., Mukerji B., Dwivedi R., and Dwivedi Y. K., “Group behavior in social media: Antecedents of initial trust formation,” Comput. Hum. Behav., vol. 105, Apr. 2020, Art. no. 106225. [Google Scholar]
  • [77].Guitton M. J., “Cyberpsychology research and COVID-19,” Comput. Hum. Behav., vol. 111, Oct. 2020, Art. no. 106357. [Online]. Available: http://www.sciencedirect.com/science/article/pii/S0747563220301102 [DOI] [PMC free article] [PubMed] [Google Scholar]

Articles from Ieee Access are provided here courtesy of Institute of Electrical and Electronics Engineers

RESOURCES