Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2021 Mar 28;18(7):3508. doi: 10.3390/ijerph18073508

Engagement of Government Social Media on Facebook during the COVID-19 Pandemic in Macao

Patrick Cheong-Iao Pang 1, Qixin Cai 2, Wenjing Jiang 3,*, Kin Sun Chan 3
Editor: Paul B Tchounwou
PMCID: PMC8036686  PMID: 33800621

Abstract

Government social media is widely used for providing updates to and engaging with the public in the COVID-19 pandemic. While Facebook is one of the popular social media used by governments, there is only a scant of research on this platform. This paper aims to understand how government social media should be used and how its engagement changes in prodromal, acute and chronic stages of the pandemic. We collected 1664 posts and 10,805 comments from the Facebook pages of the Macao government from 1 January to 31 October 2020. Using word frequency and content analysis, the results suggest that the engagement was relatively low at the beginning and then surged in the acute stage, with a decreasing trend in the chronic stage. Information about public health measures maintained their engagement in all stages, whereas the engagement of other information was dropping over time. Government social media can be used for increasing vigilance and awareness in the prodromal stage; disseminating information and increasing transparency in the acute stage; and focusing on mental health support and recovery policies in the chronic stage. Additionally, it can be a tool for controlling rumors, providing regular updates and fostering community cohesion in public health crises.

Keywords: government, social media, Facebook, content analysis, Macao, communication, engagement, COVID-19

1. Introduction

In this ongoing coronavirus disease 2019 (COVID-19) global pandemic, government social media plays an important role in engaging the public to combat the disease. A tremendous public health risk such as the COVID-19 pandemic shares a lot of common characteristics with other crises, for example, a high level of uncertainty, unexpected rapid development and short triggering events [1]. Therefore, communication efforts need to be ramped up to match the level of risks. Apart from the adverse effects of an “infodemic” (i.e., misinformation and panic being widely spread on social media) [2,3], research highlights the potential of social media to provide trusted information and counteract misinformation [4,5], cultivate information security behavior against scams [6], raise awareness and promote behavioral changes [7]. Despite the growing body of research in this space, only a limited number of studies (for example, [8,9,10]) have investigated the use of social media by governments and public health authorities. As such, our study aims to conceptualize the use of government social media in this COVID-19 crisis for its effective use in future public health crises.

Our analysis of the literature shows its imbalance in both the choices of social media platforms and the period of data collection. Many studies used Twitter (e.g., [11,12,13]) and Weibo (e.g., [9,14,15,16,17]) as data sources, and only a scant amount of research examined the content on Facebook (e.g., [8,18]). Due to the different use, culture and politics of different social media platforms [19], Facebook users may pose different behaviors and this motivates our work. In addition, our literature review finds that most of the social media research about COVID-19 used data between December 2019 and April 2020. While this is understandable as user reactions were most intense at the early stages, however, as many countries move forward to another phase of the pandemic, people are expected to react differently both online and offline in the new normal. Therefore, our study can address these blanks and shed light on the use of government social media at the beginning of the end of this global pandemic.

The dynamics of the COVID-19 pandemic often requires quick responses and swift decision making, which are similar to the handling of public health crises. As such, we use the perspective of crisis management that offers a systematic framework to understand how government social media is used at different points of time, which is important since social media users prefer different content and disseminate information differently in different stages of public health crises [20,21]. More specifically, the crisis model proposed by Fink divides a crisis into four stages [22], which allows us to compare the use of government social media in response to COVID-19 separately.

Despite having the world’s highest population density [23], the Macao Special Administration Region (abbreviated to Macao SAR or Macao) is one of the jurisdictions in the world which has successfully eliminated the transmission of the disease. As a popular destination of tourists, Macao welcomes 38 million tourists per year, and thus any ineffective infectious disease control can be catastrophic [24]. With rapid early responses and stringent preventive measures [24], the city has recorded more than 350 days without local community transmission at the time of writing (March 2021). As the community has entered the recovery stage, the case study of Macao not only provides understandings about their use of government social media, but also an insight at how the engagement of social media can be leveraged in the subsequent stages of the pandemic. This knowledge will be useful for Macao and other places to handle public health crises in the future.

The content analysis methodology was mainly used in this study. We collected 1664 COVID-19-related posts and 10,805 comments of these posts from the official Facebook pages of the Macao SAR government from 1 January 2020 to 31 October 2020 with software. These posts were classified based on their nature with a qualitative approach, whereas an exploratory word frequency analysis was performed on the comments. In addition, we examined the trends of different types of engagement associated with the posts, for example, total, positive and negative engagement, as well as the numbers of comments and shares. We also conceptualize the findings and propose the potential applications of government social media for future public health crises.

The rest of this paper is structured as follows. Firstly, we give a brief introduction of the COVID-19 outbreak in Macao and the literature review that supports our work. Then, we present our data collection details, analysis methods and results, followed by the discussion of the main findings and their implications. Finally, we conclude the article with the key messages identified in our work.

2. Background: The COVID-19 Outbreak in Macao

The emergency and crisis management system in Macao originated in the severe acute respiratory syndrome (SARS) outbreak in 2003 [25]. This system and key legislations such as the Law on Prevention, Control and Treatment of Infectious Diseases and the 10-Year Plan for Disaster Prevention and Mitigation of the Macao SAR (2019–2028) have been established to empower the government to rapidly respond to mass emergencies and disasters. Before COVID-19, the crisis management system was primarily used for natural disasters such as typhoons Hato (2017) and Mangkhut (2018) [25]. In this current outbreak, the system and the legislation enables the government to realize public health measures and isolate potentially infectious patients [24].

In the early days, Macao put some preparatory measures in place even before the start of the local outbreak [24], in response to the cases of pneumonia of unknown cause in Wuhan, China at the end of December 2019 [26]. Starting from 1 January 2020, the checking of body temperature was enforced for all passengers travelled from Wuhan, and health declaration forms became mandatory in order to enter Macao. The government established a 24-h COVID-19 Coordination Center for monitoring the development of the potential infections on 21 January [24].

On 22 January, a traveler from Wuhan was identified as the first confirmed infection in Macao [27]. In the following two weeks, nine more cases were found and admitted to hospital [28]. In the meantime, various stringent measures (Table 1), including stricter border control, centralized procurement and the mandatory use of face masks, were introduced to reduce the transmission of the virus. Casinos and border limitations were enforced to control the outbreak with a huge cost to the tourism and gaming industries [23,29]. Local transmissions continued to be discovered until 29 March [30].

Table 1.

Main measures and actions taken by the Macao SAR government.

Policy Category Measures and Actions
Disposition of government Established the COVID-19 Coordination Center
Increased the alert level of public emergencies
Improved public education about the virus
Global procurement of face masks
Prevention and control Strengthened health screening and quarantine
Reduced social gatherings
Shut down casinos, businesses and entertainment premises
Suspended classes in schools and universities
Mandated the use of face masks on public transport
Set up an online personal health declaration system (Health QR Code)
Medical support Suspended non-critical medical services
Provided support to front-line medical staff
Provided mental health assistance
Border control and immigration Limited travelers’ entry to Macao
Suspended self-service customs clearance
Shortened customs clearance time to avoid queues and allow social distancing
Business support Established a special anti-epidemic assistance fund
Launched economic assistance measures
Tax reduction and exemption
Provided subsidized employee training
Livelihood support Issued electronic shopping vouchers
Subsidized water and electricity bills
Monitored the prices of food and other daily necessities

After the elimination of local community transmission, Macao recorded only three imported cases [27], and has entered the phase of recovery. While strict preventive measures largely remained, the government has been focusing on reviving the economy, protecting job opportunities and supporting businesses (for instance, two rounds of economic assistance measures, the subsidization of water and power bills, tax reduction and exemption, etc.). The city also saw the ease of some border control measures and schools resumed classes in stages.

In summary, the Macao SAR government has suppressed the COVID-19 outbreak with a combination of various policies. Many of these policies were also posted to different social media platforms, including Facebook.

3. Literature Review

3.1. Crisis Management and COVID-19

Crises are unpredictable and highly uncertain events in an organization or even a society [31]. Its unpredictable and disruptive nature lead to the needs for crisis management, which aims to identify the key issues in a crisis and reduce harm [32]. Among the research of crisis management, the four-stage model proposed by Fink is a popular tool for researchers to understand the development of crises [22]. This model divides the lifecycle of a crisis into four crisis stages [33,34], namely prodromal, acute, chronic and resolution. In this work, we combined these stages with the progress of the COVID-19 pandemic based on the time when cases were confirmed. Table 2 lists our definitions of these stages and explains how this model can split the timeline of the COVID-19 outbreak for further analysis.

Table 2.

Crisis stages of the COVID-19 outbreak.

Crisis Stage Definition Start of Stage End of Stage
Prodromal This comes before the actual crisis, and its main focus is to prevent or delay the crisis from happening. The start of the current analysis The first confirmed COVID-19 case
Acute This stage follows the prodromal stage. It is signaled by the sudden onset of the event, and the event often develops rapidly. The main goals lie in controlling the crisis and avoiding its deterioration. The first confirmed case 28 days after the last case of local transmissions a
Chronic The crisis situation begins to ease in this stage and its appearance is less dramatic in appearance. As such, the focuses should be on relieving controlling measures, reducing damage and initiating the steps towards recovery. The first day after the acute period The end of the current analysis
Crisis Resolution The crisis is over in this stage. Learnings should be synthesized for preparing the responses to future crises and the society/organization is returning to normal. Not applicable (since the world is still in the middle of the pandemic at the time of writing, this stage is not applicable).

a The end of an outbreak can be declared when there are no infections after two incubation periods (28 days for SARS-CoV-2) as commonly used in other research [35,36].

3.2. Government Social Media and COVID-19

Social media applications can be strategically applied to foster an open government and to improve citizen–government interaction [37]. Previous studies have highlighted the importance of the engagement of government social media to facilitate the communication between the public and governments [38,39,40,41]. Some scholars have also identified challenges, risks, organizational barriers and cultural differences with government social media [39,42]. In certain settings, Facebook is preferred to other social media platforms as a means of participating in local government issues [40], which may imply that Facebook is a critical tool for effective communication between the public and governments during public health emergencies. Government Facebook pages can attract users to share and disseminate public health messages [8]. A recent study suggests that a communication strategy is needed for public health authorities to enhance the preparedness and the responses in public health crises [10].

There has been a growing body of research regarding the use of social media during COVID-19. As the electronic word of mouth, online information such as reviews and social media posts can change people’s behavior [43,44,45], and therefore misinformation and fake reviews are issues in controlling the pandemic. Some scholars have expressed concerns about the difficulty of building trust amid misinformation spread on social media [46]. Others acknowledge the potential of social media for positive purposes [47]. Additionally, studies show that many categories of information were posted on social media. To synthesize the relevant literature, we list these findings in Table 3, which serve as the theoretical foundation for the classification of our data collected from Facebook.

Table 3.

Categories of COVID-19 social media content in the existing literature.

Category Concepts and Related Literature
Plans and Measures Disposition of government [48]
Government’s handling of crisis [9]
Preventive measures [8]
Government response [12,49]
Policies, guidelines and official actions [17]
Notifications and measures been taken [50]
Control measures [51]
Public Health Messages Civic skills [41]
Caring of self-interest [48]
Education [18]
Disease prevention [16]
Popularization of prevention and treatment [49]
Rumor Control Rumor Control [41]
Falsehood correction [8]
Counter-rumor [50]
Latest News Latest news [9]
New cases of COVID-19 [15]
Appreciation Appreciation of front-line workers [9]
Appreciation [8]
Community Resilience Donations of money, goods or services [50]
Making donations [49]

In this article, we aim to contribute to the understanding of how the engagement of government social media, particularly Facebook, evolves in the development of the pandemic. As such, the following research questions were formulated for this study:

  • RQ1: How does public’s engagement of government social media change over the course of the COVID-19 pandemic?

  • RQ2: How do the categories of the content posted by a government affect the level of such engagement?

  • RQ3: What are the implications for governments to use social media to engage with the public in pandemics?

4. Methods and Data Collection

4.1. Data Collection

The information posted on the official Facebook pages of the Macao SAR government was the subject of this study. According to the annual internet usage report published by the Macao Association of Internet Research, Facebook is the second most popular social networking platform used by Macao residents [52]. In 2020, 69% of Macanese internet users used Facebook, among them 94% were 18–34 years old, 75% were 35–54 years old, and 36% were over 55 [52]. Facebook is one of the social networking platforms used by the government to engage with the public since 2017 [53], and therefore this platform can provide a reasonable sample for us to study the use of government social media in this pandemic.

Customized scripts written in Python (version 3.8) were used to crawl data from Facebook every three days. Post content, comments and emotions were updated in our database on a rolling basis to allow for the capture of late interactions from other Facebook users even if the posts had been published for some time. Human ethics applications were exempted by the University’s committee because we used publicly accessible data and would report the results in an aggregated manner.

4.2. Methods

Our research design followed the qualitative content analysis approach which allows for the study of complex phenomena and exploration of patterns in the health context by transforming a large amount of textual data into systematic themes and categories [54]. Content analysis is also used in social media analysis during the pandemic [55]. We used qualitative axial coding [56,57] to sort Facebook posts into a number of categories based on their text content. Both deductive and inductive reasoning was used in the coding process. A preliminary codebook was deducted from the existing literature of the content of social media during crises (Table 2) and this codebook was used to guide the analysis. In this process, codes that did not exist in the codebook were inducted through re-reading the data and merging similar codes. This approach can preserve the theories and principles that are applicable for our analysis, while allowing for the flexibility for unexpected or new insights to be captured, which results in a rigorous, comprehensive and reliable study [58].

We also obtained the numbers of comments, shares, likes and other emotions. As illustrated in Figure 1, in addition to “likes”, modern Facebook allows users to select other emotions, such as love, angry and sad. This information can be used for measuring the level of different types of engagement of government social media. For the purposes of this study, we categorized these choices of engagement into the following four metrics:

  • Positive emotions: The sum of likes, love, laugh and care emotions

  • Negative emotions: The sum of angry and sad emotions

  • Numbers of comments

  • Numbers of shares

Figure 1.

Figure 1

A sample COVID-19 Facebook post authored by the government.

Positive and negative emotions were used for understanding the sentiment expressed by Facebook users; the numbers of comments showed the degree to which users wanted to interact with the government and other users by leaving comments; and the numbers of shares indicated the magnitude of the propagation of information. The “surprise” emotion was excluded because it could not represent neither positive nor negative. The average values of such variables were then aggregated by calendar weeks in order to observe the trends at different times during the pandemic. In addition, we compared these figures across different post categories and crisis stages.

The content of user comments can reflect their areas of concerns, but such content can be noisy for analysis, for example, someone may comment to the original post, reply to other users, or even disseminate non-relevant messages. In this work, we performed a word frequency analysis to explore the topics that most people commented under the posts. We utilized a word segmentation library PKUSEG (version 0.25) created by Peking University [59] to split Chinese sentences into words, then the NLTK toolkit (version 3.4.5) [60] was applied to calculate the occurrences of each word within the data. The most used 10 words (threshold determined by our previous work [61]) were examined to identify users’ interests and concerns.

5. Results

5.1. Data Overview

Before the COVID-19 outbreak in Macao, there were no dedicated government Facebook pages about public health. We targeted the official government Facebook pages (e.g., Macao SAR Government News) and manually selected posts about the disease. After the establishment of the COVID-19 Coordination Center and its dedicated page, information related to COVID-19 was posted on this specific page and therefore only the posts on this page were included in our research. We totally collected 1664 posts from Facebook, including text-based posts, images and recorded live videos in a 304-day duration from 1 January 2020 to 31 October 2020. After removing comments without text content (e.g., containing only emojis and images), 10,805 comments of these posts were also retrieved. In average, the government authored 5.47 COVID-related posts per day and users posted 6.49 comments per post. These posts were assigned into three different crisis stages using the criteria outlined in Table 2, and the cut-off dates of stages are listed in Table 4. Then, two researchers were trained to perform coding on the data. Their coding achieved 87% of agreement, and the inter-coder reliability Krippendorff’s Alpha α = 0.810 which was over the threshold value (α ≥ 0.800) required for the use in academic research [62,63].

Table 4.

Date and week ranges of the three crisis stages in Macao.

Crisis Stage Date Range Week Range (of Calendar Year 2020)
Prodromal 1 January 2020–21 January 2020 Week 1–4
Acute 22 January 2020–25 April 2020 Week 4–17
Chronic 26 April 2020–31 October 2020 Week 18–44

5.2. Overall Trends

Firstly, we analyzed the engagement in the prodromal, acute and chronic stages, respectively. Figure 2 displays the trends of the weekly average values of the metrics of Facebook engagement in a logarithmic scale, shown along with the key events of the outbreak in Macao. In the first few weeks of the prodromal crisis stage, the engagement could be observed to go downwards initially and gradually turned upwards when the time got closer to the discovery of the first COVID-19 case. Since the first confirmed case, positive emotions, comments and shares increased to a higher level in the acute crisis stage, accompanied by occasional surges of negative emotions. As the pandemic entered the chronic crisis stage, all metrics tended to decrease over time. Overall, the level of positive emotions was higher than the negative ones in the entire pandemic. For the numbers of comments and shares, they both demonstrated greater values in the acute stages. Generally speaking, the overall engagement showed a decreasing trend after the earlier weeks in the acute stage.

Figure 2.

Figure 2

Trend of engagement and COVID-19 key events in Macao.

Table 5 shows the descriptive statistics of the engagement of the public throughout the three stages in the outbreak. Although the chronic stage included the most posts, the engagement was most intense in the acute stage, demonstrated by the higher means of various metrics. In addition, some emotions have a high standard deviation or large maximum values (for instance, the positive emotion and the number of comments in the acute stage), which shows that there are outlier posts that attracted extreme levels of engagement than other posts.

Table 5.

Descriptive statistics of the engagement in three stages.

Prodromal (N = 18) Acute (N = 481) Chronic (N = 1165)
Metrics Mean SD Min Max Mean SD Min Max Mean SD Min Max
Positive Emotion 35.39 60.56 5 262 99.59 372.89 0 4504 20.29 42.48 0 471
Negative Emotion 1.72 4.40 0 16 9.64 66.54 0 1267 2.24 23.01 0 667
Comments 2.72 9.36 0 40 34.83 124.30 0 2000 3.80 20.18 0 459
Shares 22.17 50.21 0 208 15.91 47.01 0 577 3.82 14.28 0 246

Figure 3 presents the Pearson correlation matrix of engagement in the three crisis stages, and each stage demonstrates different patterns across the engagement metrics. In the prodromal stage, positive emotions were highly correlated to the numbers of comments and shares, and comments and shares were also strongly correlated to each other. In the acute stage, there were no obvious correlations among these types of engagement. However, in the chronic stage, negative emotions showed a moderate level of correlation to the number of comments.

Figure 3.

Figure 3

Correlation matrix of engagement in three stages.

5.3. Post Categories

We investigated how the engagement of categories of content differs in various stages of the pandemic. As abovementioned, our data underwent a qualitative coding process, and they were grouped into seven categories, as shown in Table 6. The first six categories matched to the concepts reported in other literature, while the last category (Press Conference Live) was derived from our data. An example post translated into English is given for each category in the table.

Table 6.

Categories of posts derived from the Macao SAR Government Facebook data.

Name Definition Count Example
Plans and Measures Government’s plans and measures to combat the pandemic 542 “Starting from 0:00 h on 19 March all foreign worker ID card holders will be prohibited from entering Macau, except for those with a resident status of Mainland China, Hong Kong and Taiwan… [Infographic]”
Public Health Messages Messages for educating the public, persuading them to change behavior and preventing COVID-19 infection 99 “The representative of the Health Bureau explained that aerosol transmission is not equivalent to air transmission; aerosols are small droplets formed when patients cough, sneeze or talk to people…”
Rumor Control Posts for rumor control or clarifying untrue information 22 “Regarding rumors on the internet that influenza vaccination can prevent COVID-19, the Health Bureau emphasized that the rumors are not true and appealed the public not to believe or spread false information…”
Latest News Latest update about the pandemic, including regular updates of numbers 709 “In the past 24 h, there have been no new confirmed cases of COVID-19 infection in Macao, and a total of 10 confirmed cases have been maintained. All of which are in a mild condition. As of 3 pm, there are a total of 316 suspected cases in Macao...”
Appreciation Appreciation message to front-line workers and public staff for controlling the pandemic 44 “In response to the anticipated increase in tourists, all relevant departments in Macao have made specific arrangements, strengthened epidemic preventive work and passenger management. Let’s have a look at what they do and thank them for their efforts.”
Community Resilience Actions (e.g., donations of resources) taken by communities (e.g., non-government organizations and individuals) to combat the pandemic 17 “ [The name of an enterprise] donated 4000 L of disinfectant alcohol to the SAR government…”
Press Conference Live Live video of the government’s press conferences about the pandemic and its latest development 231 “Press conference on the latest outbreak of COVID-19 and announcements of various prevention and control measures in Macao [Date] [Video]”

5.4. Trends of Post Categories

Figure 4 shows the trends of the engagement attracted by the above post categories, denoted by the average numbers of positive emotion, negative emotion, the numbers of comments and the numbers of shares in different stages of the pandemic.

Figure 4.

Figure 4

Comparison of the engagement of different post categories in three stages: (a) positive engagement; (b) negative engagement; (c) numbers of comments; (d) numbers of shares.

The data illustrate that two post categories, namely Plans and Measures and Public Health Messages, could maintain similar levels of positive emotions, negative emotions and comments throughout all three stages, while other categories showed downward trends after the acute stage.

Additionally, for Appreciation and Community Resilience posts, it is notable that they could attract a high degree of positive engagement and more shares in the acute stage, but they recorded a large decline in the subsequent chronic stage. Similarly, Press Conference Live videos collected a substantial number of comments and shares, as well as relatively strong positive engagement during the acute stage, however, these figures dived in the later stage too.

For the number of shares (Figure 4d), we can observe that they were generally high in the middle stage and relatively low in the chronic stage. This pattern was particularly obvious for Rumor Control and Appreciation categories.

5.5. Content Analysis of Three Crisis Stages

Figure 5 lists the average numbers of engagement obtained in different stages by each post category, ordered from the highest to the lowest for every type of social media engagement.

Figure 5.

Figure 5

Averages of engagement in three stages ordered by post categories: (a) positive engagement in the prodromal stage; (b) negative engagement in the prodromal stage; (c) numbers of comments in the prodromal stage; (d) numbers of shares in the prodromal stage; (e) positive engagement in the acute stage; (f) negative engagement in the acute stage; (g) numbers of comments in the acute stage; (h) numbers of shares in the acute stage; (i) positive engagement in the chronic stage; (j) negative engagement in the chronic stage; (k) numbers of comments in the chronic stage; (l) numbers of shares in the chronic stage.

5.5.1. Prodromal Stage

In the prodromal stage, there were only three post categories (i.e., Plans and Measures, Public Health Messages and Rumor Control) found in the data because the local outbreak had not occurred. All three categories could retrieve moderate levels of positive engagement (Figure 5a) and shares (Figure 5d) in this stage, and their negative emotions and comments were relatively low in volume (Figure 5b,c). Below are some examples of posts with high positive emotions. Since the authorities did not know much about the virus in the early stage, these were mainly preventative measures and generic messages of maintaining personal hygiene:

“In response to clusters of pneumonia cases of unknown cause in Wuhan, the Health Bureau started today to screen passengers on flights from Wuhan at the Macao Airport. No abnormalities were found for the time being… [Link]”

(Category: Plans and Measures; posted on 1 January 2020).

“To prevent the pneumonia of unknown cause in Wuhan, everyone should pay attention to personal hygiene. When coughing or sneezing, cover your mouth and nose with a tissue. If you don’t have a tissue, you can cover your mouth and nose with your elbow or upper sleeve… [Infographic]”

(Category: Public Health Messages; posted on 16 January 2020).

5.5.2. Acute Stage

In the acute stage, the engagement of users focused on the areas of Appreciation, Community Resilience and information updates such as Press Conference Live and Rumor Control. Particularly, Appreciation recorded the largest volume of positive emotions and the number of shares (Figure 5e,h); whereas Community Resilience also gained a high level of positive emotions (Figure 5e) and notably zero negative emotions (Figure 5f). Rumor Control attracted the second-high number of shares (Figure 5h). Additionally, Press Conference Live and Appreciation topped the numbers of comments in Figure 5g, suggesting that substantial discussions occurred under these types of posts in this stage. Below list some samples of the content that people engaged with most, which are generally about how everyone plays their parts to control the outbreak.

“Thanks to our medical staff—In the difficult time of epidemic prevention and control, not only in hospitals, but also in health centers, blood donation centers and other locations, medical staff are doing their best to continue providing services to Macao residents. We would like to say thank you! … [Photos]”

(Category: Appreciation; posted on 31 January 2020).

“In the afternoon on 4 February, [an entrepreneur] donated 100,000 surgical masks to the Macao SAR government to help prevent and control the epidemic and reduce the risk of virus transmission. [Photos]”

(Category: Community Resilience; posted on 5 February 2020).

“There is a rumor that the Health Bureau will distribute face masks to Macao residents free of charge. The Coordination Center clarified again today that masks need to be purchased at their own expense… Meanwhile, we urge not to spread false information.”

(Category: Rumor Control; posted on 23 January 2020).

However, in the acute stage, we observe that categories Latest News and Rumor Control showed a higher level of negative emotions (Figure 5f). The content of these posts was mainly related to the reporting of new COVID-19 cases. Here, lists one example: “There are three new imported cases of new coronavirus infection in Australia, increasing to 5 cases in total. The third newly imported case of novel coronavirus infection is a female…” (Category: Latest News; posted on 26 January 2020).

5.5.3. Chronic Stage

In the chronic stage, similar to the previous stage, Appreciation and Community Resilience remained the top two categories in terms of positive emotions (Figure 5i), and Press Conference Live and Appreciation posts were still commented by the most number of users (Figure 5k).

“The Public Security Police Force continues to assist customs clearance and help travelers to create their health QR codes at various ports... [Photos]”

(Category: Appreciation; posted on 11 July 2020).

“The Education and Youth Affairs Bureau collects epidemic prevention materials for schools donated by enterprises to schools — [a business] donated 10,000 masks, 54 disinfection supplies and 1200 chlorine disinfection tablets to Macao schools on August 10... [Photos]”

(Category: Community Resilience; posted on 13 August 2020).

Meanwhile, Public Health Messages obtained the highest number of shares (Figure 5l). As shown below, these posts regarded mental health support, information about getting back to the normal, and urging the public to remain vigilant for the virus.

“In response to the epidemic, the Department of Social Work of the Macao Polytechnic Institute used their professional strengths and launched the [course name] online lecture free of charge. They, hope to provide assistance to residents who need physical and mental support... [Link]”

(Category: Public Health Messages; posted on 4 May 2020).

“The Macao SAR Government appeals for washing hands, wearing masks, keep social distancing and not gathering... [Infographic]”

(Category: Public Health Messages; posted on 30 July 2020).

Finally, Plans and Measures and Press Conference Live attracted more negative emotions in the chronic stages (Figure 5j). These posts were mainly related to the violations of epidemic controlling laws and the minor issues in the government’s arrangements of COVID-19 measures.

“A person who was under quarantine in a designated hotel room left the room to another one on the same floor without authorization. The Macao Government Tourism Office has condemned the behavior and instructed hotels to strengthen the security. [Other measures…] Residents are reminded that they must abide by the relevant laws...”

(Category: Plans and Measures; posted on 29 July 2020).

“New Coronavirus Infection Response Coordination Center Press Conference (27/08) [about the arrangements of backing to school] [Video]”

(Category: Press Conference Live; posted on 27 August 2020).

5.6. Word Frequency Analysis of Comments

We applied a word frequency analysis in order to explore the popular concerns that emerged from the comments of government social media during COVID-19. Table 7 lists the most common 10 words that appeared in user comments of the posts in three stages and their numbers of occurrences. In the prodromal stage, most comments discussed the preventive measures enforced by the government and the public showed a positive attitude towards these measures. In the acute stage, three themes can be identified, including: (1) questions about the government’s operations and hoping the reporters at the pressers pursue answers; (2) cheering up others and appreciations to front-line workers; (3) border closure and quarantine. In the chronic stage, the topics of comments shifted to questions about daily lives, for example, education (denoted by words such as children and students), public transportation (e.g., the word bus) and face masks. In all stages, we observe that users mentioned other neighboring locations such as Hong Kong and Gongbei (which is a small region in Southern China adjacent to Macao) in many comments.

Table 7.

The most used 10 words in user comments (word frequencies shown in brackets).

Rank Prodromal Stage Acute Stage Chronic Stage
1 achieve (3) question (379) resident (109)
2 good (2) Hong Kong (340) Hong Kong (88)
3 prevent (2) border closure (338) children (79)
4 measure (2) Macanese (295) student (63)
5 border entry (2) border entry (279) quarantine (59)
6 well (2) quarantine (276) why (59)
7 quarantine (2) cheer up (265) question (55)
8 Gongbei (2) appreciate (257) teacher (45)
9 check (2) Portuguese reporter (252) face mask (43)
10 not bad (2) reporter (249) bus (40)

6. Discussion

This research empirically shows how the trend of engagement with government social media changes throughout pandemics, that is, it is lower in both the prodromal and chronic stages and higher in the acute stage. The public also demonstrates their interests in different topics in different stages, as well as their intentions for interacting with governments and voicing their concerns. This section elaborates on these aspects and discusses the potential applications of government social media in future outbreaks.

6.1. Principal Results

In response to RQ1, we identified that the engagement on the government social media was lower at the beginning, then peaked at the acute stage in which the disease was widely transmitted. This observation applies to most of the post categories, and can be explained with situational relevance, that is, people tend to obtain health information when they perceive strong relevance to the situation [64]. In the prodromal stage, the city had not struck by the virus which may cause the public to have a “wait and see” attitude, resulting in a drop in engagement on social media at the earlier time. After the acute stage, as the pandemic started to ease, we could see the trend of engagement decreased over time. This may reflect that the public is less sensitive to the regular updates, and they tend to focus on other areas as their lives get back to normal.

Answering RQ2, the shift of focuses of the engagement is evident from our context analysis. In the prodromal stage, the engagement largely concentrates on the government’s measures and the prevention of the disease, which is in line with other research, suggesting the seeming importance of preventive measures [65,66,67]. In addition, reflected in the correlations, positively perceived messages are likely to be shared by users in this stage, implying that the public is willing to further disseminate information provided that it is positive. With hindsight, the measures for fighting pandemics require everybody to be involved, therefore, the use of government social media needs to retain a positive tone, meanwhile it can be strengthened to increase the vigilance of the public and the awareness of preventive measures, such as hand washing, maintaining personal hygiene, social distancing, in the early phase of future outbreaks.

Then, in the acute stage, the public overwhelmingly reacts to posts about rumor control, community resilience and appreciation. As such, governments are recommended to use more such messages to bring communities together to combat diseases. On the other hand, while the posts providing news and updates (e.g., case reports) are often negatively engaged, their engagement remains at a high level. In addition, the word frequency analysis of comments shows that both prevention and controlling measures are the main concerns in this stage. Therefore, in line with the literature in crisis management [20,68], the use of government social media in the acute stage should focus on providing up-to-date information and increasing transparency, regardless of the positive or negative nature of the content. The higher degree of sharing in the acute stage also indicates the potential of social media for disseminating information in a large scale, making it an effective tool for governments and authorities to broadcast updates during public health crises.

When the pandemic enters the chronic stage, the focus moves towards mental health support and the issues about daily activities. As a micro-economy, Macao has suffered a strong economic impact in its gaming [23,69] and hospitality [29,70] industries, while the city has enforced stringent measures in the areas which are comprised of its main income, for instance, closing down casinos, the mandatory quarantine of travelers and the ban of tourists. Many places in the world actually face the same problem. Unlike the previous outbreak of SARS, this pandemic has lasted a much longer duration, therefore people have gradually become anxious under this situation. As the COVID-19 crisis eases, it is understandable that the public turns their focuses to the return of the normal. As a practical implication, it is useful for governments to adopt social media to provide mental health support and information about the recovery of business and economy, in order to reduce the uncertainly of the public and to plan out the directions for the policies after the chronic stage.

By analyzing the comments, we argue that users demonstrate a desire to interact with governments and provide feedback using the commenting feature of social media. For example, as shown in the results, the public considered some preventive measures good in the prodromal stage, and viewers asked questions during online press conferences in other stages. Comments can be seen as a type of engagement with a higher cognitive load on government social media [9]. In this case, as the public is still keen to make comments despite the cognitive load, it may represent their demand of greater participation in policymaking and policy execution. As another implication, government social media can act as a probe for governments to receive feedback and adjust their measures in the course of pandemics.

Although digital media including social media is ubiquitous in the pandemic, there is a lack of formalized guidance for their use. To address this gap and answer RQ3, we propose practical implications for using government social media in three specific areas: rumor control, regular updates and community cohesion.

6.2. Rumor Control

Highlighted by many scholars, the infodemic is a part of this COVID-19 pandemic as misinformation is wildly spread on the internet worldwide [2,3,71]. Being a part of this global phenomenon, Macao is not immune to the infodemic and therefore the government posted a wide range of posts in order to control rumors. Fortunately, these rumor controlling posts could keep the engagement with the public with a moderate level of sharing in all crisis stages, which further reflects the need for trustworthy updates. Supported by necessary legislation (e.g., Article 26 in the Macao Civil Protection Law), government social media can help the authorities to detect anomalies such as rumors and misinformation. After rumor detection, in order to clarify and correct those rumors, government social media will be one of the channels to amplify the correct messages among the public. Our findings reinforce the potential of using government social media to counteract falsehood information.

6.3. Regular Updates

Starting on the day of the first confirmed case, the Macao SAR government had been organizing daily press conferences and these were aired live on social media simultaneously every day. This is a necessary step for improving the transparency of governments and reducing the uncertainty of the public during this COVID-19 crisis [4]. Not many places in the world organized official daily press conferences in the pandemic. However, in some locations with a success for controlling the virus (for example, Taiwan and Melbourne), daily and persistent press conferences were considered as a welcomed measure [72,73]. In the case of Macao, it can be seen that these press conference live posts can maintain a constant level of engagement in the acute stage, which shows the usefulness of government social media in providing regular updates. In addition, as shown in our examples of posts, most of the regular updates authored by the Macao government include pictures, infographics or videos. These images and videos increase the interactivity of posts, which can help the audience to easier navigate and understand health information [74], and may attract more users to share them on social media platforms [47]. As such, authorities should also focus on producing and using appropriate multimedia along with text-based content.

6.4. Community Cohesion

Information about community resilience and appreciation can attract steady and overwhelming positive engagement with minimal negative responses. Research suggests that the quick involvement of the community can help with the control of COVID-19 and protect the interests of the public [75]. In fact, community organizations often work with the Macao SAR government in different areas, including the recovery of natural disasters and this pandemic [25,76]. Social media posts allow the public to understand the community efforts spent in the outbreak. Echoing the call from Yang and Su [77], we argue that government social media can be used for creating a positive sentiment against the pandemic and bringing communities together.

In addition, other research highlights that government social media often carries only one-way communication in disease outbreaks [17,20], that is, messages are conveyed from governments to the public. Our data show that the public responded by leaving comments, which can be used as indicators for measuring the acceptance of certain policies in the pandemic and for fine-tuning them to meet the needs of people. However, such citizen–government interactions still remain a one-way communication, and there is a potential to turn this into a bidirectional interaction for maximizing its impact. By responding to individual comments, governments can build an image of openness and take this opportunity to explain and clarify certain policies and measures.

6.5. Limitations

There are cultural and political differences in the use of social media. Users may not be aware of the emotions other than “likes” and may not have the same understanding of different emotions provided by Facebook, which may introduce discrepancies when interpreting users’ reactions. Our content and word frequency analysis provided multiple perspectives of the data which helps to alleviate these issues. Additionally, different governments adopt different approaches to control COVID-19. As such, other researchers from other places may have different observations about government social media, and we suggest conducting localized research and generating collective knowledge in this discipline. Besides, classification errors might happen in the content analysis process. However, we used inter-coder reliability checks to ensure the error rate was acceptable for academic research. Our future work includes a deeper examination of Facebook data using computational analytics to address some of these issues.

7. Conclusions

In this paper, we studied how government social media could engage with the public using the lens of the staged crisis management model and examined how government social media was used in the COVID-19 pandemic. Our work has found that the engagement of government social media is associated with crisis stages: it is lower at the prodromal stage, then surges in the acute stage, and gradually decreases in the chronic stage. In terms of the content, the public changes their focuses from the pandemic to the recovery (such as policies and support) after the acute stage. The engagement of other categories of content declines over time. In different stages, government social media should be aligned with the specific content of those stages. For the use of government social media, we propose that it is a useful tool for informing the public and interacting with communities. In addition, it can play a role in rumor control and fostering community cohesion. We hope that our findings can prepare authorities for using social media in fighting future outbreaks of infectious diseases.

Author Contributions

Conceptualization, P.C.-I.P. and K.S.C.; formal analysis, P.C.-I.P.; methodology, P.C.-I.P.; software, P.C.-I.P.; supervision, K.S.C.; validation, W.J.; visualization, P.C.-I.P.; writing—original draft, P.C.-I.P., Q.C. and W.J.; writing—review and editing, P.C.-I.P., Q.C., W.J. and K.S.C. All authors have read and agreed to the published version of the manuscript.

Funding

This research received no external funding.

Institutional Review Board Statement

Ethical review and approval were waived for this study, due to the use of the aggregation of publicly available data.

Informed Consent Statement

Not applicable.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to the restrictions of the social media platform.

Conflicts of Interest

The authors declare no conflict of interest.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.Spence P.R., Lachlan K.A., Edwards A., Edwards C. Tweeting Fast Matters, But Only If I Think About It: Information Updates on Social Media. Commun. Q. 2016;64:55–71. doi: 10.1080/01463373.2015.1100644. [DOI] [Google Scholar]
  • 2.Zarocostas J. How to Fight an Infodemic. Lancet. 2020;395:676. doi: 10.1016/S0140-6736(20)30461-X. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Depoux A., Martin S., Karafillakis E., Preet R., Wilder-Smith A., Larson H. The Pandemic of Social Media Panic Travels Faster than the COVID-19 Outbreak. J. Travel Med. 2020;27 doi: 10.1093/jtm/taaa031. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Mian A., Khan S. Coronavirus: The Spread of Misinformation. BMC Med. 2020;18:89. doi: 10.1186/s12916-020-01556-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Merchant R.M., Lurie N. Social Media and Emergency Preparedness in Response to Novel Coronavirus. JAMA. 2020;323:2011–2012. doi: 10.1001/jama.2020.4469. [DOI] [PubMed] [Google Scholar]
  • 6.Tang Z., Miller A.S., Zhou Z., Warkentin M. Does Government Social Media Promote Users’ Information Security Behavior towards COVID-19 Scams? Cultivation Effects and Protective Motivations. Gov. Inf. Q. 2021:101572. doi: 10.1016/j.giq.2021.101572. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Al-Dmour H., Masa’deh R., Salman A., Abuhashesh M., Al-Dmour R. Influence of Social Media Platforms on Public Health Protection Against the COVID-19 Pandemic via the Mediating Effects of Public Health Awareness and Behavioral Changes: Integrated Model. J. Med. Internet. Res. 2020;22:e19996. doi: 10.2196/19996. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Raamkumar A.S., Tan S.G., Wee H.L. Measuring the Outreach Efforts of Public Health Authorities and the Public Response on Facebook During the COVID-19 Pandemic in Early 2020: Cross-Country Comparison. J. Med. Internet. Res. 2020;22:e19334. doi: 10.2196/19334. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chen Q., Min C., Zhang W., Wang G., Ma X., Evans R. Unpacking the Black Box: How to Promote Citizen Engagement through Government Social Media during the COVID-19 Crisis. Comput. Hum. Behav. 2020;110:106380. doi: 10.1016/j.chb.2020.106380. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Cernicova-Buca M., Palea A. An Appraisal of Communication Practices Demonstrated by Romanian District Public Health Authorities at the Outbreak of the COVID-19 Pandemic. Sustainability. 2021;13:2500. doi: 10.3390/su13052500. [DOI] [Google Scholar]
  • 11.Hung M., Lauren E., Hon E.S., Birmingham W.C., Xu J., Su S., Hon S.D., Park J., Dang P., Lipsky M.S. Social Network Analysis of COVID-19 Sentiments: Application of Artificial Intelligence. J. Med. Internet. Res. 2020;22:e22590. doi: 10.2196/22590. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Chandrasekaran R., Mehta V., Valkunde T., Moustakas E. Topics, Trends, and Sentiments of Tweets About the COVID-19 Pandemic: Temporal Infoveillance Study. J. Med. Internet. Res. 2020;22:e22624. doi: 10.2196/22624. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Ahmed W., Vidal-Alaball J., Downing J., López Seguí F. COVID-19 and the 5G Conspiracy Theory: Social Network Analysis of Twitter Data. J. Med. Internet. Res. 2020;22:e19458. doi: 10.2196/19458. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Zhao X., Fan J., Basnyat I., Hu B. Online Health Information Seeking Using “#COVID-19 Patient Seeking Help” on Weibo in Wuhan, China: Descriptive Study. J. Med. Internet. Res. 2020;22:e22910. doi: 10.2196/22910. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Zhao Y., Cheng S., Yu X., Xu H. Chinese Public’s Attention to the COVID-19 Epidemic on Social Media: Observational Descriptive Study. J. Med. Internet. Res. 2020;22:e18825. doi: 10.2196/18825. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Ngai C.S.B., Singh R.G., Lu W., Koon A.C. Grappling With the COVID-19 Health Crisis: Content Analysis of Communication Strategies and Their Effects on Public Engagement on Social Media. J. Med. Internet. Res. 2020;22:e21360. doi: 10.2196/21360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Liao Q., Yuan J., Dong M., Yang L., Fielding R., Lam W.W.T. Public Engagement and Government Responsiveness in the Communications About COVID-19 During the Early Epidemic Stage in China: Infodemiology Study on Social Media Data. J. Med. Internet. Res. 2020;22:e18796. doi: 10.2196/18796. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Chu W.-M., Shieh G.-J., Wu S.-L., Sheu W.H.-H. Use of Facebook by Academic Medical Centers in Taiwan During the COVID-19 Pandemic: Observational Study. J. Med. Internet. Res. 2020;22:e21501. doi: 10.2196/21501. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Kim Y., Sohn D., Choi S.M. Cultural Difference in Motivations for Using Social Network Sites: A Comparative Study of American and Korean College Students. Comput. Hum. Behav. 2011;27:365–372. doi: 10.1016/j.chb.2010.08.015. [DOI] [Google Scholar]
  • 20.Sun L., Pang P.C.-I., Si Y.-W. Roles of Information Propagation of Chinese Microblogging Users in Epidemics: A Crisis Management Perspective. Internet. Res. 2020 doi: 10.1108/INTR-11-2019-0490. [DOI] [Google Scholar]
  • 21.Pan P.-L., Meng J. Media Frames across Stages of Health Crisis: A Crisis Management Approach to News Coverage of Flu Pandemic. J. Contingencies Crisis Manag. 2016;24:95–106. doi: 10.1111/1468-5973.12105. [DOI] [Google Scholar]
  • 22.Fink S. Crisis Management: Planning for the Inevitable. American Management Association; New York, NY, USA: 1986. [Google Scholar]
  • 23.Loi K.I., Lei W.S., Lourenço F. Understanding the Reactions of Government and Gaming Concessionaires on COVID-19 through the Neo-Institutional Theory – The Case of Macao. Int. J. Hosp. Manag. 2020:102755. doi: 10.1016/j.ijhm.2020.102755. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Ieng S.M., Cheong I.H. An Overview of Epidemiology of COVID-19 in Macau S.A.R. Front. Public Health. 2020;8:748. doi: 10.3389/fpubh.2020.550057. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Chan K.-S., Zheng Z., Gong R. A Study on Crisis Management of Typhoon Hato in Macau. Journal. Mass Commun. 2018;8:1–12. doi: 10.17265/2160-6579/2018.01.001. [DOI] [Google Scholar]
  • 26.World Health Organization Pneumonia of Unknown Cause—China. [(accessed on 3 January 2021)]; Available online: https://www.who.int/csr/don/05-january-2020-pneumonia-of-unkown-cause-china/en/
  • 27.Macao SAR Government Health Bureau Information about Confirmed Diagnosed Patients with Novel Coronavirus (2019-NCoV) in Macau SAR. [(accessed on 3 January 2021)]; Available online: https://www.ssm.gov.mo/apps1/PreventCOVID-19/en.aspx#clg17046.
  • 28.Lo I.L., Lio C.F., Cheong H.H., Lei C.I., Cheong T.H., Zhong X., Tian Y., Sin N.N. Evaluation of SARS-CoV-2 RNA Shedding in Clinical Specimens and Clinical Characteristics of 10 Patients with COVID-19 in Macau. Int. J. Biol. Sci. 2020;16:1698–1707. doi: 10.7150/ijbs.45357. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.McCartney G. The Impact of the Coronavirus Outbreak on Macao. From Tourism Lockdown to Tourism Recovery. Curr. Issues Tour. 2020:1–10. doi: 10.1080/13683500.2020.1762549. [DOI] [Google Scholar]
  • 30.Macao SAR Government Health Bureau Special Webpage against Epidemics. [(accessed on 3 January 2021)]; Available online: https://www.ssm.gov.mo/apps1/PreventCOVID-19/en.aspx#clg17458.
  • 31.Seeger M.W., Sellnow T.L., Ulmer R.R. Communication, Organization, and Crisis. Ann. Int. Commun. Assoc. 1998;21:231–276. doi: 10.1080/23808985.1998.11678952. [DOI] [Google Scholar]
  • 32.Bundy J., Pfarrer M.D., Short C.E., Coombs W.T. Crises and Crisis Management: Integration, Interpretation, and Research Development. J. Manag. 2016;43:1661–1692. doi: 10.1177/0149206316680030. [DOI] [Google Scholar]
  • 33.Crandall W., Parnell J.A., Spillan J.E. Crisis Management: Leading in the New Strategy Landscape. 2nd ed. SAGE; Los Angeles, CA, USA: 2013. [Google Scholar]
  • 34.Xue L., Zhong K. Classification of Types, Levels and Stages for Emergencies: Managerial Foundation of Government Emergency Response System. Chin. Public Adm. 2005;2:102–107. doi: 10.3782/j.issn.1006-0863.2005.02.026. [DOI] [Google Scholar]
  • 35.Sjödin H., Wilder-Smith A., Osman S., Farooq Z., Rocklöv J. Only Strict Quarantine Measures Can Curb the Coronavirus Disease (COVID-19) Outbreak in Italy, 2020. Eurosurveillance. 2020;25 doi: 10.2807/1560-7917.ES.2020.25.13.2000280. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.World Health Organization Criteria for Declaring the End of the Ebola Outbreak in Guinea, Liberia or Sierra Leone. [(accessed on 17 November 2020)]; Available online: https://www.who.int/csr/disease/ebola/declaration-ebola-end/en/
  • 37.Wirtz B.W., Daiser P., Mermann M. Social Media as a Leverage Strategy for Open Government: An Exploratory Study. Int. J. Public Adm. 2018;41:590–603. doi: 10.1080/01900692.2017.1289388. [DOI] [Google Scholar]
  • 38.Eom S.-J., Hwang H., Kim J.H. Can Social Media Increase Government Responsiveness? A Case Study of Seoul, Korea. Gov. Inf. Q. 2018;35:109–122. doi: 10.1016/j.giq.2017.10.002. [DOI] [Google Scholar]
  • 39.Falco E., Kleinhans R. Beyond Technology: Identifying Local Government Challenges for Using Digital Platforms for Citizen Engagement. Int. J. Inf. Manag. 2018;40:17–20. doi: 10.1016/j.ijinfomgt.2018.01.007. [DOI] [Google Scholar]
  • 40.Haro-de-Rosario A., Sáez-Martín A., del Carmen Caba-Pérez M. Using Social Media to Enhance Citizen Engagement with Local Government: Twitter or Facebook? New Media Soc. 2016;20:29–49. doi: 10.1177/1461444816645652. [DOI] [Google Scholar]
  • 41.Guo J., Liu N., Wu Y., Zhang C. Why Do Citizens Participate on Government Social Media Accounts during Crises? A Civic Voluntarism Perspective. Inf. Manag. 2021;58:103286. doi: 10.1016/j.im.2020.103286. [DOI] [Google Scholar]
  • 42.Wang X., Liu Z. Online Engagement in Social Media: A Cross-Cultural Comparison. Comput. Hum. Behav. 2019;97:137–150. doi: 10.1016/j.chb.2019.03.014. [DOI] [Google Scholar]
  • 43.Reyes-Menendez A., Saura J.R., Filipe F. The Importance of Behavioral Data to Identify Online Fake Reviews for Tourism Businesses: A Systematic Review. PeerJ Comput. Sci. 2019;5:e219. doi: 10.7717/peerj-cs.219. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Reyes-Menendez A., Correia M.B., Matos N., Adap C. Understanding Online Consumer Behavior and EWOM Strategies for Sustainable Business Management in the Tourism Industry. Sustainability. 2020;12:8972. doi: 10.3390/su12218972. [DOI] [Google Scholar]
  • 45.Pang P.C.-I., Liu L. Why Do Consumers Review Doctors Online? Topic Modeling Analysis of Positive and Negative Reviews on an Online Health Community in China; Proceedings of the 53rd Hawaii International Conference on System Sciences; Maui, HI, USA. 7 January 2020; pp. 705–714. [Google Scholar]
  • 46.Limaye R.J., Sauer M., Ali J., Bernstein J., Wahl B., Barnhill A., Labrique A. Building Trust While Influencing Online COVID-19 Content in the Social Media World. Lancet Digit. Health. 2020;2:e277–e278. doi: 10.1016/S2589-7500(20)30084-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Pang P.C.-I., Chang S., Verspoor K., Clavisi O. The Use of Web-Based Technologies in Health Research Participation: Qualitative Study of Consumer and Researcher Experiences. J. Med. Internet Res. 2018;20:e12094. doi: 10.2196/12094. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 48.Xie Y., Qiao R., Shao G., Chen H. Research on Chinese Social Media Users’ Communication Behaviors during Public Emergency Events. Telemat. Inform. 2017;34:740–754. doi: 10.1016/j.tele.2016.05.023. [DOI] [Google Scholar]
  • 49.Han X., Wang J., Zhang M., Wang X. Using Social Media to Mine and Analyze Public Opinion Related to COVID-19 in China. Int. J. Environ. Res. Public Health. 2020;17:2788. doi: 10.3390/ijerph17082788. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Li L., Zhang Q., Wang X., Zhang J., Wang T., Gao T.-L., Duan W., Tsoi K.K., Wang F.-Y. Characterizing the Propagation of Situational Information in Social Media During COVID-19 Epidemic: A Case Study on Weibo. IEEE Trans. Comput. Soc. Syst. 2020;7:556–562. doi: 10.1109/TCSS.2020.2980007. [DOI] [Google Scholar]
  • 51.Islam M.S., Sarkar T., Khan S.H., Mostofa Kamal A.-H., Hasan S.M.M., Kabir A., Yeasmin D., Islam M.A., Amin Chowdhury K.I., Anwar K.S., et al. COVID-19–Related Infodemic and Its Impact on Public Health: A Global Social Media Analysis. Am. J. Trop. Med. Hyg. 2020;103:1621–1629. doi: 10.4269/ajtmh.20-0812. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Macao Association for Internet Research . Internet Usage Trends in Macao 2020. MAIR; Macao, China: 2020. [Google Scholar]
  • 53.Government Information Bureau Government Information Bureau to Launch a Facebook Page. [(accessed on 20 November 2020)]; Available online: https://www.gov.mo/en/news/66291/
  • 54.Erlingsson C., Brysiewicz P. A Hands-on Guide to Doing Content Analysis. Afr. J. Emerg. Med. 2017;7:93–99. doi: 10.1016/j.afjem.2017.08.001. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Ahmed W., Vidal-Alaball J., Lopez Segui F., Moreno-Sánchez P.A. A Social Network Analysis of Tweets Related to Masks during the COVID-19 Pandemic. Int. J. Environ. Res. Public Health. 2020;17:8235. doi: 10.3390/ijerph17218235. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Creswell J.W. Research Design: Qualitative, Quantitative, and Mixed Method Approaches. 4th ed. SAGE Publications, Inc.; Thousand Oaks, CA, USA: 2014. International Student Edition. [Google Scholar]
  • 57.Strauss A., Corbin J. Basics of Qualitative Research Techniques. SAGE Publications; Thousand Oaks, CA, USA: 1998. [Google Scholar]
  • 58.Roberts K., Dowell A., Nie J.-B. Attempting Rigour and Replicability in Thematic Analysis of Qualitative Research Data; a Case Study of Codebook Development. BMC Med. Res. Methodol. 2019;19:66. doi: 10.1186/s12874-019-0707-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Luo R., Xu J., Zhang Y., Ren X., Sun X. PKUSEG: A Toolkit for Multi-Domain Chinese Word Segmentation. arXiv. 20191906.11455 [Google Scholar]
  • 60.Bird S., Klein E., Loper E. Natural Language Processing with Python. O’Reilly Media Inc.; Newton, MA, USA: 2009. [Google Scholar]
  • 61.Pang P.C.-I., McKay D., Chang S., Chen Q., Zhang X., Cui L. Privacy Concerns of the Australian My Health Record: Implications for Other Large-Scale Opt-out Personal Health Records. Inf. Process. Manag. 2020;57:102364. doi: 10.1016/j.ipm.2020.102364. [DOI] [Google Scholar]
  • 62.Krippendorff K. Content Analysis: An Introduction to Its Methodology. SAGE Publications, Inc.; Thousand Oaks, CA, USA: 2004. [Google Scholar]
  • 63.Salkind N. Encyclopedia of Research Design. SAGE Publications, Inc.; Thousand Oaks, CA, USA: 2010. [Google Scholar]
  • 64.Pang P.C.-I., Chang S., Pearce J., Verspoor K. Online Health Information Seeking Behaviour: Understanding Different Search Approaches; Proceedings of the Pacific Asia Conference on Information Systems 2014 (PACIS 2014); Chengdu, China. 24 June 2014. [Google Scholar]
  • 65.Leung N.H.L., Chu D.K.W., Shiu E.Y.C., Chan K.-H., McDevitt J.J., Hau B.J.P., Yen H.-L., Li Y., Ip D.K.M., Peiris J.S.M., et al. Respiratory Virus Shedding in Exhaled Breath and Efficacy of Face Masks. Nat. Med. 2020;26:676–680. doi: 10.1038/s41591-020-0843-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Galvin C.J., Li Y.-C., Malwade S., Syed-Abdul S. COVID-19 Preventive Measures Showing an Unintended Decline in Infectious Diseases in Taiwan. Int. J. Infect. Dis. 2020;98:18–20. doi: 10.1016/j.ijid.2020.06.062. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 67.Nguyen N.P.T., Hoang T.D., Tran V.T., Vu C.T., Siewe Fodjo J.N., Colebunders R., Dunne M.P., Vo T.V. Preventive Behavior of Vietnamese People in Response to the COVID-19 Pandemic. PLoS ONE. 2020;15:e0238830. doi: 10.1371/journal.pone.0238830. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Panagiotopoulos P., Barnett J., Bigdeli A.Z., Sams S. Social Media in Emergency Management: Twitter as a Tool for Communicating Risks to the Public. Technol. Forecast. Soc. Chang. 2016;111:86–96. doi: 10.1016/j.techfore.2016.06.010. [DOI] [Google Scholar]
  • 69.Ho H.-W. COVID-19 Pandemic: Impact and Implications for Macau Casinos. Gaming Law Rev. 2020;24:563–567. doi: 10.1089/glr2.2020.0023. [DOI] [Google Scholar]
  • 70.Lai I.K.W., Wong J.W.C. Comparing Crisis Management Practices in the Hotel Industry between Initial and Pandemic Stages of COVID-19. Int. J. Contemp. Hosp. Manag. 2020;32:3135–3156. doi: 10.1108/IJCHM-04-2020-0325. [DOI] [Google Scholar]
  • 71.Fernández-Torres M.J., Almansa-Martínez A., Chamizo-Sánchez R. Infodemic and Fake News in Spain during the COVID-19 Pandemic. Int. J. Environ. Res. Public Health. 2021;18:1781. doi: 10.3390/ijerph18041781. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.ABC News Daniel Andrews Is Finally Taking a Day off. Is This a Sign Things Are Looking up for Victoria? [(accessed on 12 June 2020)]; Available online: https://www.abc.net.au/news/2020-10-30/daniel-andrews-takes-day-off-after-120-covid-media-briefings/12831460.
  • 73.Lai C.-C., Wang C.-Y., Wang Y.-H., Hsueh S.-C., Ko W.-C., Hsueh P.-R. Global Epidemiology of Coronavirus Disease 2019 (COVID-19): Disease Incidence, Daily Cumulative Index, Mortality, and Their Association with Country Healthcare Resources and Economic Status. Int. J. Antimicrob. Agents. 2020;55:105946. doi: 10.1016/j.ijantimicag.2020.105946. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Pang P.C.-I., Chang S., Verspoor K., Pearce J. Designing Health Websites Based on Users’ Online Information Seeking Behaviours: A Mixed-Method Observational Study. J. Med. Internet Res. 2016;18:e145. doi: 10.2196/jmir.5661. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.La V.-P., Pham T.-H., Ho M.-T., Nguyen M.-H., P Nguyen K.-L., Vuong T.-T., Nguyen H.-K.T., Tran T., Khuc Q., Ho M.-T., et al. Policy Response, Social Media and Science Journalism for the Sustainability of the Public Health System Amid the COVID-19 Outbreak: The Vietnam Lessons. Sustainability. 2020;12:2931. doi: 10.3390/su12072931. [DOI] [Google Scholar]
  • 76.Lou S. Analysis of Macao Community Legal System: Centers on Relationship of Government and Community. J. China Natl. Sch. Adm. 2006;6:83–86. doi: 10.3969/j.issn.1008-9314.2006.06.022. [DOI] [Google Scholar]
  • 77.Yang Y., Su Y. Public Voice via Social Media: Role in Cooperative Governance during Public Health Emergency. Int. J. Environ. Res. Public Health. 2020;17:6840. doi: 10.3390/ijerph17186840. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The data presented in this study are available on request from the corresponding author. The data are not publicly available due to the restrictions of the social media platform.


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES