Abstract
Low digital health literacy affects large percentages of populations around the world and is a direct contributor to the spread of COVID-19-related online misinformation (together with bots). The ease and ‘viral’ nature of social media sharing further complicate the situation. This paper provides a quick overview of the magnitude of the problem of COVID-19 misinformation on social media, its devastating effects, and its intricate relation to digital health literacy. The main strategies, methods and services that can be used to detect and prevent the spread of COVID-19 misinformation, including machine learning-based approaches, health literacy guidelines, checklists, mythbusters and fact-checkers, are then briefly reviewed. Given the complexity of the COVID-19 infodemic, it is very unlikely that any of these approaches or tools will be fully effective alone in stopping the spread of COVID-19 misinformation. Instead, a mixed, synergistic approach, combining the best of these strategies, methods, and services together, is highly recommended in tackling online health misinformation, and mitigating its negative effects in COVID-19 and future pandemics. Furthermore, techniques and tools should ideally focus on evaluating both the message (information content) and the messenger (information author/source) and not just rely on assessing the latter as a quick and easy proxy for the trustworthiness and truthfulness of the former. Surveying and improving population digital health literacy levels are also essential for future infodemic preparedness.
Keywords: COVID-19, infodemic, misinformation, disinformation, social media, health literacy, digital health literacy
1. Introduction
The COVID-19 pandemic has been accompanied by an explosion of inaccurate information about the disease, making it difficult for the general public to make informed decisions. The exact scale of spread of the excessive amount of online COVID-19 misinformation is still unknown but is nevertheless a cause of high concern. Misinformation can be broadly defined as “cases in which people’s beliefs about factual matters are not supported by clear evidence and expert opinion” [1]. It is false information being spread regardless of intent to mislead, while disinformation is false information being spread with bad intent, to deliberately deceive. The Director-General of the World Health Organization (WHO) termed the COVID-19 misinformation situation as an ‘infodemic’ (i.e., misinformation epidemic or misinformation pandemic) swarming with conspiracy theories, propaganda, and unproven scientific claims regarding the diagnosis, treatment, and prevention of the disease [2,3]. This infodemic has made reliable information harder to find and discern, and allowed rumours to spread more quickly, putting public health at risk by making it difficult to implement effective preventive measures [3].
2. COVID-19-Related Misinformation on Social Media
Social media outlets, such as Facebook, Twitter, YouTube, etc., emerged as major information seeking and sharing channels during the pandemic. As a result, the use of social media platforms increased by 20–87% around the world [4]. During health crises, access to reliable information sources and services becomes critical to enable the general public to take part in healthcare and preventive decisions. However, the abundance of health information on social media without any comprehensive checks makes it difficult for the general public to identify accurate information, thus impeding effective public health response [5].
Fondazione Bruno Kessler analysed 112 million posts shared on social media related to COVID-19, and concluded that more than 40% of posts contained information from unreliable sources, while 42% of posts were circulated on social media platforms through bots [4]. Lee et al. reported that 67.78% of adults have been exposed to COVID-19-related misinformation through social networking services or instant messaging [6]. In another study, an analysis of 1225 fake news stories about COVID-19 from January to April 2020 showed that social media accounted for spreading half or 50.5% of the stories [5]. Content spreading misinformation about vaccines gained 4.5 billion views on social media in just one month (March to April 2020) [7]. Several studies indicated that the infodemic of misleading information during COVID-19 is a threat to the COVID-19 vaccination campaign [8].
A comprehensive systematic review of studies published before March 2019 on the prevalence of health misinformation on social media reported widespread misinformation in six areas, namely (i) vaccines, (ii) drugs or smoking, (iii) non-communicable diseases, (iv) pandemics, (v) eating disorders, and (vi) medical treatments. Twitter was the leading source spreading health-related misinformation [9]. Naeem and colleagues classified the most commonly identified fake news about COVID-19 into three main types: (i) false claims, such as “coronavirus can be transmitted through houseflies or mosquito bites”, (ii) conspiracy theories, such as the ones about 5G (fifth generation technology standard for broadband cellular phone networks) and coronavirus, and (iv) pseudoscientific health therapies, such as “colloidal silver solution can help with coronavirus” [5]. A content analysis of a sample of 233 tweets identified 81 tweets (34.8%) falsely claiming that COVID-19 and 5G were linked, 75 tweets (32.2%) criticising the conspiracy theory, and 77 general tweets (33%) not giving any personal remarks or opinions. Surprisingly, 152 (65.2%) of tweets were from people who were non-conspiracy-theory supporters [10].
Digital communications, particularly on social media platforms, catalyse the rapid spread of misinformation, threatening public health [3,10]. Bridgman et al. examined 0.6 million tweets on COVID-19 and found that the use of social media was positively associated with misperceptions regarding basic COVID-19 facts. The opposite was true for news media. The study also revealed that comparatively more misleading content related to COVID-19 circulated on Twitter as compared to traditional news media [11]. In the same vein, Su concluded that social media use is significantly associated with misinformation beliefs related to COVID-19 [12].
Evidence from several studies showed that misleading information and conspiracy theories spread more rapidly when the flow of factual information is slow, and when people’s trust in the information sources and services available to them is also low, or when credible information is hard to come by [13,14,15]. Tworek argues that “communications in a public health crisis are as crucial as medical intervention. In fact, communications policies ARE a medical intervention” [16]. Effective health communication plays a critical role in speeding up the flow of factual information and building trust among people regarding health information sources and services.
The United Nations Development Programme has directed governments across the world to “step up to lead the fight against a growing tide of false, inflammatory and misleading information that threatens to worsen the already severe impacts of the virus” [17]. There is a broad commitment among researchers, healthcare professionals, information professionals, IT experts, policymakers, and social media experts to prevent the spread of misinformation.
3. Health Literacy and Healthcare Outcomes
Health literacy has received significant attention since the year 2000, when the WHO stated that a low level of public health literacy is a serious concern for public health, and stressed the need to improve public health literacy to minimise inequities in health services [18]. Health literacy covers “the ability to access, comprehend, evaluate and communicate information to promote, maintain and improve health in a variety of settings across the life course” [19]. Health literacy has been defined by WHO as the individual features and societal resources required for the public and individuals to obtain, recognise, and evaluate information and services in order to make appropriate decisions about health. Health literacy allows and encourages the public to contribute to, and improve, their healthcare and well-being. People possessing good health literacy usually have more skills to manage their health in a better way compared to those with low health literacy skills. The WHO considers the level of people’s health literacy an indicator that can be used in assessing the health status of the population [20].
Health literacy has three main pillars, namely (i) the capacity to obtain health information (where to find help), (ii) the ability to (properly) understand the information gathered, and (iii) the ability to (properly) apply health information [21]. The Australian Commission on Safety and Quality in Health Care (ACSQHC) describes two main components of health literacy: (i) individual health literacy, comprising the individual skills and ability to find, understand and use health-related information; for example, to be able to navigate and use health/care systems, and (ii) the health literacy environment, covering components related to a health system, such as policies, materials and procedures that affect the way people engage with the system [22].
Significant amounts of health-related information and myths about COVID-19 are not sufficiently simple or clear to easily comprehend or debunk by the average layperson. The pandemic and associated infodemic have brought unprecedented challenges to public health, affecting the public throughout the world in terms of socio-psychological and economic hardships, and stressing international relations (e.g., by originally naming COVID-19 variants after the places or countries where they were first reported; the WHO now recommends using Greek letters to neutrally refer to these variants). Digital technologies have amplified misinformation, but could also hold the solution.
The World Health Organization is a strong promoter of digital health literacy. With ‘digital’ added to the formula, we can anticipate wider accessibility of reliable health information, improved healthcare quality and reduced healthcare costs [23]. Digital health literacy is the ability to seek, find, understand, and appraise health information using information and communication technologies (ICTs) to address or solve a healthcare problem [20,24,25].
Prevalence of Low Health Literacy
Low health literacy is very common among people across the world. According to a large-scale national survey, more than 1 in every 3 adults in America have low health literacy [26]. Only 8.8% of people were health literate in China in 2012, leading the National Health Commission of China to issue a new strategic plan in the year 2014 to increase the health literacy of the population to 20% by 2020 [27]. In the UK, 4 in 10 adults struggle to understand health information that is meant for the public, and more than 6 in 10 adults struggle with health-related information that includes numbers and statistics [28,29].
The evidence also shows that people with a low level of health literacy skills are more likely than those people with a greater level of health literacy skills to report poor health [30]. COVID-19 impacted people with inadequate health literacy more badly and more frequently as compared to people with proficient health literacy levels, due to the inability of the former to properly understand and follow health-related recommendations. They find it difficult to locate healthcare providers and healthcare services, share their medical condition and history with healthcare providers, seek preventive healthcare, understand directions on medicines (prescriptions), and recognise the connection between risky behaviours and health [31].
A large-scale systematic review covering 111 published studies that measured health literacy and its association with health outcomes concluded that low health literacy is a contributor to compromised health outcomes and inadequate use of healthcare services, resulting in greater use of emergency services, increased hospitalisations, lower vaccination rates, improper medication-taking, inadequate ability to interpret prescriptions and health messages, and higher mortality rates among elderly persons. People with poor health literacy skills are at higher risk of poor health outcomes and unhealthy behaviours [24].
The literature is abundant with studies covering these negative consequences; for example, research linking low health literacy to a lower engagement with health services [32] and healthcare providers [33], to inadequate use of preventive health services [34], to poor health status and increased hospital re-admission rates [35], to a lack of understanding of medication instructions [36], to a lower quality of life in specific medical conditions [37], and to poor ability to self-manage health [38]. Low health literacy is also strongly correlated with health inequalities [39].
Health literacy is context-dependent. This means people with generally acceptable health literacy skills can still face health literacy challenges in some contexts, such as when they are not familiar with some complex medical jargon, or in certain health conditions requiring complicated self-care. Abdulai et al. assessed digital literacy levels among lay consumers of online COVID-19 information in Ghana, a low-income country, using a survey based on the eHealth Literacy Scale (eHEALS). Not only did the majority of respondents in their study exhibit poor ability to find COVID-19 information online, but they also demonstrated relatively low skills in differentiating scientific from unscientific information on the Internet. Gender, age, frequency of searching the Internet for COVID-19 information and for educational purposes, and having adequate or poor knowledge of COVID-19 were predictive of digital literacy levels [40]. Socioeconomic status, inadequate education, limited English proficiency, older age, and being from a diverse background are among the main factors linked to low health literacy [41,42,43,44]. In another survey of South Korean adults in 2020, Lee et al. found that COVID-19 misinformation exposure was associated with misinformation belief, and that misinformation belief was linked to fewer preventive behaviours [6].
We live in a highly digitised world where every piece of information available online is potentially subject to authenticity and validity checks. Thus, we must recognise and promote e-health and media literacies as fundamental skills, just as writing and reading are. Digital health and media literacies should also be promoted as lifelong-needed competencies that, once acquired, could be useful in any health-related context. Only then will we be able to empower people to better identify and protect themselves from misinformation and to make correctly informed decisions about their health [45]. Many studies recommend developing good digital health literacy skills among the public as a way forward to critically (self-)appraise information and prevent the spread of misinformation during pandemic times [40,46]. Health literacy and numeracy skills are two fundamental skill sets that should be promoted among the public in order to ensure better healthcare outcomes [30].
4. Strategies and Methods to Detect and Prevent the Spread of Misinformation
To prevent the spread of COVID-19 misinformation, a number of guidelines, checklists, resources, fact-checking tools, mythbusters, digital health literacy training instructions, and long-term strategies have been proposed, developed and/or implemented. These misinformation mitigation attempts have mainly been made by computer scientists, data science experts, information professionals, researchers, government agencies, and professional associations. Computer scientists developed fact-checking tools, applications and resources using artificial intelligence-based approaches, including machine learning, while information professionals, social and behavioural science researchers, and professional associations created guidelines and checklists to help the general public recognise fake news.
Given the complexity of the infodemic, no approach has yet managed to fully automate the challenge of fake news detection. According to the Fake News Challenge Stance-Detection Task’s creators, ‘truth labelling’ is very difficult in practice. They proposed developing a dedicated tool for that purpose, preferring a reliable semi-automated approach over a fully-automated system in order to achieve a greater percentage of accuracy in detecting fake news [47]. Although, fully automated systems have received some success in recognising information validity, their accuracy has not (yet) reached an acceptable level. In one study published in late 2019, the best performing system achieved a FEVER (Fact Extraction and VERification) score of 64.21% [48]. The rapidly changing COVID-19 information landscape and the associated relatively “novel” pandemic language make currently used (pre-pandemic) misinformation recognition datasets and models ineffective for debunking COVID-19 misinformation [49].
Daniel J. Levitin, a neuroscientist, said that “what looks like (and reads like) the truth may be riddled with lies if you look more closely”. He identified “four tricky ways that fake news can fool you”. These include (i) “lies are tucked in among truths”, (ii) “websites masquerade under misleading names”, (iii) “numbers are given without context”, and (iv) “claims rest on false sources”. He recommended that the task of figuring out the truth and discarding fake news falls on us all, and requires critical thinking and time. It also requires us to keep updating our knowledge as information continues to evolve very rapidly [50].
4.1. Machine Learning-Based Approaches
Several tools, approaches, and models have been reported in the literature that can flag COVID-19 related misinformation as false information. For example, Hossain et al. [49] introduced COVIDLies, a tweet debunking dataset annotated by experts, containing COVID-19 misinformation accompanied by tweets that ‘agree’, ‘disagree’, or express ‘no stance’ for each piece of misinformation. Abdelminaam and colleagues proposed CoAID-DEEP (COVID-19 heAlthcare mIsinformation Dataset), a machine learning and deep learning system to automate the identification of COVID-19-related fake news [51]. Kolluri and Murthy introduced CoVerifi, a Web application that attempts to appraise the credibility of news based on human feedback and the power of a machine learning-based approach. It provides a multi-channel check for news, using user feedback to detect fake news that have failed to be recognised by Web-based fact-checking tools and vice versa [52]. Khanday et al. argue that machine learning and deep learning can replace humans in providing accurate results regarding fake news detection [53], but it is obvious that such a bold claim cannot be universally applied in every situation.
4.2. Health Literacy Guidelines, Checklists, Mythbusters and Fact-Checkers
The International Federation of Library Associations’ (IFLA) guidelines are among the most widely accepted and used fake news detection checklists available today. It comprises eight steps: (i) “consider the source”, (ii) “check the author”, (iii) “check the date”, (iv) “check your biases”, (v) “read beyond”, (vi) “seek supporting sources”, (vii) ask “is it a joke?”, and (viii) “ask the experts” [54].
CRAAP (Currency, Relevance, Authority, Accuracy, and Purpose) is another useful checklist for evaluating online information resources, created by the Meriam Library, California State University. It focuses on whether an information resource is ‘current’ and up-to-date, ‘relevant’, ‘accurate’, and ‘telling the truth’, and directs information evaluators to seek answers to questions such as who is the ‘author’ (who wrote or compiled the resource under investigation), and what is the resource’s ‘purpose’ or why was it created [55].
The World Economic Forum’s three-step guidance on “how to read the news like a scientist and avoid the COVID-19 infodemic” is quite handy for debunking misinformation. The three steps are: (i) “embracing uncertainty responsibly”, (ii) “asking where is the information coming from?” and (iii) “determining who is backing up the claim” [56].
Llewellyn proposed a contact-tracing-like technique to identify COVID-19 misinformation. As with coronavirus itself, we should think about “contact tracing” the message and its sender(s): “who sent or shared the information”, “what is the original source”, and “how do I know it to be true?” [57]. Mantas compiled a six-step kit after evaluating various fact-checking organisations. These steps include: (1) “stop, breathe—before sharing” (2) “check the source”, (3) “trust scientists before politicians”, (4) “beware your emotions”, (5) “use (adequate) tools to help verify images and videos”, and (6) “know what you don’t know” [58].
Mheidly and Fares proposed an “infodemic response checklist” to help overcome the challenges posed by the infodemic. Their checklist recommends a number of mitigatory actions, including (i) offering more exposure or ‘airtime’ for medical professionals and scientists, (ii) verifying the social media accounts of scientists, medical professionals and public health officials, (iii) sharing scientific evidence, (iv) promoting the Web sites of public health organisations via search engines, (v) monitoring engagement on social media platforms, (vi) developing infographics and educational material, (vii) addressing minorities, racial, and ethnic differences, (viii) adopting empathy in social media communication, (ix) promoting dialogue and sharing of personal experiences, (x) improving coping skills against mental health stressors, and (xi) boosting investment in health communication research [59].
The United Nations Educational, Scientific and Cultural Organization--UNESCO ‘MIL CLICKS’ social media initiative for promoting media and information literacy is helping people acquire key skills related to media and information literacy in their normal day-to-day use of the Internet and social media. ‘MIL CLICKS’ is an acronym that stands for ‘Media and Information Literacy: Critical-thinking, Creativity, Literacy, Intercultural, Citizenship, Knowledge and Sustainability’ [60].
Conard developed a health literacy instructional model combining five domains of literacy (knowledge, numeracy, navigation, communication, and decision making) with three components (emotional, behavioural, and educational) to help build health literacy skills. The model presents a framework for addressing the emotional state of the individual in the first stage, with a second stage offering strategies that aim at strengthening the engagement and commitment of the person using a behavioural approach, and a final phase delivering an educational solution [61].
The iHeal.eu project (November 2018–April 2021), co-funded by the European Commission, is another successful programme for up-skilling older EU citizens (aged 50+) in digital health literacy to prevent marginalisation and exclusion. Project outputs included (i) a transnational digital health literacy ecosystem map and methodological framework, (ii) a curriculum, with storyboards and content, (iii) an interactive Web platform, learning environment, applications, and digital learning tools, and (iv) a training adaptation toolkit [62].
Besides the roles played by the aforementioned checklists and guidelines in tackling the COVID-19 infodemic, mythbusters have contributed significantly to flagging COVID-19 related misinformation and promoting factual information. iHealthFacts.ie is a Web-based resource where the public can easily and quickly check the authenticity of common health claims circulated on social media [63]. It is a useful resource, helping people to think critically about health claims and make informed decisions about their health [64]. Other examples of mythbusters are provided in Table 1.
Table 1.
Service Name | Hosting Organisation and Web Address |
---|---|
The WHO Mythbuster | World Health Organization [65] |
Australia COVID-19 Mythbuster | Australian Government [66] |
Canada Corona Virus Misinformation Watch | Ryerson Social Media Lab at Ted Rogers School of Management, Ryerson University, Canada [67] |
TAG Mythbusters | Treatment Action Group, a US charity in New York, NY [68] |
Pakistan National Command and Control Centre Mythbuster | Government of Pakistan [69] |
Several Web-based fact-checking tools are also available that allow people to check the authenticity of a specific claim. The majority of reputable fact-checking sites subscribe to codes of practice and standards that explicitly call for neutrality and transparency, such as the International Fact-Checking Network’s (IFCN) code of principles [70]. Together with the very closely related online mythbusters, these fact-checkers are helping combat the spread of COVID-19-related misinformation. Examples of these fact-checking tools are provided in Table 2.
Table 2.
Service Name | Hosting Organisation and Web Address |
---|---|
ClaimBuster Fact Checker | The University of Texas at Arlington, USA [71] |
Google Fact Check Tools/Explorer | Google [72] |
FactCheck.org | The Annenberg Public Policy Center of the University of Pennsylvania, USA [73] |
AFP Fact Check | Agence France-Presse, an international news agency headquartered in Paris, France [74] |
BBC News Reality Check | The British Broadcasting Corporation, the national broadcaster of the United Kingdom [75] |
5. Discussion and Recommendations
Low digital health literacy affects large percentages of populations around the world. It is a direct contributor to the spread of COVID-19 misinformation (e.g., via sharing on social media) as result of the affected populations’ inability to recognise falsehoods and their high vulnerability to deception by fake news (bots also contribute to the spread of online misinformation). The ‘viral’ nature of social media sharing further complicates the situation [76].
Given the complexity of the COVID-19 infodemic and the high prevalence of low digital health literacy among populations, it is very unlikely that any of the above-mentioned strategies, methods, and services (e.g., machine learning-based approaches, health literacy guidelines, and fact-checkers) will be fully effective alone in stopping the spread of COVID-19 misinformation. Banerjee and Meena offer a useful summary of the different ways in which digital technology and (social) media platforms can be used during health emergencies, such as the COVID-19 pandemic, to aid the general public [77].
Interestingly, Zhao et al. found a correlation between people’s preferences for particular media outlets when seeking health-related information and their behaviours during the pandemic in the USA. For example, people who considered Fox News a more trustworthy information source compared to CNN (Cable News Network) demonstrated a higher number of risky behaviours and less preventive behaviours in relation to COVID-19 (e.g., not wearing face masks). People’s behavioural responses to the pandemic were clearly divided along media bias lines. News outlets should therefore be made accountable, and their unhelpful partisan stance should be minimised during health emergencies [78].
Medical/health journalists reporting medical research in mainstream news media often unwittingly contribute to online health misinformation through bad reporting practices and distorted translation of research findings in their news reports, e.g., misinterpreting or exaggerating findings and other forms of inaccurate and/or incomplete reporting, resulting in public confusion. However, well trained, ethical medical/health journalists can play an important role in combatting misinformation.
In fact, in his July 2021 ‘Advisory on Building a Healthy Information Environment—Confronting Health Misinformation’, the US Surgeon General calls for media, science, digital, data and health literacy programmes and training to be provided for journalists, as well as health practitioners, librarians and others, as part of longer-term efforts to build resilience against health misinformation. He also urges the implementation of product design and policy changes on technology platforms to slow the spread of misinformation, in addition to expanding research that deepens our understanding of health misinformation and the best ways of tackling it [79].
Health planners and public health professionals responsible for ensuring future infodemic preparedness should comprehensively survey the digital health literacy levels of their target populations to determine the best strategies for improving these levels, namely well-targeted community outreach and awareness-raising interventions, including well-tailored education and training programmes that closely match the health literacy levels and specific needs of target audiences [20]. A number of (mostly complementary) scales and tools exist for measuring (digital) health literacy, e.g., eHEALS [40,80], NVS (Newest Vital Sign) [79,81], eHLA (eHealth Literacy Assessment Toolkit) [82], etc. Some (but not all) of these tools are available in multiple languages. Using two or more of these tools in conjunction is often required in order to achieve a more complete and accurate picture of the surveyed population’s digital health literacy levels.
Improving people’s digital health will enable them to more (pro)actively and effectively participate in the healthcare system. There is a pressing need to raise awareness among the general public that they should only seek information from valid, trusted sources [83], or as Charlie Baker, the Governor of Massachusetts, rightly suggested that “Everybody needs to get their news from legitimate places, not from their friend’s friend’s friend’s friend” [84].
However, Kamel Boulos argues that it is hard to be objective and to remain so at all times, calling for a comprehensive evaluation of both ‘the message’ (information content) and ‘the messenger’ (information author/source), rather than fully relying on the latter as (an-easy-to-establish) proxy for the trustworthiness and truthfulness of an information resource. All systems of peer review and fact-checking are inherently flawed to some extent and prone to subjectivity and influence by conflicting interests and agendas, including political ones. Having information spread or published by a reputable academic belonging to a prestigious institution, or an author with recognised qualifications, or a prestigious-scientific-award winner, or a high-impact-factor scholarly journal does not always guarantee quality (and does not disapprove it either). Consumers of online information should always take ‘recognised qualifications’, ‘prestigious institutions’, ‘fact-checking sites’, ‘peer review’, ‘reputable journals’ (and their impact factors), etc., with a grain of salt. These information-source attributes are all relative rather than absolute, and are always more helpful and useful when considered together, combined rather than individually, and when considered alongside other equally, if not more, important information quality criteria that focus on the message rather than the messenger [85].
6. Conclusions
Low digital health literacy affects large percentages of populations around the world and is a direct contributor to the spread of COVID-19-related online misinformation and to its devastating effects. The ease and ‘viral’ nature of social media sharing further complicate the situation. A number of strategies, methods, and services exist that can be used to detect and prevent the spread of COVID-19 misinformation, including machine learning-based approaches, health literacy guidelines, checklists, mythbusters, and fact-checkers. However, given the complexity of the COVID-19 infodemic, it is very unlikely that any of these approaches or tools will be fully successful alone in combatting COVID-19 misinformation. Instead, a mixed, synergistic approach, combining the best of these strategies, methods, and services together, is essential as the most effective way forward to tackle online health misinformation, and mitigate its negative effects in COVID-19 and future pandemics. Furthermore, to achieve the best results possible, techniques, and tools should focus on evaluating both the message (information content) and the messenger (information author/publisher/source), and not just rely on assessing the latter as a quick and easy proxy for the trustworthiness and truthfulness of the former. Surveying and improving population digital health literacy levels is also key to future infodemic preparedness.
Author Contributions
Paper conceptualization and scope, M.N.K.B.; literature review, S.B.N. and M.N.K.B. (equally); manuscript writing, S.B.N. and M.N.K.B. (equally). All authors have read and agreed to the published version of the manuscript.
Funding
This research received no external funding.
Institutional Review Board Statement
Not applicable.
Informed Consent Statement
Not applicable.
Data Availability Statement
No new data were created or analysed in this study. Data sharing is not applicable to this article.
Conflicts of Interest
The authors declare no conflict of interest.
Footnotes
Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Nyhan B., Reifler J. When corrections fail: The persistence of political misperceptions. Political Behav. 2010;32:303–330. doi: 10.1007/s11109-010-9112-2. [DOI] [Google Scholar]
- 2.World Health Organization Munich Security Conference. Director-General, Tedros Adhanom Ghebreyesus. [(accessed on 8 July 2021)]; Available online: https://www.who.int/dg/speeches/detail/munich-security-conference.
- 3.Brennen J.S., Simon F., Howard P.N., Nielsen R.K. Types, Sources, and Claims of COVID-19 Misinformation. [(accessed on 8 July 2021)]; Available online: https://reutersinstitute.politics.ox.ac.uk/types-sources-and-claims-covid-19-misinformation.
- 4.Bruno Kessler Foundation COVID-19 and Fake News in the Social Media (10 March 2020) [(accessed on 8 July 2021)]; Available online: https://www.fbk.eu/en/press-releases/covid-19-and-fake-news-in-the-social-media/
- 5.Naeem S.B., Bhatti R., Khan A. An Exploration of How Fake News is Taking over Social Media and Putting Public Health at Risk. Health Infor. Libr. J. 2021;38:143–149. doi: 10.1111/hir.12320. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Lee J.J., Kang K.A., Wang M.P., Zhao S.Z., Wong J.Y., O′Connor S., Yang S.C., Shin S. Associations between COVID-19 misinformation exposure and belief with COVID-19 knowledge and preventive behaviors: Cross-sectional online study. J. Med. Internet Res. 2020;22:e22205. doi: 10.2196/22205. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Byrd B., Smyser J. Lies, Bots, and Coronavirus: Misinformation’s Deadly Impact on Health. Views from the Field. Grantmakers in Health. [(accessed on 8 July 2021)]; Available online: https://www.gih.org/views-from-the-field/lies-bots-and-coronavirus-misinformations-deadly-impact-on-health/
- 8.Farooq F., Rathore F.A. COVID-19 Vaccination and the Challenge of Infodemic and Disinformation. J. Korean Med. Sci. 2021;36 doi: 10.3346/jkms.2021.36.e78. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Suarez-Lledo V., Alvarez-Galvez J. Prevalence of health misinformation on social media: Systematic review. J. Med. Internet Res. 2021;23:e17187. doi: 10.2196/17187. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Ahmed W., Vidal-Alaball J., Downing J., Seguí F.L. COVID-19 and the 5G conspiracy theory: Social network analysis of Twitter data. J. Med. Internet Res. 2020;22:e19458. doi: 10.2196/19458. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Bridgman A., Merkley E., Loewen P.J., Owen T., Ruths D., Teichmann L., Zhilin O. The Causes and Consequences of COVID-19 Misperceptions: Understanding the Role of News and Social Media. [(accessed on 8 July 2021)]; Available online: https://misinforeview.hks.harvard.edu/article/the-causes-and-consequences-of-covid-19-misperceptions-understanding-the-role-of-news-and-social-media/
- 12.Su Y. It doesn’t take a village to fall for misinformation: Social media use, discussion heterogeneity preference, worry of the virus, faith in scientists, and COVID-19-related misinformation beliefs. Telemat. Inform. 2021;58:101547. doi: 10.1016/j.tele.2020.101547. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Bessi A., Coletto M., Davidescu G.A., Scala A., Caldarelli G., Quattrociocchi W. Science vs conspiracy: Collective narratives in the age of misinformation. PLoS ONE. 2015;10:e0118093. doi: 10.1371/journal.pone.0118093. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Fine G.A., Campion-Vincent V., editors. Rumor Mills: The Social Impact of Rumor and Legend. Routledge; Oxfordshire, UK: 2005. [DOI] [Google Scholar]
- 15.Lewandowsky S., Cook J. The Conspiracy Theory Handbook; George Mason University Center for Climate Change Communication. [(accessed on 8 July 2021)];2020 Available online: https://www.climatechangecommunication.org/conspiracy-theory-handbook/
- 16.Tworek H. Tweet on Twitter (18 March 2020) [(accessed on 8 July 2021)]; Available online: https://twitter.com/HeidiTworek/status/1240340632666701824.
- 17.UNDP: Governments must Lead Fight against Coronavirus Misinformation and Disinformation. [(accessed on 8 July 2021)]; Available online: https://www.undp.org/press-releases/undp-governments-must-lead-fight-against-coronavirus-misinformation-and.
- 18.Selden C.R., Zorn M., Ratzan S., Parker R.M. Health Literacy (National Library of Medicine Current Bibliographies in Medicine) National Institutes of Health, US Department of Health and Human Services; Bethesda, MD, USA: 2000. [(accessed on 8 July 2021)]. Available online: https://www.ruhr-uni-bochum.de/healthliteracy/NIHhliteracy.pdf. [Google Scholar]
- 19.Rootman I., Gordon-El-Bihbety D. A Vision for a Health Literate Canada—Report of the Expert Panel on Health Literacy. Canadian Public Health Association; Ottawa, ON, Canada: 2008. [(accessed on 8 July 2021)]. Available online: https://www.cpha.ca/sites/default/files/uploads/resources/healthlit/report_e.pdf. [Google Scholar]
- 20.Ilona Kickbusch I., Pelikan J.M., Apfel F., Tsouros A.D., editors. Health Literacy—The Solid Facts. WHO Regional Office for Europe; Copenhagen, Denmark: 2013. [(accessed on 8 July 2021)]. Available online: https://apps.who.int/iris/bitstream/handle/10665/128703/e96854.pdf. [Google Scholar]
- 21.Dunn P., Conard S. Improving health literacy in patients with chronic conditions: A call to action. Int. J. Cardiol. 2018;273:249–251. doi: 10.1016/j.ijcard.2018.08.090. [DOI] [PubMed] [Google Scholar]
- 22.Australian Commission on Safety and Quality in Health Care . Health Literacy: Taking Action to Improve Safety and Quality. ACSQHC; Sydney, Australia: 2014. [(accessed on 8 July 2021)]. Available online: https://www.safetyandquality.gov.au/our-work/patient-and-consumer-centred-care/health-literacy. [Google Scholar]
- 23.World Health Organization . WHO Guideline: Recommendations on Digital Interventions for Health System Strengthening: Executive Summary. World Health Organization; Geneva, Switzerland: 2019. [(accessed on 8 July 2021)]. Available online: https://apps.who.int/iris/bitstream/handle/10665/311941/9789241550505-eng.pdf. [PubMed] [Google Scholar]
- 24.Berkman N.D., Sheridan S.L., Donahue K.E., Halpern D.J., Crotty K. Low health literacy and health outcomes: An updated systematic review. Ann. Intern. Med. 2011;155:97–107. doi: 10.7326/0003-4819-155-2-201107190-00005. [DOI] [PubMed] [Google Scholar]
- 25.Hernandez L.M., editor. Health Literacy: Improving Health, Health Systems, and Health Policy around the World: Workshop Summary (Institute of Medicine of the National Academies) The National Academies Press; Cambridge, MA, USA: 2013. [(accessed on 8 July 2021)]. Available online: https://www.nap.edu/catalog/18325/health-literacy-improving-health-health-systems-and-health-policy-around. [PubMed] [Google Scholar]
- 26.Mahadevan R. Health Literacy Fact Sheets. Center for Health Care Strategies. [(accessed on 8 July 2021)];2013 Available online: https://www.chcs.org/resource/health-literacy-fact-sheets/
- 27.National Health Commission of China The Strategic Plan on Health Literacy Promotion for Chinese Citizens (2014–2020). Published 15 April 2014. [(accessed on 8 July 2021)]; Available online: http://www.nhc.gov.cn/xcs/s3581/201405/218e14e7aee6493bbca74acfd9bad20d.shtml.
- 28.NHS Digital Service Manual—Content Style Guide: Health Literacy (Updated: February 2021) [(accessed on 8 July 2021)]; Available online: https://service-manual.nhs.uk/content/health-literacy.
- 29.Roberts H., Veil S.R. Health literacy and crisis: Public relations in the 2010 egg recall. Public Relat. Rev. 2016;42:214–218. doi: 10.1016/j.pubrev.2015.07.013. [DOI] [Google Scholar]
- 30.US Centers for Disease Control and Prevention (CDC) Health Literacy Basics—Understanding Literacy and Numeracy. [(accessed on 8 July 2021)]; Available online: https://www.cdc.gov/healthliteracy/learn/UnderstandingLiteracy.html.
- 31.Forsythe R.A. Considerations of Low Health Literacy during the COVID-19 Pandemic. Int. J. Nurs. Didact. 2020;10:1–6. doi: 10.15520/ijnd.v10i11.3152. [DOI] [Google Scholar]
- 32.Kobayashi L.C., Wardle J., von Wagner C. Limited health literacy is a barrier to colorectal cancer screening in England: Evidence from the English Longitudinal Study of Ageing. Prev. Med. 2014;61:100–105. doi: 10.1016/j.ypmed.2013.11.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Easton P., Entwistle V.A., Williams B. How the stigma of low literacy can impair patient-professional spoken interactions and affect health: Insights from a qualitative investigation. BMC Health Serv. Res. 2013;13:319. doi: 10.1186/1472-6963-13-319. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Jayasinghe U.W., Harris M.F., Parker S.M., Litt J., van Driel M., Mazza D., Del Mar C., Lloyd J., Smith J., Zwar N. Preventive Evidence into Practice Partnership Group. The impact of health literacy and life style risk factors on health-related quality of life of Australian patients. Health Qual. Life Outcomes. 2016;14:68. doi: 10.1186/s12955-016-0471-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Mitchell S.E., Sadikova E., Jack B.W., Paasche-Orlow M.K. Health literacy and 30-day postdischarge hospital utilization. J Health Commun. 2012;17(Suppl. 3):325–338. doi: 10.1080/10810730.2012.715233. [DOI] [PubMed] [Google Scholar]
- 36.Miller T.A. Health literacy and adherence to medical treatment in chronic and acute illness: A meta-analysis. Patient Educ. Couns. 2016;99:1079–1086. doi: 10.1016/j.pec.2016.01.020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Song L., Mishel M., Bensen J.T., Chen R.C., Knafl G.J., Blackard B., Farnan L., Fontham E., Su L.J., Brennan C.S., et al. How does health literacy affect quality of life among men with newly diagnosed clinically localized prostate cancer? Findings from the North Carolina-Louisiana Prostate Cancer Project (PCaP) Cancer. 2012;118:3842–3851. doi: 10.1002/cncr.26713. [DOI] [PubMed] [Google Scholar]
- 38.Geboers B., de Winter A.F., Spoorenberg S.L., Wynia K., Reijneveld S.A. The association between health literacy and self-management abilities in adults aged 75 and older, and its moderators. Qual. Life Res. 2016;25:2869–2877. doi: 10.1007/s11136-016-1298-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Kickbusch I., Maag D., Wait S. Navigating Health: The Role of Health Literacy. Alliance for Health and the Future, International Longevity Centre-UK; London, UK: 2006. [(accessed on 8 July 2021)]. Available online: https://ilcuk.org.uk/navigating-health-the-role-of-health-literacy/ [Google Scholar]
- 40.Abdulai A.F., Tiffere A.H., Adam F., Kabanunye M.M. COVID-19 information-related digital literacy among online health consumers in a low-income country. Int. J. Med. Inform. 2021;145:104322. doi: 10.1016/j.ijmedinf.2020.104322. [DOI] [PubMed] [Google Scholar]
- 41.Heijmans M., Waverijn G., Rademakers J., van der Vaart R., Rijken M. Functional, communicative and critical health literacy of chronic disease patients and their importance for self-management. Patient Educ. Couns. 2015;98:41–48. doi: 10.1016/j.pec.2014.10.006. [DOI] [PubMed] [Google Scholar]
- 42.Rowlands G., Protheroe J., Winkley J., Richardson M., Seed P.T., Rudd R. A mismatch between population health literacy and the complexity of health information: An observational study. Br. J. Gen. Pract. 2015;65:e379–e386. doi: 10.3399/bjgp15X685285. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Adams R.J., Appleton S.L., Hill C.L., Dodd M., Findlay C., Wilson D.H. Risks associated with low functional health literacy in an Australian population. Med. J. Aust. 2009;191:530–534. doi: 10.5694/j.1326-5377.2009.tb03304.x. [DOI] [PubMed] [Google Scholar]
- 44.Guo Z., Zhao S.Z., Guo N., Wu Y., Weng X., Wong J.Y., Lam T.H., Wang M.P. Socioeconomic Disparities in eHealth Literacy and Preventive Behaviors during the COVID-19 Pandemic in Hong Kong: Cross-sectional Study. J. Med. Internet Res. 2021;23:e24577. doi: 10.2196/24577. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Dib F., Mayaud P., Chauvin P., Launay O. Online mis/disinformation and vaccine hesitancy in the era of COVID-19: Why we need an eHealth literacy revolution. Hum. Vaccin. Immunother. 2021:1–3. doi: 10.1080/21645515.2021.1874218. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Banerjee D., Rao T.S. Psychology of misinformation and the media: Insights from the COVID-19 pandemic. Indian J. Soc. Psychiatry. 2020;36:131. doi: 10.4103/ijsp.ijsp_112_20. [DOI] [Google Scholar]
- 47.Fake News Challenge. [(accessed on 8 July 2021)]; Available online: http://www.fakenewschallenge.org.
- 48.Thorne J., Vlachos A., Cocarascu O., Christodoulopoulos C., Mittal A. The Fact Extraction and VERification (FEVER) Shared Task. arXiv. 20181811.10971 [Google Scholar]
- 49.Hossain T., Logan R.L., IV, Ugarte A., Matsubara Y., Young S., Singh S. COVIDLies: Detecting COVID-19 Misinformation on Social Media; Proceedings of the 1st Workshop on NLP for COVID-19 (Part 2) at EMNLP; Online. 20 November 2020; [DOI] [Google Scholar]
- 50.Levitin D.J. Weaponized Lies: How to Think Critically in the Post-Truth Era. Dutton Books—Penguin Publishing Group; New York, NY, USA: 2017. [Google Scholar]
- 51.Abdelminaam D.S., Ismail F.H., Taha M., Taha A., Houssein E.H., Nabil A. COVID-deep: An optimized intelligent framework for automated detecting COVID-19 misleading information on Twitter. IEEE Access. 2021;9:27840–27867. doi: 10.1109/ACCESS.2021.3058066. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Kolluri N.L., Murthy D. CoVerifi: A COVID-19 news verification system. Online Soc. Netw. Media. 2021;22:100123. doi: 10.1016/j.osnem.2021.100123. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Khanday A.M., Rabani S.T., Khan Q.R., Rouf N., Din M.M. Machine learning based approaches for detecting COVID-19 using clinical text data. Int. J. Inf. Technol. 2020;12:731–739. doi: 10.1007/s41870-020-00495-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.The International Federation of Library Associations and Institutions (IFLA) COVID-19 Key Resources for Libraries (Updated: 13 October 2020) [(accessed on 8 July 2021)]; Available online: https://www.ifla.org/covid-19-and-libraries.
- 55.Evaluating Information: Applying the CRAAP Test. Meriam Library, California State University: Chico, CA, USA, 17 September 2010. [(accessed on 8 July 2021)]; Available online: https://www.csuchico.edu/lins/handouts/eval_websites.pdf.
- 56.Hazelton A. How to Read the News Like a Scientist and Avoid the COVID-19 ‘Infodemic’. [(accessed on 8 July 2021)];World Econ. Forum. 2020 Available online: https://www.weforum.org/agenda/2020/03/how-to-avoid-covid-19-fake-news-coronavirus/ [Google Scholar]
- 57.Llewellyn S. Covid-19: How to be careful with trust and expertise on social media. BMJ. 2020;368:1160. doi: 10.1136/bmj.m1160. [DOI] [PubMed] [Google Scholar]
- 58.Mantas H. Here is the best treatment you’ll ever get for the COVID-19 infodemic. [(accessed on 8 July 2021)];Poynter. Inst. 2020 Available online: https://www.poynter.org/fact-checking/2020/here-is-the-best-treatment-youll-ever-get-for-the-covid-19-infodemic/ [Google Scholar]
- 59.Mheidly N., Fares J. Leveraging media and health communication strategies to overcome the COVID-19 infodemic. J. Public Health Policy. 2020;41:410–420. doi: 10.1057/s41271-020-00247-w. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 60.UNESCO Mil Clicks Social Media Initiative. [(accessed on 8 July 2021)]; Available online: https://en.unesco.org/MILCLICKS.
- 61.Conard S. Best practices in digital health literacy. Int. J. Cardiol. 2019;292:277–279. doi: 10.1016/j.ijcard.2019.05.070. [DOI] [PubMed] [Google Scholar]
- 62.European Commission iHeal Project: A Useful Tool for Digital Health Literacy and Skills. [(accessed on 8 July 2021)]; Available online: https://futurium.ec.europa.eu/en/active-and-healthy-living-digital-world/best-practices/iheal-project-useful-tool-digital-health-literacy-and-skills.
- 63.iHealthFacts by Health Research Board-Trials Methodology Research Network (HRB-TMRN), Evidence Synthesis Ireland and Cochrane Ireland based in NUI Galway: Health Claims—Fact Checked—Quickly and Easily Check the Reliability of a Health Claim. [(accessed on 8 July 2021)]; Available online: https://ihealthfacts.ie/questions/
- 64.Zaki M., Devane D., Conway T., Galvin S., Burke N., Finucane E. Battling the COVID-19 infodemic in an Irish context: The role of iHealthFacts. HRB Open Res. 2020:3. doi: 10.12688/hrbopenres.13174.1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65.The WHO Mythbuster. [(accessed on 8 July 2021)]; Available online: https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public/myth-busters.
- 66.Australia COVID-19 Mythbuster. [(accessed on 8 July 2021)]; Available online: https://www.australia.gov.au/covid-19-mythbusting.
- 67.Canada Corona Virus Misinformation Watch. [(accessed on 8 July 2021)]; Available online: https://covid19misinfo.org/
- 68.Treatment Action Group Mythbuster. [(accessed on 8 July 2021)]; Available online: https://www.treatmentactiongroup.org/covid-19/covid-19-myth-busters/
- 69.Pakistan National Command and Control Centre Mythbuster. [(accessed on 8 July 2021)]; Available online: http://www.covid.gov.pk/
- 70.International Fact-Checking Network’s (IFCN) Code of Principles. [(accessed on 8 July 2021)]; Available online: https://ifcncodeofprinciples.poynter.org/
- 71.ClaimBuster Fact Checker. [(accessed on 8 July 2021)]; Available online: https://idir.uta.edu/claimbuster/
- 72.Google Fact Check Tools. [(accessed on 8 July 2021)]; Available online: https://toolbox.google.com/factcheck/explorer.
- 73.FactCheck.org A Project of the Annenberg Public Policy Center. [(accessed on 8 July 2021)]; Available online: https://www.factcheck.org/
- 74.AFP Fact Check. [(accessed on 8 July 2021)]; Available online: https://factcheck.afp.com/
- 75.BBC News Reality Check. [(accessed on 8 July 2021)]; Available online: https://www.bbc.co.uk/news/reality_check.
- 76.Kamel Boulos M.N. Social Media and Mobile Health (Chapter 13, under Part B: Taking Action to Create and Strengthen Health Literacy-Friendly Settings) In: Kickbusch I., Pelikan J.M., Apfel F., Tsouros A.D., editors. The Solid Facts—Health Literacy. World Health Organization Regional Office for Europe; Copenhagen, Denmark: 2013. [(accessed on 8 July 2021)]. pp. 63–67. Available online: http://www.euro.who.int/__data/assets/pdf_file/0008/190655/e96854.pdf. [Google Scholar]
- 77.Banerjee D., Meena K.S. COVID-19 as An “Infodemic” in Public Health: Critical Role of the Social Media. Front Public Health. 2021;9:610623. doi: 10.3389/fpubh.2021.610623. [DOI] [PMC free article] [PubMed] [Google Scholar] [Retracted]
- 78.Zhao E., Wu Q., Crimmins E.M., Ailshire J.A. Media trust and infection mitigating behaviours during the COVID-19 pandemic in the USA. BMJ Glob. Health. 2020;5:e003323. doi: 10.1136/bmjgh-2020-003323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 79.Confronting Health Misinformation—The U.S. Surgeon General’s Advisory on Building a Healthy Information Environment (2021) [(accessed on 16 July 2021)]; Available online: https://www.hhs.gov/sites/default/files/surgeon-general-misinformation-advisory.pdf. [PubMed]
- 80.Holch P., Marwood J.R. EHealth Literacy in UK Teenagers and Young Adults: Exploration of Predictors and Factor Structure of the eHealth Literacy Scale (eHEALS) JMIR Form Res. 2020;4:e14450. doi: 10.2196/14450. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 81.The Newest Vital Sign. [(accessed on 8 July 2021)]; Available online: https://www.pfizer.com/health/literacy/public-policy-researchers/nvs-toolkit.
- 82.Karnoe A., Furstrand D., Christensen K.B., Norgaard O., Kayser L. Assessing Competencies Needed to Engage with Digital Health Services: Development of the eHealth Literacy Assessment Toolkit. J. Med. Internet Res. 2018;20:e178. doi: 10.2196/jmir.8347. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83.Naeem S.B., Bhatti R. The Covid-19 ‘infodemic’: A new front for information professionals. Health Infor. Libr. J. 2020;37:233–239. doi: 10.1111/hir.12311. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 84.Donovan J. Here’s How Social Media Can Combat the Coronavirus ‘Infodemic’. [(accessed on 8 July 2021)];MIT Technol. Rev. 2020 Available online: https://www.technologyreview.com/2020/03/17/905279/facebook-twitter-social-media-infodemic-misinformation/ [Google Scholar]
- 85.Kamel Boulos M.N. Health literacy 101—Beyond ‘lazy proxies of trust’: Evaluating the message, not the messenger (Invited Keynote–delivered via Zoom); Proceedings of the International Symposium on ‘Infodemic Management’; Bahawalpur, Pakistan. 25–26 June 2021; [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
No new data were created or analysed in this study. Data sharing is not applicable to this article.