Abstract
Background
Health literacy is important for the prevention of COVID-19 transmission. Research in Japan shows that health literacy is related to skills in evaluating information and decision-making (skills that are not necessarily limited to information about health). Such basic skills are important, particularly when individuals encounter new health issues for which there is insufficient evidence.
Objective
We aimed to determine the extent to which COVID-19 preventive behaviors were associated with health literacy and skills in evaluating information and making decisions.
Methods
A web-based questionnaire survey was conducted using a Japanese internet research company. The measures comprised 8 items on COVID-19 preventive behaviors, health literacy items (European Health Literacy Survey Questionnaire), 5 items on information evaluation, and 4 items on decision-making process. Pearson correlations between these variables were calculated. Multivariable analyses were also conducted using the COVID-19 preventive behavior score as a dependent variable.
Results
A total of 3914 valid responses were received.COVID-19 preventive behaviors were significantly correlated with health literacy (r=0.23), information evaluation (r=0.24), and decision-making process (r=0.30). Standardized regression coefficients (health literacy: β=.11; information evaluation: β=.13; decision-making: β=.18) showed that decision-making process contributed the most.
Conclusions
Although comprehensive health literacy is necessary for COVID-19 preventive behaviors, the skills to evaluate a wide range of information and to make appropriate decisions are no less important. Opportunities for people to acquire these skills should be available at all times.
Keywords: coronavirus, COVID-19, health literacy, health information, decision-making, health promotion, prevention, behavior, survey, evaluation
Introduction
Health literacy is as important for the prevention of COVID-19 virus transmission as it is for the prevention of noncommunicable diseases [1]. Messages and materials about COVID-19 incorporate unusual vocabulary and phrases, and the number of COVID-19–related cases and deaths may be interpreted differently by people within a particular region or country [2]. Without adequate health literacy, people are unable to distinguish fact from fiction, and their behavior may be affected by unreliable information [3]. Low health literacy and information gaps may contribute substantially to the rapid spread of fear and anxiety [4]. Conversely, high health literacy can “flatten the curve” (ie, slow infection rates) of COVID-19 infections [5].
Research shows that health literacy, which has been measured in a variety of ways for a diverse range of topics, is associated with knowledge and behavior related to COVID-19: participants with less comprehensive health literacy expressed more confusion about COVID-19–related information [6], and a study [7] on digital health literacy related to COVID-19 found that college students who were better at evaluating reliability and determining the relevance of the information that they received used more reliable public websites rather than search engines or social media.
Similarly, adolescents with higher comprehensive health literacy who were asked to respond to the pandemic situation were more likely to be knowledgeable, more likely to wash their hands, less likely to socialize with friends, and more likely to report higher health-related quality of life [8]. Higher levels of infectious disease–specific health literacy or COVID-19–related health literacy are associated with greater implementation of COVID-19 preventive behaviors [9,10].
Several studies [11-13] have investigated the relationship between health literacy not associated with COVID-19 and COVID-19–related behaviors, mental health, and quality of life. In a study [11] of the Australian general public using the Single Item Literacy Screener that reported differences in knowledge, attitudes, and behaviors, participants with lower health literacy had more difficulty understanding COVID-19 symptoms, infection-prevention behaviors, and government information. In a study [13] using the comprehensive health literacy scale developed by the European Health Literacy Project [12], chronically ill patients with greater health literacy engaged more in COVID-19 preventive behaviors [13]. Similarly, in a study [14] that assessed comprehensive health literacy in an outpatient setting, greater health literacy was associated with lower depression and greater health-related quality of life, even when COVID-19 symptoms were suspected. In addition, a study [15] of medical students found that higher comprehensive health literacy was associated with lower fear of COVID-19 [15]. Among health care workers, higher comprehensive health literacy is associated with better infection prevention and control procedures, healthier lifestyles [16], and better mental health and quality of life [17], even during the COVID-19 pandemic.
Thus, health literacy, whether related to COVID-19 or not, plays an important role in the response to COVID-19. In Japan (as in other countries), fake news and information without scientific basis (such as “The new coronavirus is very heat-sensitive and can be cured by drinking hot water” and “There is a shortage of toilet paper due to the shortage of masks”) have been circulated on the internet and social media, highlighting the importance of health literacy [18]. In addition to broadcasting the number of new COVID-19 infections and deaths, the news media in Japan have broadcast daily pandemic-related information on issues, such as whether health or economy should be prioritized, an increase in bankruptcies and suicides owing to job loss, whether the Tokyo Olympics should be held, which factors have delayed vaccine development and inoculation, and whether government and administrative responses have been inadequate. During a pandemic, there is little time to improve health literacy because governments and citizens must act immediately; therefore, the challenge is to prepare individuals and society for a situation that requires immediate response and containment [1,19].
It is likely that, in Japan, the response to COVID-19 is related to health literacy, but no studies have investigated this. Individual preventive behaviors are important in responding to COVID-19. According to the World Health Organization [20] and the Japanese Ministry of Health, Labor, and Welfare [21], such behaviors include avoiding contact with the virus by maintaining social distancing, wearing masks, and disinfecting hands. Furthermore, to avoid infecting others, individuals with a high temperature or COVID-19 symptoms should rest and stay at home. Theoretically, individuals with greater health literacy should find it easier to obtain relevant health-related information and make appropriate decisions about these behavioral choices; however, health literacy depends, not only on individual ability, but also, on interactions between individuals and the environment. Therefore, the environment must also be conducive to making appropriate behavioral choices. Individuals may find it more difficult to obtain information and make decisions in response to a new disease because the environmental context is more uncertain.
A recent study [22] in Japan demonstrated that comprehensive health literacy is associated with skills in evaluating the reliability of information and decision-making (skills that are not necessarily limited to information about health). In particular, health literacy and the skills to properly evaluate the reliability of new, uncertain, and rapidly changing information (including political and socioeconomic aspects) and to make decisions are required to cope with pandemics and infodemics. The World Health Organization [23] defines an infodemic as “too much information including false or misleading information in digital and physical environments during a disease outbreak.” It would be useful to understand the extent to which information evaluation and decision-making skills are required and which skills are needed to enable individuals to be prepared and respond to emergency situations such as the COVID-19 pandemic. Therefore, the purpose of this study was to determine the extent to which COVID-19 preventive behaviors in Japanese individuals are related to health literacy and to the skills to evaluate and make decisions based on general information from the media (eg, the internet, television, and newspapers).
Methods
Participants
Participants were recruited from individuals registered with a Japanese internet research company (Nippon Research Center Ltd) that, as of the time of this study, had approximately 1.4 million voluntarily registered participants. We aimed to collect data from a minimum of 4000 individuals aged 20 to 69 years. In January 2021, potential respondents (n=22,115) were randomly selected and invited via email to participate in a cross-sectional web-based anonymous questionnaire.
In determining potential participants, we tried to match participants’ genders, age groups, and regions (we divided the country into 8 regions) to the results of the 2015 Japanese census [24]. We accepted emailed responses from potential participants until we reached the target number for gender, age group, and region.
Measures
COVID-19 Preventive Behaviors
The questions on COVID-19 preventive behaviors were developed using World Health Organization [20] and Japanese Ministry of Health, Labor, and Welfare [21] guidelines on preventing infection.
To ensure that the questions were as comprehensible as possible, we selected text from easy-to-understand recommendations written for citizens on Japanese government and administrative webpages.
These items were “Use a mask, tissue, handkerchief, or sleeve to cover your mouth and nose when coughing or sneezing,” “Wear a mask when the distance between people is likely to be less than 2 m (meters),” “Wash your hands with soap or alcohol-based disinfectant before meals or upon returning home from outside, etc,” “Try maintaining a minimum distance of 2 m (meters) from people,” “Rest if you are not feeling well,” “Ventilate the room,” “Avoid touching your eyes, mouth, or nose after contact with doorknobs, railings, desks, light switches, etc,” and “Take your temperature.” A 5-point scale (5, always; 4, often; 3, sometimes; 2, rarely; 1, never) was used for response options (see Multimedia Appendix 1). The total score was calculated; higher scores indicated greater frequency of engaging in COVID-19 preventive behaviors.
European Health Literacy Survey Questionnaire
The Japanese-language version of the European Health Literacy Survey Questionnaire (HLS-EU-Q47), which is a comprehensive, concept-based measure of most aspects of health literacy for the general population that allows for national and international comparisons [12,25-27], has been used and validated in Japan and in other Asian countries [26,27]. The HLS-EU-Q47 comprises 47 items assessing 12 subdomains of health literacy formed by 4 information processing competences of individuals (accessing, understanding, appraising, and applying) and 3 health contexts (health care, disease prevention, and health promotion). The survey response categories were all phrased similarly to “On a scale from very easy to very difficult, how easy would you say it is to understand why you need health screenings?” and were ranked on a 4-point scale (1, very difficult; 2, fairly difficult; 3, fairly easy; 4, very easy) and included the response option “don’t know/not applicable”; this response was coded as a missing value.
The health literacy score was standardized for each participant on a metric between 0 and 50 using the formula [12]: (MEAN – 1) × (50 / 3), where MEAN is the mean of all item responses.
Information Evaluation
Based on 5 criteria (accuracy, authority, objectivity, currency, and coverage) for judging the quality of information sources [28-32], 5 items were used to determine whether participants were able to evaluate the information [22]. We asked respondents to rate how often they checked the following aspects of the information they accessed on the internet, television, newspapers, magazines, or other media: (1) the source of the information, (2) the qualifications of the people and organizations providing the information, (3) whether the information advertised products or services, (4) when the information was created, and (5) how the information differed from other information. A 5-point scale (5, always; 4, often; 3, sometimes; 2, rarely; 1, never) was used for response options (see Multimedia Appendix 2). Total and item scores were calculated. The internal consistency reliability was excellent (Cronbach α=.92) and construct validity was demonstrated by the results of a confirmatory factor analysis, which produced a single factor. Higher scores indicated greater information evaluation frequency and skill.
Decision-making Process
We assessed whether the essential aspects of the process of determining all the available options, knowing the pros and cons of each option, comparing them based on values and preferences, and making a choice were implemented, which is necessary for informed decision-making. For this purpose, we developed 4 items for each aspect based on the Shared Decision-Making Process scale [33]. Items on this scale are limited to 2 options; therefore, we created items that were not limited to health decisions and had a wider range of options. We asked respondents to rate how often they implemented the following aspects when they made important decisions: (1) make sure they have all the options, (2) know the pros of each option, (3) know the cons of each option, and (4) compare the pros and cons of each option and clarify what is important to them. As with the information evaluation items, we used a 5-point scale (5, always; 4, often; 3, sometimes; 2, rarely; 1, never; see Multimedia Appendix 2). Total and item scores were calculated; higher scores indicated greater decision-making frequency and skill. The reliability was excellent (Cronbach α=.93), and construct validity was demonstrated with confirmatory factor analysis, which produced a single factor [22].
Demographic Characteristics
The following demographic characteristics were analyzed: gender, age, level of education, occupation, and prefecture status (under a state of emergency or not under a state of emergency). At the time of the survey, the Japanese government had declared a state of emergency because of the COVID-19 pandemic in 11 of the 47 prefectures, including the Tokyo metropolitan area [34]. The main points of this state of emergency plan were shortening the opening hours of restaurants and bars, reducing the number of employees in offices by 70%, avoiding nighttime outings, and limiting events.
Statistical Analysis
We examined the distribution of responses to each COVID-19 preventive behavior items. Reliability and validity were verified, and Cronbach α values were calculated to examine internal consistency. For construct validity, confirmatory factor analysis was conducted to examine construct validity; the comparative fit index, the root mean square error of approximation, and the standardized root mean square residual were used as model fit indices. A comparative fit index value ≥.95 represents a good fit, and a value ≥.90 is generally considered to indicate acceptable model fit [35,36]. Root mean square error of approximation and standardized root mean square residual values <.05 represent good fits, and values <.08 are acceptable [35,36].
To determine which participants scored higher on COVID-19 preventive behaviors, we conducted multiple linear regression analysis (general linear model) with this variable as the dependent variable and demographic characteristics (gender, age group, education, occupation, and prefecture status) as independent variables.
To determine the extent to which the variables health literacy, information evaluation, and decision-making process can independently explain COVID-19 preventive behaviors, we conducted hierarchical multiple linear regression analysis with the COVID-19 preventive behavior score as the dependent variable and scores on health literacy, information evaluation, and decision-making process as independent variables; demographic characteristics (gender, age group, education, occupation, and prefecture status) were used as control variables.
Data were analyzed using SPSS and Amos software (version 27.0; IBM Corp).
Ethics Approval and Consent to Participate
The study received prior approval from the Research Ethics Committee of St. Luke’s International University, Japan (20-A076) and was conducted in accordance with the guidelines of the Declaration of Helsinki. Participants voluntarily signed a web-based informed consent form that was approved by the institutional review board.
Results
Participants
There were 3914 valid responses (Table 1). These included responses with less than 20% of missing values on all health literacy items, which enabled health literacy scores to be calculated as per the original HLS-EU-Q47 survey [12]. Data for these individuals were included in the analysis.
Table 1.
Characteristics of study participants.
| Characteristic | Participants (n=3914) or value | ||
| Gender, n (%) |
|
||
|
|
Men | 1953 (49.9) | |
|
|
Women | 1961 (50.1) | |
| Age (years), n (%) |
|
||
|
|
20-29 | 567 (14.5) | |
|
|
30-39 | 721 (18.4) | |
|
|
40-49 | 891 (22.8) | |
|
|
50-59 | 785 (20.1) | |
|
|
60-69 | 950 (24.3) | |
| Age, mean (SD) | 46.9 (13.6) | ||
| Highest level of education, n (%) |
|
||
|
|
Junior high school | 86 (2.2) | |
|
|
High school | 981 (25.1) | |
|
|
2-year college | 858 (21.9) | |
|
|
College or university | 1806 (46.1) | |
|
|
Graduate | 183 (4.7) | |
| Occupation, n (%) |
|
||
|
|
Self-employed | 191 (4.9) | |
|
|
Managerial and administrative | 166 (4.2) | |
|
|
Professional and technical | 463 (11.8) | |
|
|
Other (routine and manual) | 1367 (34.9) | |
|
|
Part-time | 474 (12.1) | |
|
|
Homemaker | 652 (16.7) | |
|
|
Student | 131 (3.3) | |
|
|
Unemployed | 470 (12.0) | |
| Prefecture status, n (%) |
|
||
|
|
Under a state of emergency | 2387 (61.0) | |
|
|
Not under a state of emergency | 1527 (39.0) | |
| Health literacy score, mean (SD) | 27.4 (9.4) | ||
Distribution of Responses
The item that received the highest percentage of always responses was cough etiquette (Table 2), followed by wearing a mask when close to someone, and handwashing. The most infrequently performed behavior was temperature taking (always response: 853/3914, 21.8%; often response: 717/3914, 18.3%).
Table 2.
Responses for COVID-19 preventive behavior items.
| Items | Responses, n (%) | Score, mean (SD) | |||||
|
|
Always | Often | Sometimes | Rarely | Never |
|
|
| 1. Use a mask, tissue, handkerchief, or sleeve to cover your mouth and nose when coughing or sneezing | 2408 (61.5) | 890 (22.7) | 368 (9.4) | 158 (4.0) | 90 (2.3) | 4.4 (1.0) | |
| 2. Wear a mask when the distance between people is likely to be less than 2 m (meters) | 2234 (57.1) | 992 (25.3) | 418 (10.7) | 162 (4.1) | 108 (2.8) | 4.3 (1.0) | |
| 3. Wash your hands with soap or alcohol-based disinfectant before meals or upon returning home from outside, etc | 2033 (51.9) | 930 (23.8) | 489 (12.5) | 266 (6.8) | 196 (5.0) | 4.1 (1.2) | |
| 4. Try maintaining a minimum distance of 2 m (meters) from people | 845 (21.6) | 1479 (37.8) | 986 (25.2) | 440 (11.2) | 164 (4.2) | 3.6 (1.1) | |
| 5. Rest if you are not feeling well | 1217 (31.1) | 1059 (27.1) | 805 (20.6) | 497 (12.7) | 336 (8.6) | 3.6 (1.3) | |
| 6. Ventilate the room | 1037 (26.5) | 1133 (28.9) | 986 (25.2) | 506 (12.9) | 252 (6.4) | 3.6 (1.2) | |
| 7. Avoid touching your eyes, mouth, or nose after contact with doorknobs, railings, desks, light switches, etc | 1035 (26.4) | 1111 (28.4) | 857 (21.9) | 495 (12.6) | 416 (10.6) | 3.5 (1.3) | |
| 8. Take your temperature | 853 (21.8) | 717 (18.3) | 932 (23.8) | 798 (20.4) | 614 (15.7) | 3.1 (1.4) | |
The 3 most frequently performed behaviors had mean scores representing often (ie, >4): cough etiquette (mean 4.4, SD 1.0), wearing a mask when close to someone (mean 4.3, SD 1.0), and handwashing (mean 4.1, SD 1.2). The mean total preventive behavior score was 30.1 (SD 6.4).
Reliability and Validity of the Total COVID-19 Preventive Behavior Score
We confirmed the reliability and validity of the total COVID-19 preventive behavior score (Cronbach α=.83). The comparative fit index was 0.963, the root mean square error of approximation was 0.073 (95% CI 0.067- 0.079), and the standardized root mean square residual was 0.035, which indicated acceptable fit. Error covariances were observed between 2 sets of items with similar wording in Japanese (set 1: items 1 and 2, set 2: items 5 and 8), but confirmatory factor analysis factor loadings were >0.45 for all items, and a unidimensional structure was confirmed.
Multiple Linear Regression
For COVID-19 preventive behaviors, scores were higher for women than for men (P<.001), and participants with higher levels of education had higher scores (P<.001) (Table 3). Participants in occupational, managerial, and administrative jobs had the highest preventive behavior scores, and participants who were unemployed had the lowest scores (P<.001). Participants in prefectures under a state of emergency had higher preventive behavior scores (P<.001).
Table 3.
Multiple linear regression results for COVID-19 preventive behaviors as the dependent variable.
| Variables | Estimated marginal mean (95% CI) | F test (df) | P value | |
| Gender |
|
141.9 (1,3913) | <.001 | |
|
|
Men | 28.4 (27.9, 28.8) |
|
|
|
|
Women | 31.2 (30.7, 31.7) |
|
|
| Age (years) |
|
.7 (4,3913) | .63 | |
|
|
20-29 | 29.7 (29.1, 30.3) |
|
|
|
|
30-39 | 29.9 (29.4, 30.5) |
|
|
|
|
40-49 | 29.6 (29.1, 30.2) |
|
|
|
|
50-59 | 29.6 (29.1, 30.2) |
|
|
|
|
60-69 | 30.0 (29.5, 30.5) |
|
|
| Highest level of education |
|
4.6 (4,3913) | .001 | |
|
|
Junior high school | 28.0 (26.6, 29.3) |
|
|
|
|
High school | 29.7 (29.3, 30.1) |
|
|
|
|
2-year college | 30.4 (30.0, 30.9) |
|
|
|
|
College or university | 30.2 (29.9, 30.6) |
|
|
|
|
Graduate | 30.6 (29.7, 31.6) |
|
|
| Occupation |
|
6.0 (7,3913) | <.001 | |
|
|
Self-employed | 29.3 (28.4, 30.3) |
|
|
|
|
Managerial and administrative | 31.5 (30.5, 32.5) |
|
|
|
|
Professional and technical | 29.1 (28.5, 29.7) |
|
|
|
|
Other (routine and manual) | 29.6 (29.2, 30.1) |
|
|
|
|
Part-time | 29.8 (29.2, 30.4) |
|
|
|
|
Homemaker | 30.4 (29.8, 31.0) |
|
|
|
|
Student | 30.0 (28.8, 31.2) |
|
|
|
|
Unemployed | 28.6 (27.9, 29.2) |
|
|
| Prefecture |
|
33.1 (1,3913) | <.001 | |
|
|
Under a state of emergency | 30.4 (30.0, 30.8) |
|
|
|
|
Not under a state of emergency | 29.2 (28.8, 29.6) |
|
|
Hierarchical Multiple Linear Regression
Pearson correlations (Table 4) between COVID-19 preventive behaviors and health literacy, information evaluation, and decision-making process were r=0.23 (P<.001), r=0.24 (P<.001), and r=0.30 (P<.001), respectively.
Table 4.
Hierarchical multiple linear regression analysis of COVID-19 preventive behaviors, controlling for demographic variables (gender, age, education, occupation, and prefecture status).
| Independent variable | Correlation | Model 1a | Model 2b | Model 3c | ||||||||||
|
|
r | P value | β | t value | P value | β | t value | P value | β | t value | P value | |||
| Health literacy | 0.23 | <.001 | .20 | 13.0 | <.001 | —d | — | — | .11 | 6.8 | <.001 | |||
| Information evaluation | 0.24 | <.001 | — | — | — | .15 | 8.3 | <.001 | .13 | 7.4 | <.001 | |||
| Decision-making process | 0.30 | <.001 | — | — | — | .20 | 11.3 | <.001 | .18 | 9.9 | <.001 | |||
aR2=0.12, and adjusted R2=0.12; F(18,3913)=30.6, P<.001.
bR2=0.18, and adjusted R2=0.18; F(19,3913)=45.3, P<.001.
cR2=0.19, and adjusted R2=0.19; F(20,3913)=45.9, P<.001.
dData not included.
An examination of the change in health literacy from model 1, in which only health literacy was entered as an independent variable, to model 3, which included all 3 variables, showed that the standardized regression coefficient approximately halved (model 1: β=.20; model 3: β=.11), whereas the changes for information evaluation (model 2: β=.15; model 3: β=.13) and decision-making process (model 1: β=.20; model 3: β=.18) were less pronounced; both standardized regression coefficient remained similar even after controlling for health literacy.
Discussion
This study demonstrated that health literacy was associated with COVID-19 preventive behaviors. However, information evaluation and decision-making process skills, which are not limited to health information, showed a similar strength of association with preventive behaviors. Because the assessment of health literacy in this survey focused mainly on daily health information, it may reflect the ability to cope with common diseases, including familiar infectious diseases and may be inadequate to assess responses to pandemics caused by new viruses (or infodemics). In situations in which the evidence is insufficient or not immediately communicated in an easy-to-understand manner, skills in information evaluation and decision-making process (not necessarily limited to health information) are important.
The decision-making process showed the strongest association with preventive behaviors in all analyses, even after controlling for health literacy and information evaluation. The results show that an engagement in COVID-19 preventive behaviors is associated with rational decision-making skills. To make rational decisions (ie, decisions that are purposeful and have clear reasons), an individual must engage in the process of generating options, comparing the pros and cons of those options, and selecting the option that best fits their values. The importance of this process has been demonstrated in business and health, both of which require individuals to regularly make important decisions [37]. This process is essential to the practice of shared decision-making in health, which is a collaboration between health care professionals and consumers [38]. Similarly, in evidence-based health care, consumer values and decision-making preferences are as important as evidence [39]. Furthermore, the Ottawa Decision Support Framework [40] states that to improve the quality of decision-making, individuals must make choices according to the perceived importance of the pros and cons of each option.
To implement COVID-19 preventive behaviors, we first need to know what the options are and which behaviors lower or raise the risk. Then, we need to be able to evaluate the balance and trade-offs between infection-prevention behaviors and work, connections with family and friends, stress, and mental health. To make decisions appropriate to their personal values, people need to be familiar with making decisions that clarify their values on a regular basis; it may be difficult to clarify personal values on the spur of the moment. Some international comparative studies [41-43] have shown that Japanese people have low self-esteem in decision-making and tend to make intuitive decisions rather than rational decisions. Therefore, this is an opportunity to draw attention to the importance of rational decision-making skills.
The association between preventive behaviors and information evaluation and decision-making skills that we found may indicate that the lack of these skills leads to a higher risk of infection. These differences could result in individual disparities in new health issues, which could be greater for infectious diseases as people infect others around them. In making important decisions, it is necessary to ensure that the information on which the decision is based is sufficiently reliable to determine the pros and cons of each option and to identify which pros and cons are important. However, in a survey [22] in Japan, only approximately 30% to 50% of respondents answered that they always or often made decisions in such a manner. Furthermore, more than 40% of respondents reported that they did not have the opportunity to learn these skills. Therefore, it is necessary to create an environment in which everyone can learn these skills. Respondents who had had the opportunity to learn these skills usually acquired them from the internet (approximately 40%), followed by television (approximately 30%), and newspapers and magazines (approximately 15%). It may therefore be useful to consider providing information through these media [22].
Our findings also indicate that individuals who lack skills in information evaluation and decision-making do not receive sufficient reliable information to enable decision-making. Transparent, honest communication is important to control the pandemic [4]. It would be useful to develop a website or social media source where people could obtain the latest reliable and easy-to-understand information and make decisions. In Japan, there is no organization equivalent to the US Centers for Disease Control and Prevention, and no clear source of information in the event of an infectious disease or pandemic; therefore, a solution to this problem is needed.
In addition to providing information and services that are easy to understand, there is a need to support decision-making, especially for individuals with poor decision-making skills. One early initiative was the creation of a decision aid by the Gerontological Society of America to enable people to determine whether to interact with people and participate in activities outside the home [44]. To prepare for pandemics, it is necessary to create a system that can rapidly develop and disseminate such a tool.
This study had several limitations. It is possible that there was some sample selection bias. Participants may have been skewed toward a high level of internet literacy because of the use of a web-based survey. Recruitment of respondents was based on self-selection from a group of individuals who had previously expressed a desire to participate in research projects. The responses were limited to approximately the first 4000 people; therefore the sample may have included only individuals who were most active on the internet (eg, frequently checking email). Although users familiar with the internet and social media may find it easier to obtain health information, they may become confused by the large amount of often contradictory health information available. There is evidence that internet literacy is not the only factor that determines whether people access health information using electronic sources [45]. The results of our study suggest that even people with sufficient internet literacy also need health literacy, information evaluation skills, and decision-making skills to take appropriate health action in response to an infodemic.
Items were created from 5 information evaluation criteria; however, these were just representative items; many alternative, more detailed items could have been chosen (eg, the affiliation of the author of the information). However, rather than covering a wide range of content, the goal was to identify the core aspects of information evaluation associated with COVID-19 preventive behaviors. These issues also apply to the 4 decision-making items. For example, the description decision-making includes clarification of the problem before checking the options, as well as action and evaluation after the decision is made. However, because we used the shared decision-making process as a reference, we focused on the process required to make a decision, assuming that the problem was already apparent. The aim was, not to create a scale to cover all skills needed in the decision-making process, but, to determine if specific key points were related to COVID-19 preventive behaviors.
This study was also limited because it used cross-sectional data, which does not allow a firm conclusion to be drawn.
For new nonroutine health challenges, for example, understanding and using preventive behaviors during a pandemic such as that of COVID-19, the ability to evaluate all information and make appropriate decisions is required. However, because some people experience difficulty with this, there is a substantial need to provide reliable and easy-to-understand information and to support people in choosing appropriate actions by creating an environment that allows individuals to learn information evaluation and decision-making skills at any age.
Acknowledgments
This work was supported by the Japan Society for the Promotion of Science (KAKENHI grant 20H03967). We thank Diane Williams, PhD, from Edanz for editing a draft of this manuscript.
Abbreviations
- HLS-EU-Q47
European Health Literacy Survey Questionnaire
Questionnaire on COVID-19 preventive behaviors (Japanese version).
Questionnaire on information evaluation and decision-making process skills (Japanese version).
Footnotes
Authors' Contributions: KN designed the study and contributed to writing the manuscript. KN had full access to all study data and takes responsibility for the integrity of the data and the accuracy of the data analysis. KH performed data collection. YY contributed to the study design. All authors contributed to the questionnaire development process. All authors read and approved the final manuscript.
Conflicts of Interest: None declared.
References
- 1.Paakkari L, Okan O. COVID-19: health literacy is an underestimated problem. Lancet Public Health. 2020 May;5(5):e249–e250. doi: 10.1016/S2468-2667(20)30086-4. https://linkinghub.elsevier.com/retrieve/pii/S2468-2667(20)30086-4 .S2468-2667(20)30086-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Rudd R, Baur C. Health literacy and early insights during a pandemic. J Commun Healthc. 2020 May 13;13(1):13–16. doi: 10.1080/17538068.2020.1760622. [DOI] [Google Scholar]
- 3.Spring H. Health literacy and COVID-19. Health Info Libr J. 2020 Sep;37(3):171–172. doi: 10.1111/hir.12322. http://europepmc.org/abstract/MED/32672399 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Abbas MZ. Public understanding and voluntary responsibility to mitigate COVID-19 pandemic: role of local community organizations in information sharing and health literacy. Asia Pac J Public Health. 2021 May 17;33(4):451–452. doi: 10.1177/10105395211002656. [DOI] [PubMed] [Google Scholar]
- 5.Košir U, Sørensen K. COVID-19: the key to flattening the curve is health literacy. Perspect Public Health. 2020 Jul 10;:1757913920936717. doi: 10.1177/1757913920936717. [DOI] [PubMed] [Google Scholar]
- 6.Okan O, Bollweg Torsten Michael, Berens E, Hurrelmann K, Bauer U, Schaeffer D. Coronavirus-related health literacy: a cross-sectional study in adults during the COVID-19 infodemic in Germany. Int J Environ Res Public Health. 2020 Jul 30;17(15):5503. doi: 10.3390/ijerph17155503. https://www.mdpi.com/resolver?pii=ijerph17155503 .ijerph17155503 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Rosário Rafaela, Martins MRO, Augusto C, Silva MJ, Martins S, Duarte A, Fronteira I, Ramos N, Okan O, Dadaczynski K. Associations between covid-19-related digital health literacy and online information-seeking behavior among portuguese university students. Int J Environ Res Public Health. 2020 Dec 02;17(23):8987. doi: 10.3390/ijerph17238987. https://www.mdpi.com/resolver?pii=ijerph17238987 .ijerph17238987 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Riiser K, Helseth S, Haraldstad K, Torbjørnsen Astrid, Richardsen KR. Adolescents' health literacy, health protective measures, and health-related quality of life during the covid-19 pandemic. PLoS One. 2020 Aug 28;15(8):e0238161. doi: 10.1371/journal.pone.0238161. https://dx.plos.org/10.1371/journal.pone.0238161 .PONE-D-20-19534 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Wang H, Cheong PL, Wu J, Van IK. Health literacy regarding infectious disease predicts covid-19 preventive behaviors: a pathway analysis. Asia Pac J Public Health. 2021 Jul;33(5):523–529. doi: 10.1177/10105395211013923. https://journals.sagepub.com/doi/10.1177/10105395211013923?url_ver=Z39.88-2003&rfr_id=ori:rid:crossref.org&rfr_dat=cr_pub%3dpubmed . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Wong JYH, Wai AKC, Zhao S, Yip F, Lee JJ, Wong CKH, Wang MP, Lam TH. Association of individual health literacy with preventive behaviours and family well-being during covid-19 pandemic: mediating role of family information sharing. Int J Environ Res Public Health. 2020 Nov 27;17(23):8838. doi: 10.3390/ijerph17238838. https://www.mdpi.com/resolver?pii=ijerph17238838 .ijerph17238838 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.McCaffery K, Dodd R, Cvejic E, Ayrek Julie, Batcup Carys, Isautier Jennifer Mj, Copp Tessa, Bonner Carissa, Pickles Kristen, Nickel Brooke, Dakin Thomas, Cornell Samuel, Wolf Michael S. Health literacy and disparities in COVID-19-related knowledge, attitudes, beliefs and behaviours in Australia. Public Health Res Pract. 2020 Dec 09;30(4):30342012. doi: 10.17061/phrp30342012. doi: 10.17061/phrp30342012.30342012 [DOI] [PubMed] [Google Scholar]
- 12.Sørensen Kristine, Van den Broucke S, Pelikan JM, Fullam J, Doyle G, Slonska Z, Kondilis B, Stoffels V, Osborne RH, Brand H, HLS-EU Consortium Measuring health literacy in populations: illuminating the design and development process of the European Health Literacy Survey Questionnaire (HLS-EU-Q) BMC Public Health. 2013 Oct 10;13(1):948. doi: 10.1186/1471-2458-13-948. https://bmcpublichealth.biomedcentral.com/articles/10.1186/1471-2458-13-948 .1471-2458-13-948 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Gautam V, Rustagi Neeti, Mittal Ankit, Patel Mehul, Shafi Shazia, Thirunavukkarasu Prasanna, Raghav Pankaja. Health literacy, preventive COVID 19 behaviour and adherence to chronic disease treatment during lockdown among patients registered at primary health facility in urban Jodhpur, Rajasthan. Diabetes Metab Syndr. 2021 Jan;15(1):205–211. doi: 10.1016/j.dsx.2020.12.023. http://europepmc.org/abstract/MED/33387854 .S1871-4021(20)30518-X [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Nguyen HC, Nguyen MH, Do BN, Tran CQ, Nguyen TTP, Pham KM, Pham LV, Tran KV, Duong TT, Tran TV, Duong TH, Nguyen TT, Nguyen QH, Hoang TM, Nguyen KT, Pham TTM, Yang S, Chao JC, Duong TV. People with suspected covid-19 symptoms were more likely depressed and had lower health-related quality of life: the potential benefit of health literacy. J Clin Med. 2020 Mar 31;9(4):965. doi: 10.3390/jcm9040965. https://www.mdpi.com/resolver?pii=jcm9040965 .jcm9040965 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Nguyen HT, Do BN, Pham KM, Kim GB, Dam HT, Nguyen TT, Nguyen TT, Nguyen YH, Sørensen Kristine, Pleasant A, Duong TV. Fear of COVID-19 scale-associations of its scores with health literacy and health-related behaviors among medical students. Int J Environ Res Public Health. 2020 Jun 11;17(11):4164. doi: 10.3390/ijerph17114164. https://www.mdpi.com/resolver?pii=ijerph17114164 .ijerph17114164 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Do BN, Tran TV, Phan DT, Nguyen HC, Nguyen TTP, Nguyen HC, Ha TH, Dao HK, Trinh MV, Do TV, Nguyen HQ, Vo TT, Nguyen NPT, Tran CQ, Tran KV, Duong TT, Pham HX, Nguyen LV, Nguyen KT, Chang PWS, Duong TV. Health literacy, ehealth literacy, adherence to infection prevention and control procedures, lifestyle changes, and suspected COVID-19 symptoms among health care workers during lockdown: online survey. J Med Internet Res. 2020 Nov 12;22(11):e22894. doi: 10.2196/22894. https://www.jmir.org/2020/11/e22894/ v22i11e22894 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Tran TV, Nguyen HC, Pham LV, Nguyen MH, Nguyen HC, Ha TH, Phan DT, Dao HK, Nguyen PB, Trinh MV, Do TV, Nguyen HQ, Nguyen TTP, Nguyen NPT, Tran CQ, Tran KV, Duong TT, Pham HX, Nguyen LV, Vo TT, Do BN, Duong TH, Pham MK, Pham TTM, Nguyen KT, Yang S, Chao JCJ, Duong TV. Impacts and interactions of COVID-19 response involvement, health-related behaviours, health literacy on anxiety, depression and health-related quality of life among healthcare workers: a cross-sectional study. BMJ Open. 2020 Dec 07;10(12):e041394. doi: 10.1136/bmjopen-2020-041394. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=33293320 .bmjopen-2020-041394 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Itakura Kimie. Coronavirus outbreak puts Japan’s health literacy to the test. Nippon.com. 2020. Apr 15, [2021-12-10]. https://www.nippon.com/en/in-depth/d00551/
- 19.Abdel-Latif M. The enigma of health literacy and COVID-19 pandemic. Public Health. 2020 Aug;185:95–96. doi: 10.1016/j.puhe.2020.06.030. http://europepmc.org/abstract/MED/32593054 .S0033-3506(20)30268-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Coronavirus disease (COVID-19) advice for the public. World Health Organization. [2021-12-10]. https://www.who.int/emergencies/diseases/novel-coronavirus-2019/advice-for-public .
- 21.Novel Coronavirus (COVID-19): preventing infection. Ministry of Health, Labour and Welfare, Japan. [2021-12-10]. https://www.mhlw.go.jp/stf/covid-19/kenkou-iryousoudan_00006.html#1-1 .
- 22.Nakayama K, Yonekura Y, Danya H, Hagihara K. Associations between health literacy and information-evaluation and decision-making skills in Japanese adults. Research Square. doi: 10.21203/rs.3.rs-537682/v1. Preprint posted online on August 18, 2021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Infodemic. World Health Organization. [2022-01-14]. https://www.who.int/health-topics/infodemic .
- 24.2015 population census in Japan. Statistics Bureau, Ministry of Internal Affairs and Communications, Japan. 2017. [2021-12-10]. http://www.stat.go.jp/english/data/kokusei/
- 25.Pelikan JM, Ganahl K, Van den Broucke S, Sørensen K. International Handbook of Health Literacy: Research, Practice and Policy across the Lifespan. Bristol: Policy Press; 2019. Measuring health literacy in Europe: introducing the European health literacy survey questionnaire (HLS-EU-Q) pp. 115–138. [Google Scholar]
- 26.Duong TV, Aringazina A, Baisunova G, Nurjanah. Pham TV, Pham KM, Truong TQ, Nguyen KT, Oo WM, Mohamad E, Su TT, Huang H, Sørensen Kristine, Pelikan JM, Van den Broucke S, Chang PW. Measuring health literacy in Asia: validation of the HLS-EU-Q47 survey tool in six Asian countries. J Epidemiol. 2017 Feb;27(2):80–86. doi: 10.1016/j.je.2016.09.005. https://linkinghub.elsevier.com/retrieve/pii/S0917-5040(16)30077-6 .S0917-5040(16)30077-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Nakayama K, Osaka W, Togari T, Ishikawa H, Yonekura Y, Sekido A, Matsumoto M. Comprehensive health literacy in Japan is lower than in Europe: a validated Japanese-language assessment of health literacy. BMC Public Health. 2015 May 23;15(1):505. doi: 10.1186/s12889-015-1835-x. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-015-1835-x .10.1186/s12889-015-1835-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Evaluating sources toolkit: CRAP test. Colorado Community Colleges Online. [2021-12-10]. https://ccconline.libguides.com/c.php?g=242130&p=2185475 .
- 29.Blakeslee S. The CRAAP test. LOEX Q. 2004;31(3):6–7. https://commons.emich.edu/loexquarterly/vol31/iss3/4 . [Google Scholar]
- 30.How should research sources be evaluated? University of Maryland GLobal Campus. [2021-12-10]. https://www.umgc.edu/current-students/learning-resources/writing-center/online-guide-to-writing/tutorial/chapter4/ch4-05.html .
- 31.Beck SE. Evaluation criteria. New Mexico State University Library. 2009. [2021-12-10]. https://lib.nmsu.edu/instruction_backup/evalcrit.html .
- 32.Evaluating information resources. Elmer E. Rasmuson Library University of Alaska Fairbanks. [2021-12-10]. https://library.uaf.edu/instruction/readings/evaluation .
- 33.Shared decision making process scale. MGH Health Decision Sciences Center. [2021-12-10]. https://mghdecisionsciences.org/tools-training/sdm-process-survey/
- 34.The prime minister in action. Official Website of the Prime Minister of Japan and His Cabinet. [2022-01-14]. https://japan.kantei.go.jp/index.html .
- 35.Sudbury-Riley L, FitzPatrick M, Schulz PJ. Exploring the measurement properties of the eHealth literacy scale (eHEALS) among baby boomers: a multinational test of measurement invariance. J Med Internet Res. 2017 Feb 27;19(2):e53. doi: 10.2196/jmir.5998. https://www.jmir.org/2017/2/e53/ v19i2e53 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Hooper D, Coughlan J, Mullen M. Structural equation modelling: guidelines for determining model fit. Electronic J Bus Res Methods. 2008:53–60. doi: 10.21427/D7CF7R. [DOI] [Google Scholar]
- 37.Harvard Business Essentials: Decision Making: 5 Steps to Better Results. Boston: Harvard Business School Publishing; 2006. [Google Scholar]
- 38.Makoul G, Clayman ML. An integrative model of shared decision making in medical encounters. Patient Educ Couns. 2006 Mar;60(3):301–12. doi: 10.1016/j.pec.2005.06.010.S0738-3991(05)00178-3 [DOI] [PubMed] [Google Scholar]
- 39.Djulbegovic B, Guyatt GH. Progress in evidence-based medicine: a quarter century on. Lancet. 2017 Jul 22;390(10092):415–423. doi: 10.1016/S0140-6736(16)31592-6.S0140-6736(16)31592-6 [DOI] [PubMed] [Google Scholar]
- 40.Hoefel L, O'Connor Annette M, Lewis KB, Boland L, Sikora L, Hu J, Stacey D. 20th anniversary update of the Ottawa decision support framework part 1: a systematic review of the decisional needs of people making health or social decisions. Med Decis Making. 2020 Jul;40(5):555–581. doi: 10.1177/0272989X20936209. [DOI] [PubMed] [Google Scholar]
- 41.Martinsons MG, Davison RM. Strategic decision making and support systems: comparing American, Japanese and Chinese management. Decision Support Systems. 2007 Feb;43(1):284–300. doi: 10.1016/j.dss.2006.10.005. [DOI] [Google Scholar]
- 42.Radford MH, Mann L, Ohta Y, Nakane Y. Differences between Australian and Japanese students in decisional self-esteem, decisional stress, and coping styles. J Cross Cult Psychol. 2016 Jul 27;24(3):284–297. doi: 10.1177/0022022193243002. [DOI] [Google Scholar]
- 43.Mann L. Cross-cultural Differences in Self-reported Decision-making Style and Confidence. Int J Psychol. 1998 Oct;33(5):325–335. doi: 10.1080/002075998400213. [DOI] [Google Scholar]
- 44.Brown LM, Wallick A, Hyer K, Sullivan E, Sobczyk E, Scherer A. A covid-19 decision aid: how do i choose when to interact with people or take part in activities outside my home during the pandemic? The Gerontological Society of America. 2021. [2021-12-10]. https://www.geron.org/images/gsa/documents/GSA_Decision_Aid.pdf .
- 45.Lwin MO, Panchapakesan C, Sheldenkar A, Calvert GA, Lim LK, Lu J. Determinants of eHealth literacy among adults in China. J Health Commun. 2020 May 03;25(5):385–393. doi: 10.1080/10810730.2020.1776422. [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Questionnaire on COVID-19 preventive behaviors (Japanese version).
Questionnaire on information evaluation and decision-making process skills (Japanese version).