Skip to main content
PLOS One logoLink to PLOS One
. 2023 Oct 4;18(10):e0291229. doi: 10.1371/journal.pone.0291229

Determinants and outcomes of eHealth literacy in healthy adults: A systematic review

Ariesta Milanti 1,*, Dorothy Ngo Sheung Chan 1, Anselmus Aristo Parut 2, Winnie Kwok Wei So 1
Editor: Muhammad Shahzad Aslam3
PMCID: PMC10550189  PMID: 37792773

Abstract

Background

eHealth has shown many benefits in health promotion and disease prevention. For engaging in and taking advantage of eHealth, eHealth literacy is essential. This systematic review aims to summarise and examine the existing evidence on determinants and outcomes of eHealth literacy in healthy adults.

Methods

We searched the relevant peer-reviewed articles published in English in six databases: MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest. The inclusion criteria of the review were: 1) studies examining ‘eHealth literacy’, which refers to the ability to search, select, judge and apply online health information to address or solve health problems and to improve wellbeing; 2) the type of study included observational and experimental studies, mixed method studies or qualitative studies; 3) the participants were healthy adults; 4) the main outcomes were the determinants (i.e. influencing or associated factors) and outcomes (i.e. benefits and disadvantages) of eHealth literacy. Articles were assessed by two reviewers using the Joanna Briggs Institute critical appraisal tool. A conceptual model to map the determinants and outcomes of eHealth literacy in healthy adults into the non-modifiable, individual, social and community networks and structural layers was developed to classify the identified determinants and outcomes.

Results

Forty-four studies were included in this review, of which 43 studies were cross-sectional and one was qualitative. eHealth literacy determinants included age, sex, literacy factors, socioeconomic factors and language. eHealth literacy outcomes included better general health promotion behavior, COVID-19 preventive behaviors, psychological wellbeing, social support, self-rated health and health service utilisation.

Conclusions

Our results showed that eHealth literacy has multi-layered determinants and positive outcomes. Different strategies at different policy levels are needed to improve the eHealth literacy levels of healthy adults.

Introduction

Advances in information and communication technologies (ICT) have benefitted services in all sectors including health. The use of ICT for supporting health and health-related fields, including health care services, health surveillance, health literature and health education can be referred to as electronic health (eHealth) [1]. eHealth is currently recognised as one of the fastest growing areas in today’s health field [2]. The World Health Organisation also acknowledged the potential of eHealth to achieve the Sustainable Development Goals, especially in supporting health promotion and disease prevention in all countries, by enhancing the quality, accessibility and affordability of health services [3]. This can be achieved by various means of eHealth including telehealth, eLearning, mHealth and social media [4].

In order to engage in, and take the advantage of eHealth, individuals need eHealth literacy [4]. eHealth literacy may be defined as “one’s ability to seek, find, understand, appraise and apply the health information from electronic sources to address or solve a health problem” [5]. eHealth literacy is a complex entity. The challenge of identifying, appraising and understanding health information from online sources is already complex, especially when the information is to be used to make health-related decisions or to inform health behavioral changes [6]. eHealth literacy is also dynamic; it is a process-oriented skill that evolves over time [5]. Given ICT’s rapid development and changes in personal, social and environmental contexts, individuals must continue to develop their eHealth literacy for their own empowerment, in order to achieve health-related outcomes [5, 7].

Evidence indicates that eHealth literacy is associated with health outcomes, such as health promoting behaviors and facilitating psychological well-being across various population groups [6, 8, 9]. On the other hand, according to Norman and Skinner [5], eHealth literacy can be associated with individual’s educational background, health status and presenting health issue when encountering the eHealth resources, motivation for seeking the information and the technology used. Apart from these hypotheses, empirical studies have found many other socio-demographic and literacy variables as important determinants of eHealth literacy [1014].

Previous systematic reviews related to eHealth literacy were carried out across different populations, including college students [15], older adults [16, 17], older adults in China [8], people living with HIV [18], and underserved population in the United States [19]. Previous systematic reviews have also addressed eHealth literacy interventions [17, 20, 21], eHealth literacy tools [22, 23], health literacy in eHealth era [24], eHealth definition [25], policy issues in eHealth [26], and eHealth literacy’s relationships with health-related behaviors [27]. However, to the best of our knowledge, there is still no systematic review to summarise the evidence of eHealth literacy’s determinants and outcomes, unrelated to a specific intervention. To address this perceived gap, this systematic review aims to summarise and appraise the existing research which has examined the determinants and outcomes of eHealth literacy in healthy adults. Understanding the determinants and outcomes of eHealth literacy can provide valuable insights into the factors that influence individuals’ ability to use technology to access, understand, and use health information, and the impact that eHealth literacy has on health outcomes. This information can then be used to develop interventions and policies to promote eHealth literacy and improve health outcomes in healthy adults. Focusing on the adult population is important since this population makes up the largest age group in the world [28]. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy.

Methods

The protocol for this review was registered in PROSPERO International Prospective Register of Systematic Reviews (reference number: CRD42021271346).

Search strategy

We searched six electronic databases: MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest to identify relevant studies. Relevant grey literature including dissertations and theses were identified from ProQuest. These databases were selected since they are among the largest and most widely recognized as authoritative sources in the fields of healthcare, medical, nursing, psychology, and behavioral sciences. They offer a comprehensive coverage of literature relevant to the eHealth literacy topic. Including other databases might introduce redundancy in the review process. These databases were chosen to strike a balance between comprehensive coverage and efficiency.

A search strategy was developed to capture the key elements of the topic of interest, i.e.: determinants and outcomes of eHealth literacy. Keywords were combined using AND and OR Boolean operators. The year of publication was not limited. The detailed search strategy is presented in S1 Table.

Selection process

Studies were included if they met these criteria: 1) studies examining ‘eHealth literacy’; 2) the type of study included observational and interventional studies, mixed methods studies, and qualitative studies; 3) population/participants were healthy adults (defined as individuals aged over 18–64 years [29] without significant chronic health conditions or disabilities); 4) the main outcomes were the determinants (i.e. influencing or associated factors) and outcomes (i.e. positive and negative outcomes) of eHealth literacy. Intervention and comparator were beyond the scope of this review. Reviews, editorials, expert’s opinion, letters and conference papers were excluded. Articles written in non-English languages were also excluded.

All citations were managed using EndNote 20 software (Clarivate Analytics, PA, USA). Duplicates were identified and removed electronically (using ’Find Duplicates’ feature in EndNote) and manually. After removing duplicates, the titles and abstracts of the records were screened against the inclusion and exclusion criteria by two independent reviewers (AM and AAP), using EndNote 20 software. The records which clearly did not meet the inclusion criteria were excluded from the review. Full texts of all retained articles were also screened independently by two reviewers (AM and AAP). Disagreement was resolved by discussion between the two reviewers. The selection process and reasons for exclusion were documented using a PRISMA flow diagram.

Assessment of methodological quality

AM and AAP independently carried out the critical appraisal for each study. The Joanna Briggs Institute (JBI) critical appraisal tools were used, according to each study’s design, to assist in examining the trustworthiness and risk of bias of the included studies [30]. The JBI critical appraisal tools are widely recognized within the field of evidence synthesis for their comprehensive approach to evaluating the risk of bias based on the study’s design, conduct, and analysis. While other tools, such as the Cochrane Risk of Bias Tool, Newcastle-Ottawa Scale (NOS), Appraisal tool for Cross-Sectional Studies (AXIS), and A measurement Tool to Assess Systematic Reviews (AMSTAR 2), mostly focus on specific study types and their respective attributes, JBI tools offer a broader approach in comprehensively assessing various study designs. Therefore, the JBI tools were deemed suitable for systematically reviewing the determinants and outcomes of eHealth literacy across different research methodologies.

Data collection process

AM extracted the data using a standardised extraction sheet in Microsoft Word to record the study characteristics of included articles. Afterwards, AAP checked and amended the data extraction results as required.

Data items

The information included: a) the details of the study’s aim, b) design, c) sample size, d) types of participants, e) participants’ characteristics, f) eHealth literacy instrument and g) mean score of eHealth literacy. In addition, the determinants and outcomes were also extracted from the included studies.

Data synthesis

A conceptual model illustrating the determinants and outcomes of eHealth literacy was developed, based on Dahlgren and Whitehead’s Determinants of Health Model [31]. According to Dahlgren and Whitehead [31], there are a series of layers which influence health; every layer has its own implication for policy making. The outermost layer is the major structural environment which covers the cultural and environmental conditions. Under the major structural environment, there are the living and working conditions which are determined by various factors including education, employment and health care. Next, there are the social and community networks where an individual can have mutual support from family, friends and the local community. The inner layer after social support involves individual factors; for example, eating and smoking. Finally, the innermost layer contains the non-modifiable factors over which we have little or no control, including age and sex [31]. Data from the included studies were synthesised and applied to this model by extracting the information on the determinants and outcomes of eHealth literacy and mapping the findings onto the layers of Dahlgren and Whitehead’s model. Finally, areas where interventions or policies can be targeted related to each determinant were identified.

Results

Study selection

Forty-four studies were eligible for inclusion (Fig 1). The studies were from the US (n = 9), China (n = 6), South Korea (n = 5), Taiwan (n = 4), Japan (n = 3), Israel (n = 2), Ethiopia (n = 2), Pakistan (n = 2), Hong Kong (n = 2), Greece (n = 2), Cyprus and Greece (n = 1), Singapore (n = 1), Ghana (n = 1), Vietnam (n = 1), Denmark (n = 1), Turkey (n = 1), and the UK (n = 1).

Fig 1. PRISMA flowchart of study selection process.

Fig 1

This review included 43 cross-sectional studies and one qualitative study (S1 Table). As the causal relationship could not be drawn from the cross-sectional study design, the determinants and outcomes were putative only.

Eighteen (41.0%) studies recruited lay people, mostly internet users [10, 3248]. Eighteen (41.0%) studies involved university students as their participants [9, 4965]. Five (11.3%) studies had health care professionals as the participants [6670]. Two (4.5%) studies recruited carers of children with special health care needs [11, 12]. Lastly, one (2.2%) study involved carers of people with dementia [71].

Thirty four (77.2%) studies [10, 3239, 4148, 5053, 56, 6264] used Norman and Skinner’s eHealth literacy scale (eHEALS) [72]. Four (9.1%) studies [54, 55, 61, 65] used the Chiang et al. eHealth literacy scale (eHLS) [73]. Two (4.5%) studies [9, 57] used Van Der Vaart and Drossaert’s Digital Health Literacy Instrument (DHLI). Two (4.5%) studies [40, 60] used eHealth Literacy Questionnaire (eHLQ) developed by Norgaard et al. (2015) [74]. One (2.2%) study used the European Commission’s digital competency framework [70]. One study (2.2%) [49] was a qualitative study and did not use any eHealth literacy measuring instrument.

Quality assessment in studies

The quality assessment, using the JBI instrument for each included study, is available in the Supplementary materials. We quantified the number of the critical appraisal components which were fulfilled in each study. The majority of the quantitative studies (n = 24) had 6 out of 8 components fulfilled. Most of the unfulfilled criteria were about identification of confounding factors and strategies to address them. Meanwhile, the qualitative study (n = 1) had 7 out of 10 components fulfilled. This qualitative study did not state the cultural or theoretical location of the researcher, the influence of the researcher on the research, and the ethical considerations of the study. None of the papers was excluded based on the quality evaluation.

Determinants of eHealth literacy

Summary of findings from studies which address the determinants of eHealth literacy are presented in Table 1 and is illustrated in Fig 2.

Table 1. Determinants of eHealth literacy.

Category Sub-category Determinant References
Non-modifiable factors Age Younger age [1012, 32, 39, 69]
Older age [46, 62]
Sex Male [32, 37, 46, 67]
Female [57]
Individual factors Literacy Health literacy [71]
Internet literacy [32, 46]
Computer literacy [39]
Information literacy [39]
Digital literacy [62, 70]
Online health information seeking behavior Online health information seeking behavior [52, 63]
Online health information searching experience [47]
Health information orientation [46]
Frequently sought health information [54]
Internet usage period of over 15 years [62]
Intensity of Instagram use [50]
Effort in operating ICT devices [47]
Satisfaction with information [57]
Importance of information [57]
Higher perceived trust in online information [37]
Living and working conditions Education Higher education [10, 11, 39, 41, 46, 47, 60, 70]
Higher academic level/e.g. year 1, 2, 3 [62]
Doing medical major [54]
Employment Higher income [41, 46, 70]
Government employee [70]
Physician [69]
Years of experience < 5 years [69]
Collegial nurse-physician relationships [68]
Nurse participation in hospital affairs [68]
Health care service A very or fairly easy ability to pay for medication [67]
A very or fairly easy ability to pay for doctors [67]
ICT infrastructure Availability and accessibility of ICT resources [49]
Simple and concise presentation of health information [49]
Categorisation of authentic and unauthentic websites [49]
General socio-economic, cultural and environmental conditions Language Language [11]

Fig 2. Conceptual model of eHealth literacy determinants and outcomes.

Fig 2

Non-modifiable determinants

Age and sex were found to be the non-modifiable determinants of eHealth literacy (Fig 2). Studies found inconsistencies in how these two factors were linked with eHealth literacy. In six studies, younger age was found to be associated with higher eHealth literacy [1012, 32, 39, 69]. Whereas, in a study conducted among online users in China, older age was found to be related with higher eHealth literacy [46]. Inconsistency was also found with regards to sex. Being male was found to be associated with higher eHealth literacy in four studies [32, 37, 46, 67], while being female was found to be related with higher eHealth literacy in only one study [57].

Individual determinants

In the individual layer of eHealth literacy determinant model (Fig 2), there are literacy factors and online health information-seeking behavior factors. The literacy factors included health literacy [71], internet literacy [32, 46], computer literacy [39], information literacy [39] and digital literacy [62, 70]. The online health information seeking behaviors included: online health information seeking behavior [52, 63]; health information orientation i.e. the willingness of people to look for health information [46]; internet usage period of over 15 years [62] and intensity of Instagram use [50]. In addition, the users’ satisfaction with information and the importance of information influenced eHealth literacy. A higher perceived trust in online information also influenced eHealth literacy [37, 57]. Moreover, Magsamen-Conrad et al. found that less effort in operating ICT devices was associated with higher eHealth literacy [47].

Determinants related to living and working conditions

For the social and community network layer of determinant model, there was no factor found to be the determinant of eHealth literacy. However, for the next layer (living and working conditions) the factors of: education, employment, living conditions and health care services were identified.

Higher education was consistently associated with higher eHealth literacy, as indicated in eight studies [10, 11, 39, 41, 46, 47, 60, 70]. Still related with education, studies conducted among college students found that the higher the academic level (i.e. year 3 compared to year 1) and the students’ major subject both influenced eHealth literacy [54, 62].

Higher income was consistently related to higher eHealth literacy [41, 46, 70]. Studies conducted among health care professionals in Ethiopia found that being a government employee, being a physician, and having less than five years working experience were found to be associated with higher eHealth literacy [69, 70].

Related to the health care service, personal health care financing was found to be linked with eHealth literacy. The ability to pay for medications and doctors were associated with higher eHealth literacy [67].

Other determinants of eHealth literacy are related to ICT infrastructure. In a qualitative study conducted among college students in Pakistan, Adil et al. identified that the access to ICT resources, categorisation of authentic and unauthentic websites and presentation of eHealth information influenced eHealth literacy [49].

General socio-economic, cultural and environmental determinants

Finally, in the outermost layer of the eHealth literacy determinant model, which represents the general socio-economic and cultural environments (Fig 2), there is the factor of language to consider. Knapp et al. in a study about the eHealth literacy of low-income parents whose children have special health care needs, found that non-English speaking parents were more likely to demonstrate lower eHealth literacy levels [11].

Outcomes of eHealth literacy

A summary of findings from the studies which addressed the outcomes of eHealth literacy is presented in Table 2 and is illustrated in Fig 2.

Table 2. Outcomes of eHealth literacy.

Category Sub-category Outcomes References
Individual lifestyle factors Health promotion behavior Better general health and future intention to maintain health [58]
Health promoting behavior [44, 45, 63, 64, 66].
Health responsibility [66]
Self-care competence [63]
Exercise [33, 39, 53, 58, 61, 67]
Better physical activity among nurses working on fixed-day and day-evening shifts [66]
Healthy eating [67]
A balanced diet [33, 55, 58, 61]
Lower unhealthy food intake [55]
Regular breakfast [53]
Regular eating habit [55]
Lower risk of being overweight [53]
Sleep [58]
Getting vaccinations [58]
Maintenance of sexual health [58]
A lifestyle free of harmful substances [58]
Colorectal cancer screening practice [48]
Preventive behavior Higher adherence to COVID-19 preventive behaviors [10, 41, 45, 51, 56, 64, 67]
Knowledge about disease Higher COVID-19 knowledge [41]
Higher Colorectal cancer (CRC) knowledge [48]
Attitude about disease Lower COVID-19 conspiracy beliefs [41]
More confidence in finding cancer information [36]
Psychological wellbeing Better Psychological wellbeing [9, 35]
Higher self-actualisation [66]
Lower depression [40]
Lower insomnia [40]
Lower PTSD [40]
Better Stress management [66]
Higher sense of coherence [57]
Social and community networks Stable friendship and social support Stable friendships/ social support [58]
Better interpersonal relations [66]
Online social capital Online bridging social capital [50]
Living and working conditions Self-rated health Better perceived health outcomes [43]
Self-rated health [34, 55, 60, 70]
Lower likelihood of suspected COVID-19 symptoms [67]
Health service utilisation Health service utilisation [65]
Health-app utilisation Health-app use efficacy [42]
The extent of health-app use [42]

Individual lifestyle-related outcomes

Many studies included in this review were conducted during the COVID-19 pandemic and the outcomes were also related to COVID-19. Seven studies found that higher eHealth literacy was associated with higher adherence to COVID-19 preventive behaviors [10, 41, 45, 51, 56, 64, 67]. A web-based survey of US adults found that higher eHealth literacy was also related to higher COVID-19 knowledge and lower levels of COVID-19 conspiracy beliefs [41]. In addition, a study among health care professionals in Vietnam found that higher eHealth literacy was also linked to a lower likelihood of having suspected COVID-19 symptoms [67].

In terms of psychological outcomes, two studies indicated that higher eHealth literacy was associated with better psychological wellbeing [9, 35]. Another study conducted among hospital nurses in South Korea showed that higher eHealth literacy was associated with a sense of higher self-actualisation (i.e. an individual’s perception of having a sense of purpose in life and thriving for self-development) and better self-management [66]. The results of a survey conducted in China during the COVID-19 pandemic suggested that higher eHealth literacy was related to lower depression, lower insomnia and lower post-traumatic stress disorder (PTSD) [40]. Additionally, a survey amongst university students in Pakistan found a higher sense of coherence of the COVID-19 situation, which encompassed the senses of comprehensibility, manageability and meaningfulness of the COVID-19, was associated with higher eHealth literacy [57].

Five studies showed that eHealth literacy was related to health promoting behavior [44, 45, 63, 64, 66]. eHealth literacy was also associated with general health and future intention to maintain health, according to a study of college students in the US [58]. eHealth literacy was also linked with the issue of personal health responsibility [66]. Moreover, a study conducted among nursing students in South Korea showed that eHealth literacy was associated with self-care competence [63].

Still related to health promoting behaviors, several studies examined the health promoting behaviors more specifically, including exercise, health eating, sleep, a lifestyle free of harmful substances and maintenance of sexual health. Six studies found that eHealth literacy was associated with exercise [33, 39, 53, 58, 61, 67]. A study in South Korea showed that eHealth literacy was related to better physical activity among nurses working on fixed-day and day-evening shifts, but not the among the nurses working rotating shifts [66]. Furthermore, eHealth literacy was associated with better health behaviors including sleep, getting vaccinations, maintenance of sexual health and a lifestyle free of harmful substances [58].

Four studies suggested that eHealth literacy was linked with a balanced diet [33, 55, 58, 61], while one study suggested that eHealth literacy was linked with higher likelihood of healthy eating [67]. A study in Taiwanese college students also found that eHealth literacy was associated with lower intake of unhealthy food and the maintaining of regular eating habits. A study conducted in Japan showed that college students with higher eHealth literacy were more likely to have regular breakfast and to be at lower risk of being overweight [53].

With regards to colorectal cancer (CRC), a study was conducted among internet users in Japan [48]. This study found that eHealth literacy was associated with CRC knowledge and practice [48].

Social and community networks-related outcomes

In the social and community networks layer, stable friendships or social support were found to be related with eHealth literacy [58]. People with higher eHealth literacy were more likely to have better interpersonal relationships, according to a study in South Korea [66]. Moreover, people with higher eHealth literacy was also found to be have better online social capital; that is, the accessibility to ties on an online network, in which the latter promotes group norms and trust [50].

Living and working conditions outcomes

In the next layer, regarding living and working conditions, health outcomes and health service/health app utilisation were found to be linked to eHealth literacy. According to four studies, eHealth literacy was associated with self-rated health [34, 55, 60, 70]. A study in Israel found that eHealth literacy was related to better perceived health outcomes [43]. On the other hand, eHealth literacy was also found to be linked with health service utilisation [65], health-app use efficacy and the extent of health-app use [42].

The model suggests that eHealth literacy is shaped by a complex interaction of multi-layered determinants (i.e. non-modifiable factors, individual lifestyle, social and community networks, living and working conditions, and general socio-economic and cultural conditions). As a result, eHealth literacy is also associated with various outcomes.

Discussion

This review has attempted to consolidate the determinants and outcomes of eHealth literacy in healthy adults. We categorised the determinants and outcomes of the eHealth literacy into layers which could influence health, according to Dahlgren and Whitehead’s model [31]. Dahlgren and Whitehead’s model is a useful resource from which to outline strategic approaches to promote greater equity in health through different policy levels for interventions [31], in this case related to eHealth literacy.

In the first layer of eHealth literacy determinants, we identified age and sex as the non-modifiable factors. There are conflicting findings regarding these two factors, but, overall, most studies in this review support ‘younger age’ and ‘male sex’ to be linked with higher eHealth literacy level. One study’s result, that older age was associated with better eHealth literacy, is possibly because the participants were heavy internet users regardless of age [46]. However, this review did not include studies among older adults, therefore, comparisons between younger and older age participants cannot be made. In terms of sex, it is quite surprising that men were more likely to have a higher level of eHealth literacy than women. Prior studies showed that women used health apps [75] and searched health information online [76, 77] more often than men did. Women were also found to be more eHealth literate than men and perceived online information quality better [78, 79]. More studies are needed to clarify how sex differences determine eHealth literacy.

In the second layer of the eHealth literacy determinants, there are individual factors which comprised literacy issues and online health information seeking behavior issues. According to Norman and Skinner’s Lily Model of eHealth literacy, eHealth literacy is the combination of six core literacies, i.e. traditional literacy, media literacy, information literacy, health literacy, scientific literacy and computer literacy [5]. In this review, three literacies including health literacy, computer literacy and information literacy were found to be the determinants of eHealth literacy. However, the other three literacies in the model: traditional, scientific, and media are hypotheses which still need to be tested and proven. Traditional literacy, which is defined as the basic literacy skills of reading, writing, and understanding written language, is comprised of simple tasks which might be overlooked in eHealth literacy research. Despite being so-called ‘traditional’, such literacy is essential in the era of Web 2.0, when internet platforms have more focus on community building, data sharing and co-production [80]. Traditional literacy can be the relevant ability to determine the relevance of online information, as well as in creating self-generated content. According to Norman [7], eHEALS, which is the most frequently used eHealth literacy tool (as noted in this review), is arguably incomplete when required to measure eHealth literacy for the Web 2.0. Further studies are deemed necessary to update eHEALS to fit its purpose in the Web 2.0 internet era. Subscales to assess communication skills in online social interactions and in synthesising contents are some instances of items that could be developed for updated version of eHEALS. Studies are also needed to assess the traditional literacy, scientific literacy and media literacy. The latter is especially important in combating disinformation and bridging the digital divide [81].

In the living and working conditions layer, there is socioeconomic status. This factor includes education, employment, income and ease of paying for health care, all of which play important roles in determining the eHealth literacy levels of healthy adults. This finding is consistent with the result of a previous systematic review of eHealth literacy in an underserved population in the US [19]. In the countries where there is no universal health coverage, such as the US, those who are poor and uninsured may have lesser access to health care, confirming their status as a vulnerable and underserved population [19]. Economically disadvantaged people may also have decreased opportunity to access technology [19]. Even if they have access to mobile devices and the internet, this population is also more likely to have lower levels of education; the latter being a strong predictor of eHealth literacy, as shown in several studies [10, 11, 41, 47]. Therefore, it is particularly important to assess the population with lower socioeconomic status regarding their eHealth literacy levels, and to intervene where necessary, in order to address the digital divide between this population and the wider population with higher levels of education and therefore of eHealth literacy.

Referring to Dahlgren and Whitehead’s model [31], different policy levels may apply in different layers of the health determinant. Policy level 1 is for the major structural environment, in which the language factor is situated. For addressing this determinant, national-level strategies, such as incorporating language services in the national health care system, are needed [82]. Having national and health industry investments to develop population-based language services by using ICT is also recommended [82]. Furthermore, policy level 2, which aims to improve living and working conditions can achieve that aim by, for example, a) providing the welfare benefits through the social security sector, and improving b) health care services, c) the education system and d) the ICT infrastructure [31]. Policy level 3, aiming at strengthening social and community support is not applicable, as there is no eHealth literacy determinant identified in this layer. Policy level 4 aims at influencing individual lifestyles [31]. The policy can include developing programmes to enhance eHealth literacy skills. Finally, for the innermost layer, i.e. the non-modifiable factor, the intervention can be integrated into the educational improvement of the eHealth literacy for older adults of both sexes and women of all ages.

With regard to the outcomes, eHealth literacy was found to have several positive outcomes. Of note, most eHealth literacy studies within this review were conducted during the COVID-19 pandemic. Indeed, in this pandemic, eHealth literacy became more relevant than ever, since most of the COVID-19 information, including misinformation and disinformation, is disseminated through the internet [10]. eHealth literacy can positively influence COVID-19 preventive behaviors [10, 41, 45, 51, 56, 64, 67], knowledge and attitude about disease [41], and facilitate psychological wellbeing [9, 35]. General health promotion behaviors such as healthy eating, exercise and sleep are also the outcomes of eHealth literacy [44, 45, 63, 64, 66]. In addition, eHealth literacy positively influences social and community networks, as well as living and working conditions [58]. Nonetheless, these are putative outcomes only. Randomised controlled trials are needed to infer the causal relationships between eHealth literacy and these outcome benefits.

A systematic review on the influencing factors of eHealth literacy among Chinese older adults [8] showed several similar findings with our study results, i.e. age, sex, education, socioeconomic status, and language influenced the levels of eHealth literacy [8]. These similarities suggest the factors which may be the universal determinants of eHealth literacy across different culture and population. However, our present study found that eHealth literacy was also influenced by literacy factors and ICT infrastructure. Another difference is that physical and psychological conditions, marital status, and being the family carer were found to be associated with the Chinese older adults’ levels of eHealth literacy [8]. These differences may indicate the factors that may be unique to older adult population, especially in China. With regards to outcomes, similar to our study findings, a recent systematic review concluded that eHealth literacy is associated with health-promoting behaviors including regular eating and exercise, and compliance with disease prevention behaviors [27]. These similar and different findings show the importance of conducting systematic review to find the consistent and inconsistent patterns across different studies.

Study strengths

The systematic review offers comprehensive summarized evidence of the determinants and outcomes of eHealth literacy in healthy adults. It encompasses a wide range of factors, both non-modifiable and individual, as well as environmental and cultural aspects. In addition, the review acknowledges that different layers of eHealth literacy determinants can have varying policy implications. This recognition is crucial for policymakers and healthcare professionals seeking to enhance eHealth literacy, as it provides insights into targeted interventions and strategies.

Study limitations

As with all systematic reviews, we cannot be fully certain that we have identified all relevant literature. This review only covered six databases and studies published in English. We may have missed potentially eligible studies published in other languages or contained within other databases. We only included articles which measured associations of eHealth literacy with the determinant or outcome variables. Articles presenting only differences between those variables were excluded. This constraint might also limit the findings of the review. Furthermore, we limit our population to healthy adults, who may not be the vulnerable population with regards to eHealth literacy. It is important to note that the studies included a relatively diverse group of healthy adults, e.g. students and healthcare professionals. While such inclusion can provide a more comprehensive picture of eHealth literacy in healthy adults, it can also introduce heterogeneity into the study population. Therefore, careful consideration of how the results is interpreted and generalized is needed.

Conclusions and future directions

This systematic review has contributed to the understanding of the putative determinants and outcomes of eHealth literacy in healthy adults. In summary, the determinants of eHealth literacy include the non-modifiable factors (age, sex); individual factors (literacy, online health information seeking behavior); living and working conditions (education, employment, health care service and ICT infrastructure) and general cultural conditions (particularly language). Whereas, the outcomes of eHealth literacy include health promotion behaviors, COVID-19 preventive behaviors, psychological wellbeing, better social and community networks, better self-rated health and better health service utilisation. Different layers of eHealth literacy determinants can have different policy implications as they aim to improve eHealth literacy.

Future studies should incorporate artificial intelligence (AI) into the eHealth landscape. One possible direction is the expansion of the eHealth Literacy tool to include AI-driven health information. AI can also be used to develop inclusive eHealth solutions that are tailored to different literacy levels. The key to AI’s influence is personalization, which enables the creation of eHealth intervention finely tuned to individual literacy levels. This personalisation encourages more effective health information dissemination while improving accessibility.

Supporting information

S1 Table. Details of search strategy.

(PDF)

S2 Table. Characteristics of included studies.

(PDF)

S3 Table. Joanna-Briggs institute critical appraisal for included studies.

(PDF)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

The author(s) received no specific funding for this work.

References

  • 1.World Health Organisation (2005) WHA58.28 eHealth [Google Scholar]
  • 2.World Health Organisation (2016) Global Observatory for eHealth. In: Who. http://www.who.int/goe/data/en/ [Google Scholar]
  • 3.World Health Organisation (2018) Seventy-First World Health Assembly [Google Scholar]
  • 4.World Health Organisation (2016) From innovation to implementation: eHealth in the WHO European region [Google Scholar]
  • 5.Norman CD, Skinner HA (2006) eHealth literacy: Essential skills for consumer health in a networked world. J Med Internet Res 8:1–10. 10.2196/jmir.8.2.e9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Levin-Zamir D, Bertschi I (2018) Media health literacy, Ehealth literacy, and the role of the social environment in context. Int J Environ Res Public Health 15:1–12. doi: 10.3390/ijerph15081643 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Norman C (2011) eHealth literacy 2.0: problems and opportunities with an evolving concept. J Med Internet Res 13:2–5. doi: 10.2196/jmir.2035 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Shi Y, Ma D, Zhang J, Chen Jun B (2021) In the digital age: a systematic literature review of the e-health literacy and influencing factors among Chinese older adults. J Public Health (Bangkok). doi: 10.1007/s10389-021-01604-z [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Amoah PA, Leung AYM, Parial LL, et al. (2021) Digital Health Literacy and Health-Related Well-Being Amid the COVID-19 Pandemic: The Role of Socioeconomic Status Among University Students in Hong Kong and Macao. Asia-Pacific J public Heal 10105395211012230. doi: 10.1177/10105395211012230 [DOI] [PubMed] [Google Scholar]
  • 10.Guo Z, Zhao SZ, Guo N, et al. (2021) Socioeconomic Disparities in eHealth Literacy and Preventive Behaviors During the COVID-19 Pandemic in Hong Kong: Cross-sectional Study. J Med Internet Res 23:e24577. doi: 10.2196/24577 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Knapp C, Madden V, Wang H, et al. (2011) Internet use and eHealth Literacy of low-income parents whose children have special health care needs. J Med Internet Res 13:1–13. doi: 10.2196/jmir.1697 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Sarkar M, Sanders LM, Kelleher KJ, Chisolm DJ (2016) Psychosocial Health, e-Health Literacy, and Perceptions of e-Health as Predictors and Moderators of e-Health Use Among Caregivers of Children with Special Healthcare Needs. Telemed J E Health 22:123–131. doi: 10.1089/tmj.2015.0028 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Neter E, Brainin E (2012) eHealth literacy: Extending the digital divide to the realm of health information. J Med Internet Res 14:e19. doi: 10.2196/jmir.1619 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Choi NG, Dinitto DM (2013) The digital divide among low-income homebound older adults: Internet use patterns, ehealth literacy, and attitudes toward computer/internet use. J Med Internet Res 15:1–16. doi: 10.2196/jmir.2645 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 15.Stellefson M, Hanik B, Chaney B, et al. (2011) Ehealth literacy among college students: A systematic review with implications for ehealth education. J Med Internet Res 13:. 10.2196/jmir.1703 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Watkins I, Xie B (2014) eHealth literacy interventions for older adults: A systematic review of the literature. J Med Internet Res 16:1–12. doi: 10.2196/jmir.3318 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Pourrazavi S, Kouzekanani K, Bazargan-Hejazi S, et al. (2020) Theory-based E-health literacy interventions in older adults: a systematic review. Arch Public Health 78:72. doi: 10.1186/s13690-020-00455-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Han HR, Hong H, Starbird LE, et al. (2018) eHealth literacy in people living with HIV: Systematic review. JMIR Public Heal Surveill 20:. doi: 10.2196/publichealth.9687 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Chesser A, Burke A, Reyes J, Rohrberg T (2015) Navigating the digital divide: Literacy in underserved populations in the United States. Informatics Heal Soc Care 41:1–19. 10.3109/17538157.2014.948171 [DOI] [PubMed] [Google Scholar]
  • 20.Car J, Lang B, Colledge A, et al. (2011) Interventions for enhancing consumers’ online health literacy. Cochrane Database Syst Rev. doi: 10.1002/14651858.CD007092.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Jacobs RJ, Lou JQ, Ownby RL, Caballero J (2016) A systematic review of eHealth interventions to improve health literacy. Health Informatics J 22:81–98. doi: 10.1177/1460458214534092 [DOI] [PubMed] [Google Scholar]
  • 22.Collins SA, Currie LM, Bakken S, et al. (2012) Health literacy screening instruments for eHealth applications: A systematic review. J Biomed Inform 45:598–607. doi: 10.1016/j.jbi.2012.04.001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Karnoe A, Kayser L (2015) How is eHealth literacy measured and what do the measurements tell us? A systematic review. Knowl Manag E-Learning 7:576–600. 10.34105/j.kmel.2015.07.038 [DOI] [Google Scholar]
  • 24.Kim H, Xie B (2017) Health literacy in the eHealth era: A systematic review of the literature. Patient Educ Couns 100:1073–1082. doi: 10.1016/j.pec.2017.01.015 [DOI] [PubMed] [Google Scholar]
  • 25.Oh H, Rizo C, Enkin M, Jadad A (2005) What is eHealth (3): A systematic review of published definitions. J Med Internet Res 7:1–12. doi: 10.2196/jmir.7.1.e1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Khoja S, Durrani H, Nayani P, Fahim A (2012) Scope of policy issues in ehealth: Results from a structured literature review. J Med Internet Res 14:1–10. doi: 10.2196/jmir.1633 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Kim K, Shin S, Kim S, Lee E (2023) The Relation between eHealth Literacy and Health-Related Behaviors: Systematic Review and Meta-analysis. J Med Internet Res 25:. doi: 10.2196/40778 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Ritchie H, Roser M (2019) Age Structure. In: Our World Data. https://ourworldindata.org/age-structure. Accessed 17 Apr 2023 [Google Scholar]
  • 29.American Medical Association (2022) Age. In: NIH Style Guid. https://www.nih.gov/nih-style-guide/age. Accessed 17 Apr 2023 [Google Scholar]
  • 30.Moola S, Munn Z, Tufanaru C, et al. (2017) Checklist for Analytical Cross Sectional Studies. Joanna Briggs Inst Rev Man 6. 10.17221/96/2009-CJGPB [DOI] [Google Scholar]
  • 31.Dahlgren G, Whitehead M (1991) Policies and strategies to promote social equity in health [Google Scholar]
  • 32.Abdulai A-FF, Tiffere A-HH, Adam F, Kabanunye MM (2021) COVID-19 information-related digital literacy among online health consumers in a low-income country. Int J Med Inform 145:104322. doi: 10.1016/j.ijmedinf.2020.104322 [DOI] [PubMed] [Google Scholar]
  • 33.Mitsutake S, Shibata A, Ishii K, Oka S (2016) Associations of eHealth Literacy with health behavior among adult internet users. J Med Internet Res 18:e192. doi: 10.2196/jmir.5413 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Neter E, Brainin E, Baron-Epel O (2021) Group differences in health literacy are ameliorated in ehealth literacy. Heal Psychol Behav Med 9:480–497. doi: 10.1080/21642850.2021.1926256 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Özkan O, Özer Ö, Özmen S, Budak F (2022) Investigation of the Perceived Coronavirus Threat, E-Health Literacy, and Psychological Well-Being in Turkey. Soc Work Public Health 37:122–134. doi: 10.1080/19371918.2021.1986451 [DOI] [PubMed] [Google Scholar]
  • 36.Park H, Moon M, Baeg JH oo. (2014) Association of eHealth literacy with cancer information seeking and prior experience with cancer screening. Comput Inform Nurs 32:458–463. doi: 10.1097/CIN.0000000000000077 [DOI] [PubMed] [Google Scholar]
  • 37.Paige SR, Krieger JL, Stellefson ML, et al. (2017) The Influence of eHealth Literacy on Perceived Trust in Online Health Communication Channels and Sources. J Health Commun 22:53–65. doi: 10.1080/10810730.2016.1250846 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Quinn S, Bond R, Nugent R, et al. (2017) Quantifying health literacy and ehealth literacy using existing instruments and browser-based software for tracking online health information seeking behavior. Comput Human Behav 69:256–267. https://doi.org/ 10.1016/j.chb.2016.12.032 [DOI] [Google Scholar]
  • 39.Xesfingi S, Vozikis A (2016) eHealth Literacy: In the Quest of the Contributing Factors. Interact J Med Res 5:e16. doi: 10.2196/ijmr.4749 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Yang BX, Xia L, Huang R, et al. (2021) Relationship between eHealth literacy and psychological status during COVID-19 pandemic: A survey of Chinese residents. J Nurs Manag 29:805–812. doi: 10.1111/jonm.13221 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.An L, Bacon E, Hawley S, et al. (2021) Relationship Between Coronavirus-Related eHealth Literacy and COVID-19 Knowledge, Attitudes, and Practices among US Adults: Web-Based Survey Study. J Med Internet Res 23:e25042. doi: 10.2196/25042 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Cho J, Park D, Lee HE (2014) Cognitive factors of using health apps: systematic analysis of relationships among health consciousness, health information orientation, eHealth literacy, and health app use efficacy. J Med Internet Res 16:e125. doi: 10.2196/jmir.3283 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 43.Hayat TZ, Brainin E, Neter E (2017) With some help from my network: Supplementing eHealth literacy with social ties. J Med Internet Res 19:e98. doi: 10.2196/jmir.6472 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Kim S-H, Son Y-J (2017) Relationships between ehealth literacy and health behaviors in Korean adults. CIN—Comput Informatics Nurs 35:84–90. doi: 10.1097/CIN.0000000000000255 [DOI] [PubMed] [Google Scholar]
  • 45.Li X, Liu Q (2020) Social media use, eHealth literacy, disease knowledge, and preventive behaviors in the COVID-19 pandemic: Cross-sectional study on chinese netizens. J Med Internet Res 22:e19684. doi: 10.2196/19684 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Lwin MO, Panchapakesan C, Sheldenkar A, et al. (2020) Determinants of eHealth Literacy among Adults in China. J Health Commun 25:385–393. doi: 10.1080/10810730.2020.1776422 [DOI] [PubMed] [Google Scholar]
  • 47.Magsamen-Conrad K, Wang F, Tetteh D, et al. (2020) Using Technology Adoption Theory and a Lifespan Approach to Develop a Theoretical Framework for eHealth Literacy: Extending UTAUT. Health Commun 35:1435–1446. doi: 10.1080/10410236.2019.1641395 [DOI] [PubMed] [Google Scholar]
  • 48.Mitsutake S, Shibata A, Ishii K, Oka K (2012) Association of ehealth literacy with colorectal cancer knowledge and screening practice among internet users in Japan. J Med Internet Res 14:1–11. doi: 10.2196/jmir.1927 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Adil A, Usman A, Jalil A (2020) Qualitative analysis of digital health literacy among university students in Pakistan. J Hum Behav Soc Environ 31:771–781. 10.1080/10911359.2020.1812462 [DOI] [Google Scholar]
  • 50.Paige SR, Stellefson M, Chaney BH, et al. (2017) Examining the Relationship between Online Social Capital and eHealth Literacy: Implications for Instagram Use for Chronic Disease Prevention among College Students. Am J Heal Educ 48:264–277. doi: 10.1080/19325037.2017.1316693 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Qin N, Shi S, Ma G, et al. (2022) Associations of COVID-19 Risk Perception, eHealth Literacy, and Protective Behaviors Among Chinese College Students Following Vaccination: A Cross-Sectional Study. Front Public Heal 9:1–9. doi: 10.3389/fpubh.2021.776829 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 52.Suri VR, Majid S, Chang Y-K, et al. (2016) Assessing the influence of health literacy on health information behaviors: A multi-domain skills-based approach. Patient Educ Couns 99:1038–1045. doi: 10.1016/j.pec.2015.12.017 [DOI] [PubMed] [Google Scholar]
  • 53.Tsukahara S, Yamaguchi S, Igarashi F, et al. (2020) Association of eHealth Literacy with lifestyle behaviors in university students: Questionnaire-based cross-sectional study. J Med Internet Res 22:e18155. doi: 10.2196/18155 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Yang SC, Luo Y-F, Chiang C (2017) The associations among individual factors, ehealth literacy, and health-promoting lifestyles among college students. J Med Internet Res 19:e15. doi: 10.2196/jmir.5964 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Yang SC, Luo YF, Chiang SC (2019) Electronic Health Literacy and Dietary Behaviors in Taiwanese College Students: Cross-Sectional Study. J Med Internet Res 21:e13140. doi: 10.2196/13140 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Yuan T, Liu HHR, Li XD, Liu HHR (2020) Factors Affecting Infection Control Behaviors to Prevent COVID-19: An Online Survey of Nursing Students in Anhui, China in March and April 2020. Med Sci Monit 26:e925877. doi: 10.12659/MSM.925877 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Zakar R, Iqbal S, Zakar MZ, Fischer F (2021) COVID-19 and health information seeking behavior: Digital health literacy survey amongst university students in Pakistan. Int J Environ Res Public Health 18:4009. doi: 10.3390/ijerph18084009 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Britt RK, Collins WB, Wilson K, et al. (2017) eHealth Literacy and Health Behaviors Affecting Modern College Students: A Pilot Study of Issues Identified by the American College Health Association. J Med Internet Res 19:e392. doi: 10.2196/jmir.3100 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Chang Y-S, Zhang Y, Gwizdka J (2021) The effects of information source and eHealth literacy on consumer health information credibility evaluation behavior. Comput Human Behav 115:N.PAG-N.PAG. 10.1016/j.chb.2020.106629 [DOI] [Google Scholar]
  • 60.Holt KA, Overgaard D, Engel LV, Kayser L (2020) Health literacy, digital literacy and eHealth literacy in Danish nursing students at entry and graduate level: a cross sectional study. BMC Nurs 19:22. doi: 10.1186/s12912-020-00418-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Huang CL, Yang S-C, Chiang C-H (2020) The associations between individual factors, ehealth literacy, and health behaviors among college students. Int J Environ Res Public Health 17:2108. doi: 10.3390/ijerph17062108 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Kim S, Jeon J (2020) Factors influencing eHealth literacy among Korean nursing students: A cross-sectional study. Nurs Heal Sci 22:667–674. doi: 10.1111/nhs.12711 [DOI] [PubMed] [Google Scholar]
  • 63.Kim S, Oh J (2021) The relationship between e-health literacy and health-promoting behaviors in nursing students: A multiple mediation model. Int J Environ Res Public Health 18:5804. doi: 10.3390/ijerph18115804 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Li S, Cui G, Kaminga AC, et al. (2021) Associations between health literacy, ehealth literacy, and covid-19-related health behaviors among chinese college students: Cross-sectional online study. J Med Internet Res 23:e25600. doi: 10.2196/25600 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 65.Luo YF, Yang SC, Chen A-SS, et al. (2018) Associations of ehealth literacy with health services utilization among college students: Cross-sectional study. J Med Internet Res 20:45. doi: 10.2196/jmir.8897 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 66.Cho H, Han K, Park BK (2018) Associations of eHealth literacy with health-promoting behaviors among hospital nurses: A descriptive crosssectional study. J Adv Nurs 74:1618–1627. 10.1111/jan.13575 [DOI] [PubMed] [Google Scholar]
  • 67.Do BN, Tran T V., Phan DT, et al. (2020) Health literacy, ehealth literacy, adherence to infection prevention and control procedures, lifestyle changes, and suspected COVID-19 symptoms among health care workers during lockdown: online survey. J Med Internet Res 22:e22894. doi: 10.2196/22894 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Kritsotakis G, Andreadaki E, Linardakis M, et al. (2021) Nurses’ ehealth literacy and associations with the nursing practice environment. Int Nurs Rev 1–7. doi: 10.1111/inr.12650 [DOI] [PubMed] [Google Scholar]
  • 69.Shiferaw KB, Mehari EA (2019) Internet use and eHealth literacy among health-care professionals in a resource limited setting: a cross-sectional survey. Adv Med Educ Pract 10:563–570. doi: 10.2147/AMEP.S205414 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Shiferaw KB, Tilahun BC, Endehabtu BF (2020) Healthcare providers’ digital competency: a cross-sectional survey in a low-income country setting. BMC Health Serv Res 20:1021. doi: 10.1186/s12913-020-05848-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 71.Efthymiou A, Middleton N, Papastavrou E, Charalambous A (2021) Health literacy and eHealth literacy and their association with other caring concepts among carers of people with dementia: A descriptive correlational study. Health Soc Care Community. doi: 10.1111/hsc.13341 [DOI] [PubMed] [Google Scholar]
  • 72.Norman CD, Skinner HA (2006) eHEALS: The eHealth literacy scale. J Med Internet Res 8:1–7. doi: 10.2196/jmir.8.4.e27 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Chiang C, Yang S, Hsu W (2015) Development and validation of the e-health literacy scale and investigation of the relationships between e-health literacy and healthy behavior among undergraduate students in Taiwan. Formosa J Ment Heal 28:389–420 [Google Scholar]
  • 74.Norgaard O, Furstrand D, Klokker L, et al. (2015) The e-health literacy framework: A conceptual framework for characterizing e-health users and their interaction with e-health systems. Knowl Manag E-Learning 7:522–540. 10.34105/j.kmel.2015.07.035 [DOI] [Google Scholar]
  • 75.Rising CJ, Jensen RE, Moser RP, Oh A (2020) Characterizing the US population by patterns of mobile health use for health and behavioral tracking: Analysis of the national cancer institute’s health information national trends survey data. J Med Internet Res 22:1–15. doi: 10.2196/16299 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Escoffery C (2018) Gender Similarities and Differences for e-Health Behaviors among U.S. Adults. Telemed e-Health 24:335–343. doi: 10.1089/tmj.2017.0136 [DOI] [PubMed] [Google Scholar]
  • 77.Bidmon S, Terlutter R (2015) Gender differences in searching for health information on the internet and the virtual patient-physician relationship in Germany: Exploratory results on how men and women differ and why. J Med Internet Res 17:e156. doi: 10.2196/jmir.4127 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Yasin B, Ozen H (2011) Gender Differences in The Use of Internet for Health Information Search. Ege Akad Bakis (Ege Acad Rev 11:229–229. 10.21121/eab.2011219567 [DOI] [Google Scholar]
  • 79.Ozen H (2021) Gender Difference in eHealth Literacy: Empirical Evidence from Turkey. Int J Acad Res Bus Soc Sci 11:1058–1068. 10.6007/ijarbss/v11-i4/9769 [DOI] [Google Scholar]
  • 80.Fuchs C (2011) Web 2.0, prosumption, and surveillance. Surveill Soc 8:288–308. 10.24908/ss.v8i3.4165 [DOI] [Google Scholar]
  • 81.Hicks-Goldston C, Ritchart A (2019) The New Digital Divide: Disinformation and Media Literacy in the U.S. Media Lit Acad Res 2:49–60 [Google Scholar]
  • 82.Partida Y (2007) Addressing language barriers: Building response capacity for a changing nation. J Gen Intern Med 22:347–349. doi: 10.1007/s11606-007-0367-1 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Guglielmo Campus

14 Feb 2023

PONE-D-22-35330

Determinants and outcomes of eHealth literacy in healthy adults: A systematic review

PLOS ONE

Dear Dr. Milanti,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Mar 31 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Guglielmo Campus, Ph.D DDS

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

3. We note you have included a table to which you do not refer in the text of your manuscript. Please ensure that you refer to Table 4 in your text; if accepted, production will need this reference to link the reader to the Table.

4. Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Partly

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: I Don't Know

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for the opportunity to read this paper. It address an important topic and contributes to the body of knowledge in this field. I only have few minor comments for authors' consideration.

Introduction

- Please elaborate why the authors want to understand eHealth literacy in healthy adults?

- Why it is important to understand determinants and outcomes?

Results

- It is worth noting that studies included a wide range of participants (e.g. carers or healthcare professionals), please comment on how it may affect the results of this SR.

Discussion

- I think readers may be interested to whether the results of this SR in healthy adults differ from those in other populations (e.g. older adults). Please consider adding few sentences to elaborate.

Reviewer #2: This is an interesting review which examines the determinants and outcomes of eHealth literacy.

Introduction/Background

- Rationale: given that there are already three reviews that examine interventions for health literacy, it would be important to be more specific about how this current review adds to the already extensive reviews in the area, in particular as you state that the results are ‘putative’ and other reviews have focused specifically on interventions and the outcomes of interventions.

- A recently published systematic review: https://pubmed.ncbi.nlm.nih.gov/36716080/

- Why focus on healthy adults only and how are healthy adults defined?

- Rationale for how ‘outcomes’ can be described as benefits and disadvantages.

Methods:

- What software was used to screen the articles?

- Where were the data extracted to?

- Data Synthesis: the Dahlgren and Whitehead model is explained, but not how the data were synthesised and applied to this model. How was this undertaken from a methods perspective?

- I don’t think Table 2 or Table 3 are necessary. These could be put in a supplementary file. Also, no need to list the JBI critical appraisal questions.

Results/Discussion

- I would question the appropriateness or need to use of the term ‘putative’ throughout the article. If there is a description of what is meant by putative and why these studies are putative determinants and outcomes only in the background (or early results) and perhaps again in the conclusion, there is no need to repeat this throughout the article.

- Conceptual model of ehealth literacy: the figure/model as it stands is a bit one dimensional. Suggest distinguishing the different levels as per Dahlgren and Whitehead and be more explicit about the left side that distinguishes determinants and outcomes.

Other

- Abstract: background should include ‘healthy adults’.

- The following sentence appears to be incorrectly in the article: “Please add subheading to guide the classification of determinants according to the model” (p36).

- Discussion: need to draw out more the differences between different countries/parts of the world?

- Some of the language in the article is awkward. Suggest reviewing for structure of sentences.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********​

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Oct 4;18(10):e0291229. doi: 10.1371/journal.pone.0291229.r002

Author response to Decision Letter 0


30 Apr 2023

Dear Editors and Reviewers:

On behalf of all authors, I would like to thank the editor and all reviewers for the valuable feedback that we have used to improve the quality of our manuscript. The reviewer comments are listed below in italicised font, while our responses are given in normal font. Changes or additions we made in the manuscripts are marked with red colour.

List of response

Reviewer #1:

Thank you for the opportunity to read this paper. It address an important topic and contributes to the body of knowledge in this field. I only have few minor comments for authors' consideration.

Introduction

1. Please elaborate why the authors want to understand eHealth literacy in healthy adults?

Reply:

Thank you for your valuable suggestion. We have taken your feedback into consideration and have elaborated on our rationale for studying eHealth literacy in healthy adults. We have included our response in the introduction section of our manuscript, specifically in the last paragraph.

Understanding the determinants and outcomes of eHealth literacy can provide valuable insights into the factors that influence individuals’ ability to use technology to access, understand, and use health information, and the impact that eHealth literacy has on health outcomes. This information can then be used to develop interventions and policies to promote eHealth literacy and improve health outcomes in healthy adults. Focusing on the adult population is important since this population makes up the largest age group in the world [28]. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy. (page 2-3)

2. Why it is important to understand determinants and outcomes?

Reply:

Thank you for your comment. We believe that understanding the determinants and outcomes of eHealth literacy is crucial because it can help identify the factors that contribute to individuals' ability to access and use health information through technology, and how this ability impacts their health outcomes. By examining these factors, we can develop interventions and policies that promote eHealth literacy and improve health outcomes in healthy adults.

We have added this explanation to the last paragraph of our introduction section.

Understanding the determinants and outcomes of eHealth literacy can provide valuable insights into the factors that influence individuals’ ability to use technology to access, understand, and use health information, and the impact that eHealth literacy has on health outcomes. This information can then be used to develop interventions and policies to promote eHealth literacy and improve health outcomes in healthy adults. Focusing on the adult population is important since this population makes up the largest age group in the world [28]. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy. (page 2-3)

Results

3. It is worth noting that studies included a wide range of participants (e.g. carers or healthcare professionals), please comment on how it may affect the results of this SR.

Reply:

Thank you for raising this issue. We agree that it is important to note about the wide range of participants which may influence the results of our SR. We have acknowledged it in the following comment at the end of the discussion section.

It is important to note that the studies included a diverse kind of healthy adults, e.g. students and healthcare professionals. While such inclusion can provide a more comprehensive picture of eHealth literacy in healthy adults, it can also introduce heterogeneity into the study population. Therefore, careful consideration of how the results are interpreted and generalized is needed. (page 44)

Discussion

4. I think readers may be interested to whether the results of this SR in healthy adults differ from those in other populations (e.g. older adults). Please consider adding few sentences to elaborate.

Reply:

Thank you for your suggestion. We have written an additional paragraph in the discussion section to elaborate the similarities and differences between our SR and the most relevant previous SR.

A systematic review on the influencing factors of eHealth literacy among Chinese older adults [8] showed several similar findings with our study results, i.e. age, gender, education, socioeconomic status, and language influenced the levels of eHealth literacy [8]. These similarities suggest the factors which may be the universal determinants of eHealth literacy across different culture and population. However, our present study found that eHealth literacy was also influenced by literacy factors and ICT infrastructure. Another difference is that physical and psychological conditions, marital status, and being the family carer were found to be associated with the Chinese older adults’ levels of eHealth literacy [8]. These differences may indicate the factors that may be unique to older adult population, especially in China. With regards to outcomes, similar to our study findings, a recent systematic review concluded that eHealth literacy is associated with health-promoting behaviours including regular eating and exercise, and compliance with disease prevention behaviours [27]. These similar and different findings show the importance of conducting systematic review to find the consistent and inconsistent patterns across different studies. (page 43)

Reviewer #2:

This is an interesting review which examines the determinants and outcomes of eHealth literacy.

Introduction/Background

1. Rationale: given that there are already three reviews that examine interventions for health literacy, it would be important to be more specific about how this current review adds to the already extensive reviews in the area, in particular as you state that the results are ‘putative’ and other reviews have focused specifically on interventions and the outcomes of interventions.

Reply:

Thank you for your meaningful feedback on our manuscript. We agree that it is important to clarify how our review adds to the existing literature on eHealth literacy, given the extensive previous reviews particularly on eHealth literacy interventions for older adults.

Our review takes a broader approach by examining the determinants and outcomes of eHealth literacy in healthy adults, while previous reviews on eHealth literacy interventions focused on older adults. Focusing on the adult population is important since this population makes up the largest age group in the world. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy. In addition, our review offers a model of eHealth literacy determinants and outcomes which can be helpful to outline strategic approaches to promote greater equity in eHealth literacy through different policy levels. Finally, our present review found the factors unique to healthy adults which are not found among older adult population as well as the similar factors across these populations (as illustrated in the second last paragraph in the discussion section).

We also added an explanation about this rationale to the last paragraph of our introduction:

“However, to the best of our knowledge, there is still no systematic review to summarise the evidence of eHealth literacy’s determinants and outcomes, unrelated to a specific intervention. To address this perceived gap, this systematic review aims to summarise and appraise the existing research which has examined the determinants and outcomes of eHealth literacy in healthy adults. Understanding the determinants and outcomes of eHealth literacy can provide valuable insights into the factors that influence individuals’ ability to use technology to access, understand, and use health information, and the impact that eHealth literacy has on health outcomes. This information can then be used to develop interventions and policies to promote eHealth literacy and improve health outcomes in healthy adults. Focusing on the adult population is important since this population makes up the largest age group in the world [28]. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy.” (page 2-3)

2. A recently published systematic review: https://pubmed.ncbi.nlm.nih.gov/36716080/

Reply:

Thank you for suggesting a recently published SR. We have incorporated it in our introduction (page 2) and discussion sections (page 43).

3. Why focus on healthy adults only and how are healthy adults defined?

Reply:

Thank you for your questions. We added these sentences to the end of our introduction section to answer your question:

“Focusing on the adult population is important since this population makes up the largest age group in the world [2]. Moreover, by focusing the study population on healthy adults, the researchers can minimise the potential confounding effects of health conditions or other factors that may influence eHealth literacy.” (page 3)

Also, we have inserted the definition of healthy adults in the eligibility criteria, in the Methods section.

Healthy adults are defined as individuals aged over 18-64 years (American Medical Association, 2022) without significant chronic health conditions or disabilities. (page 3)

4. Rationale for how ‘outcomes’ can be described as benefits and disadvantages.

Reply:

Thank you for raising this issue.

We replaced the use of terms ‘benefits and disadvantages’ with positive and negative outcomes (page 3). Describing outcomes as both positive and negative allows for a more balanced assessment of the eHealth literacy topic.

Methods:

5. What software was used to screen the articles?

Reply:

We used EndNote 20 software to screen the articles (we have added this information in our Methods section, page 3).

6. Where were the data extracted to?

Reply:

The data were extracted to an extraction sheet in Microsoft Word (we have added this information in our Methods section page 4).

7. Data Synthesis: the Dahlgren and Whitehead model is explained, but not how the data were synthesised and applied to this model. How was this undertaken from a methods perspective?

Reply:

Thank you for raising this issue.

From a methods perspective, we synthesised the data from the included studies to this model by extracting the information on the determinants and outcomes of eHealth literacy and mapping the findings onto the model. Finally we identified areas where interventions or policies can be targeted related to each determinants. (We have incorporated these information at the end of the Data Synthesis part, Methods section)

Data from the included studies were synthesised and applied to this model by extracting the information on the determinants and outcomes of eHealth literacy and mapping the findings onto the layers of Dahlgren and Whitehead’s model. Finally, areas where interventions or policies can be targeted related to each determinant were identified. (page 4)

8. I don’t think Table 2 or Table 3 are necessary. These could be put in a supplementary file. Also, no need to list the JBI critical appraisal questions.

Reply:

Thank you for your feedback. We have put table 2 and 3 in the Supplementary material.

Results/Discussion

9. I would question the appropriateness or need to use of the term ‘putative’ throughout the article. If there is a description of what is meant by putative and why these studies are putative determinants and outcomes only in the background (or early results) and perhaps again in the conclusion, there is no need to repeat this throughout the article.

Reply:

Thank you for your suggestion. We have removed the term ‘putative’, except in the early part of the Results section (As the causal relationship could not be drawn from the cross-sectional study design, the determinants and outcomes were putative only. Page 5) and in the Conclusions.

10. Conceptual model of ehealth literacy: the figure/model as it stands is a bit one dimensional. Suggest distinguishing the different levels as per Dahlgren and Whitehead and be more explicit about the left side that distinguishes determinants and outcomes.

Reply:

Thank you for your suggestion. We have made some revisions to the figure to improve its clarity. Firstly, we have made a more explicit distinction between the different levels of the determinants and their interactions, as per Dahlgren and Whitehead's model. Secondly, we have separated the groups of determinants and outcomes into upper and lower parts using a bold line to make them more visible. We have also created dashed arrows to indicate non-causal relationships between the determinants and eHealth literacy, as well as between eHealth literacy and the outcomes. Furthermore, we have moved the group of determinants to the upper part of the figure, and the outcomes to the lower part. Lastly, we have included an explanation of the figure in the caption.

Figure 2. Conceptual model of eHealth literacy determinants and outcomes

The model suggests that eHealth literacy is shaped by a complex interaction of multi-layered determinants (i.e. non-modifiable factors, individual lifestyle, social and community networks, living and working conditions, and general socio-economic and cultural conditions). As a result, eHealth literacy is also associated with various outcomes.

Other

11. Abstract: background should include ‘healthy adults’.

Reply: Thank you for your reminder. We have revised the background section in our abstract accordingly.

12. The following sentence appears to be incorrectly in the article: “Please add subheading to guide the classification of determinants according to the model” (p36).

Reply: Thank you for your meticulous review. We have deleted that sentence.

13. Discussion: need to draw out more the differences between different countries/parts of the world?

Reply:

Thank you for your comment on our article. We appreciate your suggestion to draw out more the differences between different countries in the discussion section. We have compared the results of our SR with those from the previous systematic reviews focused on different countries in these two paragraphs:

(Discussion, page 41) …This factor includes education, employment, income and ease of paying for health care, all of which play important roles in determining the eHealth literacy levels of healthy adults. This finding is consistent with the result of a previous systematic review of eHealth literacy in an underserved population in the US [19]. In the countries where there is no universal health coverage, such as the US, those who are poor and uninsured may have lesser access to health care, confirming their status as a vulnerable and underserved population [19]. Economically disadvantaged people may also have decreased opportunity to access technology [19]….

(Discussion, page 42) A systematic review on the influencing factors of eHealth literacy among Chinese older adults [8] showed several similar findings with our study results, i.e. age, gender, education, socioeconomic status, and language influenced the levels of eHealth literacy [8]. These similarities suggest the factors which may be the universal determinants of eHealth literacy across different culture and population. However, our present study found that eHealth literacy was also influenced by literacy factors and ICT infrastructure. Another difference is that physical and psychological conditions, marital status, and being the family carer were found to be associated with the Chinese older adults’ levels of eHealth literacy [8]. These differences may indicate the factors that may be unique to older adult population, especially in China. With regards to outcomes, similar to our study findings, a recent systematic review concluded that eHealth literacy is associated with health-promoting behaviours including regular eating and exercise, and compliance with disease prevention behaviours [27]. These similar and different findings show the importance of conducting systematic review to find the consistent and inconsistent patterns across different studies.

14. Some of the language in the article is awkward. Suggest reviewing for structure of sentences.

Reply:

Thank you for your feedback. We have our article professionally proofread and edited by a native English academic and proofreader. We also have reviewed our article to improve its readability and clarity.

Attachment

Submitted filename: Response to reviewer_26042023.docx

Decision Letter 1

Muhammad Shahzad Aslam

7 Jul 2023

PONE-D-22-35330R1Determinants and outcomes of eHealth literacy in healthy adults: A systematic reviewPLOS ONE

Dear Dr. Milanti,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

1-It is necessary to provide a reproducible search strategy. The current given information does not determine the reproducibility. Please provide detail search strategy.

2- how did you removing duplicates. The current methodology in incomplete. Please read https://jbi.global/. Please make sure your methodology is in details and include all aspect of data screening method, data collection methods.

3-Please provide us PICO. The PICO framework focuses on the Population, Intervention, Comparison and Outcomes. If you use other framework then give to us. It is mandatory.

4-Provide details on grey literature. Mandatory

5-Provide justification on why you exclude other database. Mandatory

Regarding Study risk of bias assessment. Kindly compare it with other methods such as Cochrane Risk of Bias Tool, Newcastle-Ottawa Scale (NOS), AXIS (Appraisal tool for Cross-Sectional Studies), AMSTAR 2 (A MeaSurement Tool to Assess systematic Reviews). The current information is not sufficient.

6-Kindly organize your table properly. All given tables has several structural flaws. Proof read properly.

7-Provide heading and details, Study strength, study limitation, future direction. Mandatory.

8-Please revisit PRIMA flow dagram and cross-check the statement and content provided.

Please submit your revised manuscript by Aug 21 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Muhammad Shahzad Aslam, Ph.D.,M.Phil., Pharm-D

Academic Editor

PLOS ONE

Additional Editor Comments:

1-It is necessary to provide a reproducible search strategy. The current given information does not determine the reproducibility. Please provide detail search strategy.

2- how did you removing duplicates. The current methodology in incomplete. Please read https://jbi.global/. Please make sure your methodology is in details and include all aspect of data screening method, data collection methods.

3-Please provide us PICO. The PICO framework focuses on the Population, Intervention, Comparison and Outcomes. If you use other framework then give to us. It is mandatory.

4-Provide details on grey literature. Mandatory

5-Provide justification on why you exclude other database. Mandatory

Regarding Study risk of bias assessment. Kindly compare it with other methods such as Cochrane Risk of Bias Tool, Newcastle-Ottawa Scale (NOS), AXIS (Appraisal tool for Cross-Sectional Studies), AMSTAR 2 (A MeaSurement Tool to Assess systematic Reviews). The current information is not sufficient.

6-Kindly organize your table properly. All given tables has several structural flaws. Proof read properly.

7-Provide heading and details, Study strength, study limitation, future direction. Mandatory.

8-Please revisit PRIMA flow dagram and cross-check the statement and content provided.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Oct 4;18(10):e0291229. doi: 10.1371/journal.pone.0291229.r004

Author response to Decision Letter 1


23 Aug 2023

PONE-D-22-35330R1 - Determinants and outcomes of eHealth literacy in healthy adults: A systematic review

PLOS ONE Academic Editor

Dr. Muhammad Shahzad Aslam, Ph.D.,M.Phil., Pharm-D

Dear Dr Aslam,

On behalf of all authors, I would like to thank the academic editor and reviewers for the valuable feedback to improve the quality of our manuscript. The editor' comments are listed below in italicised font, while our responses are given in normal font. Changes or additions we made in the manuscripts are marked with yellow highlight and red color. The existing contents which address your comments are marked with purple color.

List of response

1-It is necessary to provide a reproducible search strategy. The current given information does not determine the reproducibility. Please provide detail search strategy.

Response:

Thank you for your comment. We have added a supporting information file containing our detailed search strategy for each databases that we used.

Search strategy

We searched six electronic databases: MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest to identify relevant studies. Relevant grey literature including dissertations and theses were identified from ProQuest. These databases were selected since they are among the largest and most widely recognized as authoritative sources in the fields of healthcare, medical, nursing, psychology, and behavioral sciences. They offer a comprehensive coverage of literature relevant to the eHealth literacy topic. Including other databases might introduce redundancy in the review process. These databases were chosen to strike a balance between comprehensive coverage and efficiency.

A search strategy was developed to capture the key elements of the topic of interest, i.e.: determinants and outcomes of eHealth literacy. Keywords were combined using AND and OR Boolean operators. The year of publication was not limited. The detailed search strategy is presented in appendix 1.

(page 4)

2- how did you removing duplicates. The current methodology in incomplete. Please read https://jbi.global/. Please make sure your methodology is in details and include all aspect of data screening method, data collection methods.

Response:

Thank you for your suggestion, We have checked and referred to JBI guidelines to add more details in our methods.

All citations were managed using EndNote 20 software (Clarivate Analytics, PA, USA). Duplicates were identified and removed electronically (using 'Find Duplicates' feature in EndNote) and manually. (page 4)

3-Please provide us PICO. The PICO framework focuses on the Population, Intervention, Comparison and Outcomes. If you use other framework then give to us. It is mandatory.

Response:

Thank you for your comments. We have written the population and outcomes in the eligibility criteria of our review. We also added that intervention and comparator were not within the scope of our review.

Selection process

Studies were included if they met these criteria: 1) studies examining ‘eHealth literacy’; 2) the type of study included observational and interventional studies, mixed methods studies, and qualitative studies; 3) population/participants were healthy adults (defined as individuals aged over 18-64 years [29] without significant chronic health conditions or disabilities); 4) the main outcomes were the determinants (i.e. influencing or associated factors) and outcomes (i.e. positive and negative outcomes) of eHealth literacy. Intervention and comparator were beyond the scope of this review. (page 4)

4-Provide details on grey literature. Mandatory

Response:

Thank you for your comment. We have added in our 'Search strategy' section that grey literature were searched from ProQuest.

Search strategy

We searched six electronic databases: MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest to identify relevant studies. Relevant grey literature including dissertations and theses were identified from ProQuest. These databases were selected since they are among the largest and most widely recognized as authoritative sources in the fields of healthcare, medical, nursing, psychology, and behavioral sciences. They offer a comprehensive coverage of literature relevant to the eHealth literacy topic. Including other databases might introduce redundancy in the review process. These databases were chosen to strike a balance between comprehensive coverage and efficiency.

A search strategy was developed to capture the key elements of the topic of interest, i.e.: determinants and outcomes of eHealth literacy. Keywords were combined using AND and OR Boolean operators. The year of publication was not limited. The detailed search strategy is presented in appendix 1.

(page 4)

5-Provide justification on why you exclude other database. Mandatory

Response:

We have explained our justification to include MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest and exclude other databases.

Search strategy

We searched six electronic databases: MEDLINE, EMBASE, PsycINFO, CINAHL, Cochrane Library and ProQuest to identify relevant studies. Relevant grey literature including dissertations and theses were identified from ProQuest. These databases were selected since they are among the largest and most widely recognized as authoritative sources in the fields of healthcare, medical, nursing, psychology, and behavioral sciences. They offer a comprehensive coverage of literature relevant to the eHealth literacy topic. Including other databases might introduce redundancy in the review process. These databases were chosen to strike a balance between comprehensive coverage and efficiency.

A search strategy was developed to capture the key elements of the topic of interest, i.e.: determinants and outcomes of eHealth literacy. Keywords were combined using AND and OR Boolean operators. The year of publication was not limited. The detailed search strategy is presented in appendix 1.

5. a. Regarding Study risk of bias assessment. Kindly compare it with other methods such as Cochrane Risk of Bias Tool, Newcastle-Ottawa Scale (NOS), AXIS (Appraisal tool for Cross-Sectional Studies), AMSTAR 2 (A MeaSurement Tool to Assess systematic Reviews). The current information is not sufficient.

Response:

Thank you for your suggestion. We have incorporated it in our paper.

Assessment of methodological quality

AM and AAP independently carried out the critical appraisal for each study. The Joanna Briggs Institute (JBI) critical appraisal tools were used, according to each study’s design, to assist in examining the trustworthiness and risk of bias of the included studies [30]. The JBI critical appraisal tools are widely recognized within the field of evidence synthesis for their comprehensive approach to evaluating the risk of bias based on the study’s design, conduct, and analysis. While other tools, such as the Cochrane Risk of Bias Tool, Newcastle-Ottawa Scale (NOS), Appraisal tool for Cross-Sectional Studies (AXIS), and A measurement Tool to Assess Systematic Reviews (AMSTAR 2), mostly focus on specific study types and their respective attributes, JBI tools offer a broader approach in comprehensively assessing various study designs. Therefore, the JBI tools were deemed suitable for systematically reviewing the determinants and outcomes of eHealth literacy across different research methodologies. (page 5)

6-Kindly organize your table properly. All given tables has several structural flaws. Proof read properly.

Response:

Thank you for your comments. We have rechecked the structure, and proofread the tables.

Additionally, table of characteristics of included studies has been moved from the main text to the Supporting information part. In that table, we removed the mean eHealth literacy score as it was deemed unnecessary.

7-Provide heading and details, Study strength, study limitation, future direction. Mandatory.

Response:

Thank you for your suggestion.

We have provided headings for the study strengths, limitations and future directions (the future directions was put after the Conclusions). In addition, we also incorporated the study limitations and future directions in the Discussion section to improve clarity and contextualisation (please see below examples).

Discussion, Paragraph 1, page 16:

(Limitation) However, this review did not include studies among older adults, therefore, comparisons between younger and older age participants cannot be made. In terms of sex, it is quite surprising that men were more likely to have a higher level of eHealth literacy than women. Prior studies showed that women used health apps [76] and searched health information online [77, 78] more often than men did. Women were also found to be more eHealth literate than men and perceived online information quality better [79, 80]. (Future direction) More studies are needed to clarify how sex differences determine eHealth literacy.

Paragraph 3, page 17:

(Future direction) Further studies are deemed necessary to update eHEALS to fit its purpose in the Web 2.0 internet era. (Future direction) Subscales to assess communication skills in online social interactions and in synthesising contents are some instances of items that could be developed for updated version of eHEALS. (Future direction) Studies are also needed to assess the traditional literacy, scientific literacy and media literacy. The latter is especially important in combating disinformation and bridging the digital divide [82].

Implications for policymaking (page 17-18)

Referring to Dahlgren and Whitehead’s model [31], different policy levels may apply in different layers of the health determinant. Policy level 1 is for the major structural environment, in which the language factor is situated. For addressing this determinant, national-level strategies, such as incorporating language services in the national health care system, are needed [83]. Having national and health industry investments to develop population-based language services by using ICT is also recommended [83]. Furthermore, policy level 2, which aims to improve living and working conditions can achieve that aim by, for example, a) providing the welfare benefits through the social security sector, and improving b) health care services, c) the education system and d) the ICT infrastructure [31]. Policy level 3, aiming at strengthening social and community support is not applicable, as there is no eHealth literacy determinant identified in this layer. Policy level 4 aims at influencing individual lifestyles [31]. The policy can include developing programmes to enhance eHealth literacy skills. Finally, for the innermost layer, i.e. the non-modifiable factor, the intervention can be integrated into the educational improvement of the eHealth literacy for older adults of both sexes and women of all ages.

Study strengths

The systematic review offers comprehensive summ

arized evidence of the determinants and outcomes of eHealth literacy in healthy adults. It encompasses a wide range of factors, both non-modifiable and individual, as well as environmental and cultural aspects. In addition, the review acknowledges that different layers of eHealth literacy determinants can have varying policy implications. This recognition is crucial for policymakers and healthcare professionals seeking to enhance eHealth literacy, as it provides insights into targeted interventions and strategies.

Study limitations

As with all systematic reviews, we cannot be fully certain that we have identified all relevant literature. This review only covered six databases and studies published in English. We may have missed potentially eligible studies published in other languages or contained within other databases. We only included articles which measured associations of eHealth literacy with the determinant or outcome variables. Articles presenting only differences between those variables were excluded. This constraint might also limit the findings of the review. Furthermore, we limit our population to healthy adults, who may not be the vulnerable population with regards to eHealth literacy. It is important to note that the studies included a relatively diverse group of healthy adults, e.g. students and healthcare professionals. While such inclusion can provide a more comprehensive picture of eHealth literacy in healthy adults, it can also introduce heterogeneity into the study population. Therefore, careful consideration of how the results is interpreted and generalized is needed.

Conclusions and future directions (page 19 & 20)

This systematic review has contributed to the understanding of the putative determinants and outcomes of eHealth literacy in healthy adults. In summary, the determinants of eHealth literacy include the non-modifiable factors (age, sex); individual factors (literacy, online health information seeking behavior); living and working conditions (education, employment, health care service and ICT infrastructure) and general cultural conditions (particularly language). Whereas, the outcomes of eHealth literacy include health promotion behaviors, COVID-19 preventive behaviors, psychological wellbeing, better social and community networks, better self-rated health and better health service utilisation. Different layers of eHealth literacy determinants can have different policy implications as they aim to improve eHealth literacy.

Future studies should incorporate artificial intelligence (AI) into the eHealth landscape. One possible direction is the expansion of the eHealth Literacy tool to include AI-driven health information. AI can also be used to develop inclusive eHealth solutions that are tailored to different literacy levels. The key to AI's influence is personalization, which enables the creation of eHealth intervention finely tuned to individual literacy levels. This personalisation encourages more effective health information dissemination while improving accessibility.

8-Please revisit PRIMA flow diagram and cross-check the statement and content provided.

Response:

Thank you for your suggestion.

We have revisited our PRISMA flow diagram and checked its content for accuracy.

Attachment

Submitted filename: response to reviewers_23Aug23.docx

Decision Letter 2

Muhammad Shahzad Aslam

25 Aug 2023

Determinants and outcomes of eHealth literacy in healthy adults: A systematic review

PONE-D-22-35330R2

Dear Dr. Milanti,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Muhammad Shahzad Aslam, Ph.D.,M.Phil., Pharm-D

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: N/A

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thanks for the opportunity to review this paper. This systematic review addressed an important topic and filled the gaps in literature.

The author has responded to all my suggestions.

Reviewer #2: (No Response)

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Aisling Walsh

**********

Acceptance letter

Muhammad Shahzad Aslam

25 Sep 2023

PONE-D-22-35330R2

 Determinants and outcomes of eHealth literacy in healthy adults: A systematic review

Dear Dr. Milanti:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Muhammad Shahzad Aslam

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Details of search strategy.

    (PDF)

    S2 Table. Characteristics of included studies.

    (PDF)

    S3 Table. Joanna-Briggs institute critical appraisal for included studies.

    (PDF)

    Attachment

    Submitted filename: Response to reviewer_26042023.docx

    Attachment

    Submitted filename: response to reviewers_23Aug23.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES