Skip to main content
Digital Health logoLink to Digital Health
. 2023 Aug 14;9:20552076231194915. doi: 10.1177/20552076231194915

Psychometric properties of the German revised version of the eHealth literacy scale in individuals with cardiac diseases: Validation and test of measurement invariance

Alexander Bäuerle 1,2,, Matthias Marsall 3, Lisa Maria Jahre 1,2, Christos Rammos 4, Charlotta Mallien 1,2, Eva-Maria Skoda 1,2, Tienush Rassaf 4, Julia Lortz 4, Martin Teufel 1,2
PMCID: PMC10426311  PMID: 37588160

Abstract

Background

The internet is most people's primary source of (health) information. However, no validated instrument exists to assess eHealth literacy in the group of patient with cardiac diseases.

Objective

The objective of this study was the evaluation of the psychometric properties of the German revised version of the eHealth literacy scale (GR-eHEALS) in individuals with coronary artery disease (CAD) and congestive heart failure (CHF).

Methods

A cross-sectional study was conducted. N = 455 were included in the statistical analyses. The assessment compromised the GR-eHEALS, medical history, sociodemographic data, and technology-related data. Confirmatory factor analyses, correlational analyses, and tests of measurement invariance were performed.

Results

The two-factorial model reached a good model fit. The sub-scales information seeking and information appraisal, as well as the eHealth literacy total score, reached high reliability coefficients. Construct and criterion validity was fully confirmed For the two-factorial model, measurement invariance up to the scalar level could be confirmed regarding the sociodemographic characteristics sex, age, and educational level.

Conclusions

This study confirmed the two-factor structure, construct, and criterion validity as well as measurement invariance at the scalar level for sex, age, and educational level of the GR-eHEALS scale in a sample of individuals with CAD and CHF.

Keywords: eHEALS, eHealth, cardiovascular diseases, cardiac disease, health information, health literacy, internet, measurement invariance, validation

Introduction

Health literacy has been defined as a Sustainable Development Goal by the World Health Organization (WHO). 1 Nutbeam 2 defines health literacy as ‘a person's ability to access, understand and use health information in ways that promote and maintain good health’. Health literacy is associated with a number of important health outcomes: Low health literacy has been connected to more hospitalizations, more frequent use of emergency care, poorer adherence towards medication use, better health understanding, better health-related self-management behaviours, and poorer health status.35 Today, knowledge about health-related topics is no longer only conveyed by experts. The internet offers a nearly unmanageable amount of possibilities to access (health) information. 6 Problems occur when the presented information is not fact-based or even harmful to health. 7 This makes the concept of electronic health literacy (eHealth literacy) all the more critical. The overarching concept of eHealth describes healthcare based on information and communication technology, e.g., telemedicine, mobile health (mHealth), and health informatics. 8 To conclude, eHealth literacy adapts the concept of health literacy to the age of digital media and is defined as the ‘ability to seek, find, understand, and appraise health information from electronic sources and apply the knowledge gained to addressing or solving a health problem’. 9

Several studies have shown positive relations between eHealth literacy and health-related outcomes in the general population and clinical populations, such as health knowledge,10,11 health information seeking,12,13 health intention, 14 preventive health behaviour,11,15 and adherence. 16 Moreover, beneficial health behaviours, such as following a healthy diet and regularly exercising, are positively associated with eHealth literacy.17,18

(e)Health literacy in individuals with cardiac diseases

The WHO names cardiovascular diseases (CVDs), in particular cardiac diseases (CDs), as ‘the leading cause of death globally’, resulting in 17.9 million death per year. 19 CDs are a group of diseases encompassing several diseases, e.g., coronary artery disease (CAD), congestive heart failure (CHF), and rheumatic heart disease, resulting in heart attacks and strokes. 19 Due to risk factors, such as diet, immobility, and alcohol or tobacco, many CDs are considered ‘lifestyle disorders’.20,21

For the context of health literacy among individuals at risk of and affected by coronary heart disease, it could already be shown that low health literacy is associated with negative health behaviours and outcomes, such as feeling less equipped to implement necessary lifestyle changes, lack of proactive coping strategies, denial of CAD, more rapid physical deterioration, and less use of healthcare services compared to individuals with higher health literacy. 22 Further, sociodemographic factors such as older age, unemployment, low level of education, and low socioeconomic status are related to low health literacy in this group of patients. 22 Low health literacy in those affected by CDs has further been connected to decreased quality of life. 23

Targeted eHealth interventions for individuals with several CDs can potentially affect a number of risk factors and health outcomes positively.2426 However, it is important to understand that adequate eHealth literacy is a significant skill in this context. In order to successfully use these services or even find these support approaches, eHealth literacy plays a key role.

In a German sample of patients with CD, diabetes, or both, eHealth literacy was related to the use of mHealth apps and the higher perceived effectiveness of such apps. 27 Richtering et al. 28 investigated eHealth literacy in individuals with moderate to high cardiovascular risk. However, the authors note that the assessment instrument used was unable to depict mean to high levels of eHealth literacy and suggest a revision of existing measurement scales. Cardiovascular risk and health-related behaviours and their association with eHealth literacy have been investigated among patients with hypertension, diabetes mellitus, and coronary heart disease. Low eHealth literacy was associated with cardiovascular risk. 29 The aforementioned relations between eHealth literacy and several health-related outcomes in patients with CDs, as well as the need for a validated instrument, have highlighted the relevance of a reliable assessment of eHealth literacy in a number of diverse populations.

As there is no study examining the validity of the measurement of eHealth literacy in people with CDs, there is a gap in understanding the assessment of eHealth literacy which is a crucial requirement in developing specific eHealth interventions for people suffering from CDs. The recently published German revised version of the eHealth literacy scale (GR-eHEALS) is a valid and reliable assessment instrument for measuring eHealth literacy in the German language. 30 Measurement invariance of the instrument, which is necessary to determine whether an interpretation of mean differences is considered valid,31,32 was confirmed for sex and educational level. This is highly relevant as different sociodemographic variables have been shown to be connected to eHealth literacy: similar to health literacy, older people and those with lower levels of education exhibit poor eHealth literacy. 33 In contrast, studies examining the association between eHealth literacy and sex showed contradictory findings.11,18,34 Therefore, the independence of the measurement instrument from sociodemographic variables is crucial for evaluating its psychometric quality. However, the GR-eHEALS was only validated on a sample from the general population in Germany. Moreover, the investigation of its validity in clinical samples is missing so far.

Objectives

eHealth literacy is an important ability for patients and the basis of the successful use of eHealth services. Measurement of this construct needs to be reliable for studies investigating eHealth literacy and the programme's efficacy in increasing this ability in patients with low eHealth literacy. Further, measurement invariance is required to interpret mean differences regarding sociodemographic determinants validly.

Therefore, three objectives were developed for this study:

  • We wanted to examine the factorial structure of the GR-eHEALS. Further, the construct validity should be assessed by investigating the convergent and discriminant validity of the instrument in individuals with CDs.

  • To investigate the GR-eHEALS’ criterion validity, the associations of eHealth literacy and health-related outcomes in individuals with a CD should be considered.

  • Further, the goal was to examine measurement invariance for sex, age, and educational level of the GR-eHEALS in individuals with a CD.

Methods

Study design and participants

A cross-sectional study design was applied. Data collection was conducted via an online survey on the platform Unipark 35 from November 2021 to December 2022. Recruitment of patients took place at the Department of Cardiology, West German Heart and Vascular Center, University Hospital Essen, and social media channels that focus on CDs. Eligibility requirements for participation in the study consisted of a diagnosis of a CD (at least one of the following: CHF or CAD), age above 18 years, sufficient command of the German language, and internet access. Electronic informed consent was obtained before the beginning of the survey. Participation was anonymous and voluntary. Compensation for participation was not offered. In order to improve the data's quality, we performed an outlier analysis regarding the completion time of the questionnaire and detected 12 cases with extremely slow completion times, which were excluded. N = 455 patients were included in the final data analysis. The sample size for this study was determined based on recommendations for factor analyses and validation studies.36,37 The study was conducted in accordance with the Declaration of Helsinki, and the Ethics Committee of the Essen Medical Faculty (19-89-47-BO) agreed to conduct the study.

Measurements

Sociodemographic and medical characteristics were collected. eHealth literacy and constructs to examine convergent, discriminant, and criterion validity were assessed via self-assessment measurement instruments.

Sociodemographic data were assessed, including sex, age, marital status, level of education, occupation, and city size. Medical data were assessed, including, e.g., patients’ smoking behaviour.

eHealth literacy is assessed with the GR-eHEALS, 30 which is based on the eHEALS by Norman and Skinner. 38 The GR-eHEALS consists of eight items. All items are rated on a five-point Likert scale. The validity and factorial structure of GR-eHEALS were confirmed by exploratory and confirmatory factor analyses in a German convenient sample before. 30

To examine the convergent validity, we used established scales to measure digital confidence, 30 knowledge of internet-based health promotion programmes,30,39,40 and a single item to assess the duration of private internet use. In accordance with Campbell and Fiske, 41 we expected significant interrelations with the GR-eHEALS to confirm convergent validity.

Regarding discriminant validity, the eight-item impulsive behaviour scale (I-8) 42 was used to measure impulsivity as a personal trait which we expected to be independent of the GR-eHEALS (eHealth literacy). These items were assessed via five-point Likert scales.

To evaluate the criterion validity of the GR-eHEALS in the form of concurrent validity, we assessed the health status (physical and mental health) as well as the quality of life with self-developed single items on 11-point Likert scales. Further, we asked whether people were smoking or not via a single dichotomous item.

Statistical analyses

Data analysis was performed using R 43 and RStudio. 44 Confirmatory factor analysis (CFA) was conducted to investigate the factorial structure of the scale. Prior to this, an exploratory factor analysis (EFA) was conducted, with results presented in Appendix 1. Hu and Bentler 45 suggest a comparative fit index (CFI) and Tucker–Lewis index (TLI) of about 0.95 and root mean square error of approximation (RMSEA) and standardized root mean square residual (SRMR) of about 0.06 and 0.08, respectively, to confirm the fit of the model. A robust likelihood estimator (ULSM: ULS = unweighted least squares, M = mean adjusted test statistic) was used to ensure a model with fewer biases 46 and consider the ordinal-scaled level of items of the instrument. 47 Interrelations of the GR-eHEALS with convergent, discriminant, and criterion validity scales, as well as sociodemographic variables, were examined with two-tailed Pearson correlations, t-tests, and analyses of variances (ANOVA) considering significance levels of α = 0.05. Before using the scales for convergent, discriminant, and criterion validity, their reliabilities (internal consistency) were investigated. Missing values were deleted listwise. Further, measurement invariances of sex, age, and educational level of the GR-eHEALS were analysed. For this purpose, we conducted consecutive multi-group CFA and considered the scalar invariance to verify measurement invariance. 48 In the CFA and tests of measurement invariance, data of N = 315 patients with complete data on eHealth literacy variables were considered. When scalar invariance is confirmed, the interpretation of mean differences is considered valid. 31 Otherwise, differences between groups of the respective sociodemographic characteristic may be attributable to the instrument's lack of ability to measure equally between different groups. Model fit indices and difference of CFI (ΔCFI) between compared models were examined. A cutoff criterion of a difference of CFI of 0.01 was applied, indicating invariance between the two models. 49 As measurement invariance testing requires sufficient large group samples, we excluded one person who indicated sex as ‘diverse’. Moreover, we dummy-coded the age via the median split-half procedure. To test measurement invariance for educational level, we excluded persons who indicated having no school certificate (n = 2) and who indicated ‘Other’ or ‘Not specified’ (n = 18) and aggregated people with any school degree as Group 1 and people with a university or academic degree as Group 2.

Results

Sample description

Table 1 shows the sample characteristics of the study. Further, the table includes the sample characteristics of the 315 participants, who completed all items of the GR-eHEALS. Out of N = 455 people who indicated to be diagnosed with a CD, n = 153 (34%) reported to have had myocardial infarction in the past. A total of 196 (43%) indicated having a diagnosed CHF, and 193 (42%) indicated to previously undergone bypass surgery or percutaneous coronary intervention.

Table 1.

Description of the study sample.

Complete sample (n = 455) Sample with complete data on all GR-eHEALS variables (n = 315)
Variable n % n %
Age (M (SD)) 55.5 (14.2) 57.0 (13.4)
Sex
Female 217 47.7 153 48.6
Male 237 52.1 162 51.4
Diverse 1 0.2 - -
Educational level
No school certificate 2 0.4 2 0.6
Secondary school 239 52.5 168 53.3
University entrance qualification 83 18.2 58 18.4
University/academic degree 113 24.8 79 25.1
Other/not specified 18 4.0 8 2.5
Marital status
Married/in relationship 316 69.5 212 67.3
Single 50 10.9 34 10.8
Divorced/separated 54 11.9 44 14.0
Widowed/other 35 7.7 25 7.9
Occupation
Attending school/study 14 3.1 6 1.9
Employed (part time, full time) 194 42.6 133 42.4
Sick leave 31 6.8 17 5.4
Retirement/pension 145 31.9 109 34.6
Not employed/other 71 15.6 50 15.9
Community size
Big city (>100,000 inhabitants) 266 58.5 197 62.5
Medium city (>20,000 inhabitants) 96 21.1 63 20.0
Small city (>5000 inhabitants) 48 10.5 30 9.5
Rural village (<5000 inhabitants) 45 9.9 25 7.9

n: sub-sample size; M: mean; SD: standard deviation.

Abbreviation: GR-eHEALS: German revised version of the eHealth literacy scale.

Properties of scales used for construct validation

Three items assessing digital confidence reached excellent internal consistency of 0.94. Good internal consistency (0.87) was reached for three items measuring knowledge of internet-based health promotion programmes. Regarding impulsivity, four of the eight items of the I-8 scale were excluded due to low item discriminations indices and diminishing internal consistency. After item exclusion, good internal consistency of 0.78 was reached.

Construct validation of the GR-eHEALS in people with CD

We conducted a CFA to evaluate the factorial structure of the GR-eHEALS in the population of individuals affected by CD. In the first model, we performed a model test to evaluate the model fit of a one-factorial model. In the second model, the two-factorial structure reflecting two interrelated sub-dimensions of information seeking and information appraisal proposed by Marsall et al. 30 was tested. The results of these analyses are presented in Table 2.

Table 2.

Results of CFA to examine factorial structure of the GR-eHEALS.

Model Chi² (df) CFI TLI RMSEA SRMR
1 182.0 (20) 0.993 0.990 0.081 0.053
2 90.9 (19) 0.997 0.996 0.053 0.039

Chi²: Chi²-coefficient; df: degrees of freedom; CFA: confirmatory factor analysis; CFI: comparative fit index; GR-eHEALS: German revised version of the eHealth literacy scale; TLI: Tucker–Lewis index; RMSEA: root mean square error of approximation; SRMR: standardized root mean square residual.

As shown in Table 2, the two-factor model reached a better model fit and replicated the findings of Marsall et al. 30 All item factor loadings were greater than 0.76. The items, as well as their descriptive characteristics, are shown in Table 3. All items had a median of 4 and were slightly negatively skewed. The two sub-dimension information seeking (Items # 1–4) and information appraisal (Items # 5–8) reached excellent internal consistencies of 0.92 and 0.91, respectively. Internal consistency of all eight items (eHealth literacy total score) was excellent, with Cronbach's alpha of 0.94.

Table 3.

Item statistics of the GR-eHEALS in the study population.

# Item M SD Skew Response distribution %
1 2 3 4 5
Information seeking 3.70 1.07 −0.72 - - - - -
1 Ich weiß, wie ich Internetseiten mit hilfreichen Gesundheitsinformationen finden kann. 3.87 0.98 −1.04 3.20 7.60 13.10 51.10 25.10
2 Ich weiß, wie ich das Internet nutzen kann, um Antworten auf meine Gesundheitsfragen zu erhalten. 3.85 1.00 −0.84 2.20 10.20 14.60 46.70 26.30
3 Ich weiß, welche Seiten mit Gesundheitsinformationen im Internet verfügbar sind. 3.53 1.10 −0.43 3.20 18.70 19.00 39.70 19.00
4 Ich weiß, wo ich im Internet hilfreiche Gesundheitsinformationen finden kann. 3.56 1.14 −0.56 4.40 18.40 14.30 42.70 20.30
Information appraisal 3.56 1.12 −0.59 - - - - -
5 Ich weiß, Gesundheitsinformationen aus dem Internet so zu nutzen, dass sie mir weiterhelfen. 3.60 1.01 −0.72 3.20 14.00 17.10 50.80 14.90
6 Ich bin in der Lage, Internetseiten mit Gesundheitsinformationen kritisch zu bewerten. 3.72 1.13 −0.83 5.40 11.50 14.30 43.50 25.40
7 Ich kann zwischen vertrauenswürdigen und fragwürdigen Internetseiten mit Gesundheitsinformationen unterscheiden. 3.51 1.21 −0.49 6.00 19.40 14.30 37.80 22.60
8 Ich fühle mich sicher darin, Informationen aus dem Internet zu nutzen, um Entscheidungen in Bezug auf meine Gesundheit zu treffen. 3.40 1.12 −0.34 4.80 20.30 21.60 37.10 16.20
eHealth literacy total 3.63 1.10 −0.65 - - - - -

M: mean; SD: standard deviation.

Abbreviation: GR-eHEALS: German revised version of the eHealth literacy scale.

With regard to sociodemographic variables, the GR-eHEALS sub-dimensions information seeking and information appraisal were significantly related to age (r = −0.16 and −0.19, respectively). Moreover, higher educational degrees were related to higher scores of information seeking (F4,310 = 5.92, p < 0.001) and information appraisal (F4,310 = 6.50, p < 0.001) with post hoc tests indicating that both sub-scales were significantly higher in patients holding a universities/academic degree compared to patients with secondary school certificate. Further, information seeking and information appraisal differed regarding patients’ marital status (F3,311 = 7.83, p < 0.001, and F3,311 = 7.28, p < 0.001, respectively) and the community size they lived in (F3,311 = 6.12, p < 0.001, and F3,311 = 9.59, p < 0.001, respectively).

Regarding convergent and discriminant validity of the GR-eHEALS, Table 4 shows the interrelations of its two sub-dimensions as well as with the eHealth literacy total mean score with digital confidence, knowledge of internet-based health promotion programmes, and duration of private internet use (convergent validity scales) as well as impulsivity (discriminant validity scale).

Table 4.

Pearson correlations of the GR-eHEALS sub-dimension and the eHealth literacy total mean score with convergent and discriminant validity scales.

Scale Information seeking Information appraisal eHealth literacy total
Digital confidence 0.22*** 0.24*** 0.24***
Knowledge of internet-based health promotion programmes 0.51*** 0.47*** 0.52***
Duration of private internet use 0.19*** 0.21*** 0.21***
Impulsivity −0.04 −0.06 −0.05

***p < .001.

Abbreviation: GR-eHEALS: German revised version of the eHealth literacy scale.

The results in Table 4 show that the three convergent validity scales were significantly positively related to the two eHealth literacy sub-scales information seeking and information appraisal, as well as the eHealth literacy total mean score. With regard to the discriminant validity scale, no significant relationships were found.

Criterion validity of the GR-eHEALS in people with CD

In order to examine the interrelations between eHealth literacy and health-related outcomes, correlational analyses of the GR-eHEALS sub-dimension information seeking and information appraisal as well as the eHealth literacy total mean score with health status (physical and mental health), quality of life, and smoking behaviour were conducted. The results are reported in Table 5.

Table 5.

Pearson correlations of the GR-eHEALS sub-dimension with criterion validity scales.

Scale Information seeking Information appraisal eHealth literacy total
Physical health 0.27*** 0.29*** 0.29***
Mental health 0.35*** 0.39*** 0.39***
Quality of life 0.33*** 0.36*** 0.36***
Smoking behaviour a −0.20*** −0.24*** −0.23***

anot smoking vs. smoking.

***p < .001.

Abbreviation: GR-eHEALS: German revised version of the eHealth literacy scale.

As shown in Table 5, all criterion validity scales were significantly related to information seeking and information appraisal and eHealth literacy total mean score. Physical and mental health and quality of life were significantly higher in people with higher eHealth literacy. Further, non-smokers reported higher eHealth literacy than smokers.

Measurement invariance of the GR-eHEALS in people with CD

In order to investigate the measurement invariance of the two-factor GR-eHEALS model regarding the sociodemographic variables, sex, age, and educational level, multi-group CFA was conducted. Results of the multi-group CFA are presented in Table 6.

Table 6.

Results of multi-group CFA regarding sex, age, and educational level.

Sociodemographic variable Invariance level Chi² (df) CFI TLI RMSEA SRMR Δ CFI
Sex
Configural 118.8 (38) 0.997 0.995 0.056 0.040 0.00
Metric 123.0 (44) 0.995 0.993 0.068 0.051 0.00
Scalar 130.9 (50) 0.995 0.994 0.063 0.052 0.00
Age
Configural 118.1 (38) 0.996 0.995 0.057 0.041 0.00
Metric 92.6 (44) 0.996 0.995 0.053 0.048 0.00
Scalar 100.1 (50) 0.996 0.996 0.050 0.049 0.00
Educational level
Configural 107.8 (38) 0.997 0.995 0.052 0.039 0.00
Metric 86.1 (44) 0.997 0.996 0.049 0.047 0.00
scalar 90.5 (50) 0.997 0.997 0.045 0.048 0.00

Chi²: Chi²-coefficient; df: degrees of freedom; CFI: comparative fit index; TLI: Tucker–Lewis index; RMSEA: root mean square error of approximation; SRMR: standardized root mean square residual.

As shown in Table 6, model fit indices for each sociodemographic variable performed slightly worse over the increasingly restrictive models of measurement invariance. Nevertheless, good model fits were found, while there was nearly no deterioration in the CFI over the increasingly restrictive models of measurement invariance. Therefore, measurement invariance up to the scalar level could be confirmed for the GR-eHEALS model regarding the sociodemographic characteristics: sex, age, and educational level.

Discussion

The aims of this study were to critically evaluate the validity of the GR-eHEALS, including the test of its measurement invariance, in people affected by CDs. The results corroborate that the GR-eHEALS is a valid and reliable instrument for measuring eHealth literacy in this clinical cohort. The two-factor model, construct, and criterion validity could be confirmed. Furthermore, measurement invariance regarding patients’ sex, age, and educational level up to the scalar level could also be confirmed.

Besides good model fit indices of the two-factor model, correlational analysis underpinned convergent and discriminant validity, confirming the instrument's overall construct validity. Regarding the convergent validity, the results showed that people with higher eHealth literacy were more confident in using digital media and had more knowledge regarding internet-based health promotion programmes. Furthermore, it was found that there was a positive relation between eHealth literacy and the duration of private internet use. This relationship has already been observed for health literacy: previous research found that low health literacy was associated with less internet use. 50 One possible explanation could be that diverse online experiences enable users to interact more competently with the information provided on the internet. At the same time, competent internet users may feel more at ease online and therefore report more frequent internet use. Summarizing these results, eHealth literacy was related to other cognitive and behavioural constructs regarding the use of digital media and the internet in terms of health-related questions, which provides clear evidence for the convergent validity of the GR-eHEALS. Referring to the examination of discriminant validity, no or just a weak relation between the GR-eHEALS with patients’ impulsivity was expected, which was confirmed by the performed analyses.

Moreover, we looked at possible health-related and behavioural outcomes to examine the criterion validity and found that people with higher eHealth literacy reported better physical and mental health statuses. This relationship was also true for patients’ quality of life. On the behavioural level, our results provide evidence that people with higher eHealth literacy are less likely to smoke cigarettes. This result is especially important in the context of people who are already affected by CDs.

In another step of our analyses, we wanted to investigate whether the GR-eHEALS is an equally valid instrument for measuring eHealth literacy in female and male persons in different age groups as well as different levels of patients’ educational background. Our results underline previously published results of the measurement invariance of the GR-eHEALS regarding sex and educational level. 30 In addition, measurement invariance regarding age could be confirmed in this study. To sum up, measurement invariance could be confirmed, which is a highly important prerequisite for the valid use of the instrument in the study of sociodemographic differences.

eHealth literacy is a critical construct that has been linked to various health-related outcomes and behaviours.1012,14,15,17,18 Furthermore, it is the basis for the effective use of eHealth services. In the context of people being affected by CDs, eHealth literacy makes it possible to empower those patients by granting anonymity and providing convenient, flexible access to basic and advanced information about health-related topics and eHealth services. 51 However, this new form of healthcare may also further divides groups of patients into those with high and low eHealth literacy. 51 Since it has been established that barriers to accessing eHealth services include readability and availability of information and poor usability, there is a high demand for adapted and valid health literacy screening instruments. 50 In the long term, low eHealth literacy could mean that the usefulness of eHealth interventions is low among these individuals, or worse, that newly developed eHealth services do not reach these people at all. These findings are highly relevant for individuals affected by CDs. Only through valid measurement of eHealth literacy, it will be possible to develop interventions to increase eHealth literacy and close the gap of access to health information. 33

Based on these findings, eHealth literacy and its assessment should be utilized to promote positive health behaviours. Dedicated programmes to increase eHealth literacy could be beneficial to patients with CDs and positively impact their health-related outcomes.52,53 This is especially important in the area of eHealth interventions, as lack of eHealth literacy is a key barrier to the use and success of digital health programmes. 54 In this way, people with low eHealth literacy could be specially identified, so that adapted approaches to access digital services would be feasible. Furthermore, this study offers the opportunity to use the GR-eHEALS as a tool to assess the efficacy of interventions to foster eHealth literacy in the population of patients with CDs.

Limitations

When interpreting the present study's results, limitations must be considered. A limitation of the study is that eHealth literacy was only measured through self-assessment. This construct is meant to assess skills and competencies, so it would be more accurate to compare it with actual behaviours or use behaviour-based measurement methods. However, to our knowledge, there is no such tool. Furthermore, an easy-to-use tool is essential to be integrated with the clinical routine. The data collected in this study were cross-sectional, so while it can show relationships, it cannot be used to make causal inferences. Additionally, the survey was conducted online, which may have resulted in a sample that is more representative of individuals who are comfortable using the internet and digital devices and may not accurately reflect the views of those who are less familiar with the web. However, a representative study demonstrated that internet use in Germany reached 91% in 2021 and is further increasing. 55 The study sample is younger than the general population of individuals affected by CAD and CHF. 56 Moreover, the gender ratio of the participants is more balanced and does not reflect the overrepresentation of men affected by CDs. Further, a high number of participants (30.7%, n = 140) could not be included into the CFA and test for measurement invariance due to missing data on the GR-eHEALS items. Therefore, the possibility of selection bias should be considered.

Conclusion

eHealth literacy represents an important ability for people with CDs to find and understand health information on the internet. Furthermore, it is the basis of the successful use of eHealth services. This study confirmed the two-factor structure, construct, and criterion validity of the GR-eHEALS in a sample of people with CDs. Furthermore, measurement invariance up to the scalar level could be confirmed for the GR-eHEALS regarding sex, age, and educational level. To conclude, the GR-eHEALS can be used to assess associations between eHealth literacy and health-related outcomes in individuals with CDs.

Supplemental Material

sj-docx-1-dhj-10.1177_20552076231194915 - Supplemental material for Psychometric properties of the German revised version of the eHealth literacy scale in individuals with cardiac diseases: Validation and test of measurement invariance

Supplemental material, sj-docx-1-dhj-10.1177_20552076231194915 for Psychometric properties of the German revised version of the eHealth literacy scale in individuals with cardiac diseases: Validation and test of measurement invariance by Alexander Bäuerle, Matthias Marsall, Lisa Maria Jahre, Christos Rammos, Charlotta Mallien, Eva-Maria Skoda, Tienush Rassaf, Julia Lortz and Martin Teufel in DIGITAL HEALTH

Acknowledgements

We acknowledge Anna-Lena Frewer (Clinic for Psychosomatic Medicine and Psychotherapy, University of Duisburg-Essen, LVR-University Hospital Essen, 45147 Essen, Germany) for revising the final manuscript draft.

Footnotes

Contributorship: AB, MM, and MT conceptualized the study. Project administration was performed by AB, LJ, JL, and CM. Statistical analyses were conducted by MM. AB and MM interpreted the data. AB, LJ, JL, and MM wrote the original draft of the manuscript. MT, E-MS, CR, and TR supervised the project and contributed to the study design, data collection, and critical revision of the manuscript. All authors reviewed and approved the final manuscript.

The authors declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.

Ethical approval: The study was conducted in accordance with the Declaration of Helsinki and the Ethics Committee of the Essen Medical Faculty (19-89-47-BO).

Funding: The authors disclosed receipt of the following financial support for the research, authorship, and/or publication of this article: The publication is supported by the Open Access Publication Fund of the University of Duisburg-Essen.

Guarantor: AB.

ORCID iDs: Alexander Bäuerle https://orcid.org/0000-0003-1488-8592

Charlotta Mallien https://orcid.org/0000-0003-0929-3789

Supplemental material: Supplemental material for this article is available online.

References

  • 1.World Health Organization. Shanghai declaration on promoting health in the 2030 Agenda for Sustainable Development. Health Promot Int 2017; 32: 7–8. [DOI] [PubMed] [Google Scholar]
  • 2.Nutbeam D. The evolving concept of health literacy. Soc Sci Med 2008; 67: 2072–2078. [DOI] [PubMed] [Google Scholar]
  • 3.Berkman ND, Sheridan SL, Donahue KE, et al. Low health literacy and health outcomes: an updated systematic review. Ann Intern Med 2011; 155: 97–107. [DOI] [PubMed] [Google Scholar]
  • 4.Marciano L, Camerini AL, Schulz PJ. The role of health literacy in diabetes knowledge, self-care, and glycemic control: a meta-analysis. J Gen Intern Med 2019; 34: 1007–1017. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Papadakos JK, Hasan SM, Barnsley J, et al. Health literacy and cancer self-management behaviors: a scoping review. Cancer 2018; 124: 4202–4210. [DOI] [PubMed] [Google Scholar]
  • 6.Wang Y, McKee M, Torbica A, et al. Systematic literature review on the spread of health-related misinformation on social media. Soc Sci Med 2019; 240: 112552. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Alcoreza OB. Science literacy in the age of (dis)information: a public health concern. Acad Med 2021; 96: e12. [DOI] [PubMed] [Google Scholar]
  • 8.Enam A, Torres-Bonilla J, Eriksson H. Evidence-Based evaluation of eHealth interventions: systematic literature review. J Med Internet Res 2018; 20: e10971. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Norman CD, Skinner HA. Ehealth literacy: essential skills for consumer health in a networked world. J Med Internet Res 2006; 8: e9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.An L, Bacon E, Hawley S, et al. Relationship between coronavirus-related eHealth literacy and COVID-19 knowledge, attitudes, and practices among US adults: web-based survey study. J Med Internet Res 2021; 23: e25042. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Mitsutake S, Shibata A, Ishii K, et al. Association of eHealth literacy with colorectal cancer knowledge and screening practice among internet users in Japan. J Med Internet Res 2012; 14: e153. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 12.Park H, Moon M, Baeg JH. Association of eHealth literacy with cancer information seeking and prior experience with cancer screening. Comput Inform Nurs 2014; 32: 458–463. [DOI] [PubMed] [Google Scholar]
  • 13.Stellefson ML, Shuster JJ, Chaney BH, et al. Web-based health information seeking and eHealth literacy among patients living with chronic obstructive pulmonary disease (COPD). Health Commun 2018; 33: 1410–1424. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Britt RK, Collins WB, Wilson KM, et al. The role of eHealth literacy and HPV vaccination among young adults: implications from a planned behavior approach. Commun Res Rep 2015; 32: 208–215. [Google Scholar]
  • 15.Noblin AM, Wan TT, Fottler M. The impact of health literacy on a patient's decision to adopt a personal health record. Perspectives in Health Information Management/AHIMA, American Health Information Management Association 2012; 9: 1–13. [PMC free article] [PubMed] [Google Scholar]
  • 16.Lin CY, Ganji M, Griffiths MD, et al. Mediated effects of insomnia, psychological distress and medication adherence in the association of eHealth literacy and cardiac events among Iranian older patients with heart failure: a longitudinal study. Eur J Cardiovasc Nurs 2020; 19: 155–164. [DOI] [PubMed] [Google Scholar]
  • 17.Mitsutake S, Shibata A, Ishii K, et al. Associations of eHealth literacy with health behavior among adult internet users. J Med Internet Res 2016; 18: e192. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Tsukahara S, Yamaguchi S, Igarashi F, et al. Association of eHealth literacy with lifestyle behaviors in university students: questionnaire-based cross-sectional study. J Med Internet Res 2020; 22: e18155. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.World Health Organization. https://www.who.int/health-topics/cardiovascular-diseases#tab=tab_1. (Accessed 04.01.23). 2023.
  • 20.Bays HE, Taub PR, Epstein E, et al. Ten things to know about ten cardiovascular disease risk factors. Am J Prev Cardiol 2021; 5: 100149. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Mozaffarian D, Wilson PW, Kannel WB. Beyond established and novel risk factors: lifestyle risk factors for cardiovascular disease. Circulation 2008; 117: 3031–3038. [DOI] [PubMed] [Google Scholar]
  • 22.Peltzer S, Hellstern M, Genske A, et al. Health literacy in persons at risk of and patients with coronary heart disease: a systematic review. Soc Sci Med 2020; 245: 112711. [DOI] [PubMed] [Google Scholar]
  • 23.Kanejima Y, Shimogai T, Kitamura M, et al. Impact of health literacy in patients with cardiovascular diseases: A systematic review and meta-analysis. Patient Educ Couns 2021; 105: 1793–1800. [DOI] [PubMed] [Google Scholar]
  • 24.Kemp BJ, Thompson DR, Watson CJ, et al. Effectiveness of family-based eHealth interventions in cardiovascular disease risk reduction: a systematic review. Prev Med 2021; 149: 106608. [DOI] [PubMed] [Google Scholar]
  • 25.McMahon J, Thompson DR, Pascoe MC, et al. Ehealth interventions for reducing cardiovascular disease risk in men: a systematic review and meta-analysis. Prev Med 2021; 145: 106402. [DOI] [PubMed] [Google Scholar]
  • 26.Su JJ, Yu DSF, Paguio JT. Effect of eHealth cardiac rehabilitation on health outcomes of coronary heart disease patients: a systematic review and meta-analysis. J Adv Nurs 2020; 76: 754–772. [DOI] [PubMed] [Google Scholar]
  • 27.Ernsting C, Stuhmann LM, Dombrowski SU, et al. Associations of health app use and perceived effectiveness in people with cardiovascular diseases and diabetes: population-based survey. JMIR Mhealth Uhealth 2019; 7: e12179. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 28.Richtering SS, Morris R, Soh SE, et al. Examination of an eHealth literacy scale and a health literacy scale in a population with moderate to high cardiovascular risk: Rasch analyses. PLoS One 2017; 12: e0175372. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Lee WL, Lim ZJ, Tang LY, et al. Patients’ Technology Readiness and eHealth Literacy: Implications for Adoption and Deployment of eHealth in the COVID-19 Era and Beyond. Comput Inform Nurs 2021; 40: 244–250. [DOI] [PubMed] [Google Scholar]
  • 30.Marsall M, Engelmann G, Skoda EM, et al. Measuring electronic health literacy: development, validation, and test of measurement invariance of a revised German version of the eHealth literacy scale. J Med Internet Res 2022; 24: e28252. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Dimitrov DM. Testing for factorial invariance in the context of construct validation. Meas Eval Couns Dev 2017; 43: 121–149. [Google Scholar]
  • 32.Vandenberg RJ, Lance CE. A review and synthesis of the measurement invariance literature: suggestions, practices, and recommendations for organizational research. Organ Res Methods 2016; 3: 4–70. [Google Scholar]
  • 33.Levin-Zamir D, Bertschi I. Media Health Literacy, eHealth Literacy, and the Role of the Social Environment in Context. Int J Environ Res Public Health 2018; 15, 2018/08/08. DOI: 10.3390/ijerph15081643. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Neter E, Brainin E. Ehealth literacy: extending the digital divide to the realm of health information. J Med Internet Res 2012; 14: e19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Tivian XI GmbH. Unipark. 2004.
  • 36.Kyriazos TA. Applied psychometrics: sample size and sample power considerations in factor analysis (EFA, CFA) and SEM in general. Psychology 2018; 09: 2207–2230. [Google Scholar]
  • 37.Rouquette A, Falissard B. Sample size requirements for the internal validation of psychiatric scales. Int J Methods Psychiatr Res 2011; 20: 235–249. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Norman CD, Skinner HA. eHEALS: the eHealth literacy scale. J Med Internet Res 2006; 8: e27. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Bäuerle A, Frewer AL, Rentrop V, et al. Determinants of acceptance of weight management applications in overweight and obese individuals: using an extended unified theory of acceptance and use of technology model. Nutrients 2022; 14: 20220508. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Rentrop V, Damerau M, Schweda A, et al. Predicting acceptance of e-mental health interventions in patients with obesity by using an extended unified theory of acceptance model: cross-sectional study. JMIR Form Res 2022; 6: e31229. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Campbell DT, Fiske DW. Convergent and discriminant validation by the multitrait-multimethod matrix. Psychol Bull 1959; 56: 81–105. [PubMed] [Google Scholar]
  • 42.Kovaleva ABC, Kemper CJ, Rammstedt B. Die Skala Impulsives-Verhalten-8 (I-8). Zusammenstellung sozialwissenschaftlicher Items und Skalen (ZIS) 2014. 10.6102/zis183 . [DOI] [Google Scholar]
  • 43.R Core Team. R: A language and environment for statistical computing. Vienna, Austria: R Foundation for Statistical Computing, 2022. [Google Scholar]
  • 44.RStudio Team. RStudio: Integrated Development for R. PBC. Boston, MA: RStudio, 2020. [Google Scholar]
  • 45.Hu L, Bentler PM. Cutoff criteria for fit indexes in covariance structure analysis: conventional criteria versus new alternatives. Structural Equation Modeling: A Multidisciplinary Journal 1999; 6: 1–55. [Google Scholar]
  • 46.Finney SJ, DiStefano C. Non-normal and categorical data in structural equation modeling. Structural Equation Modeling: A Second Course 2006; 10: 269–314. [Google Scholar]
  • 47.Sellbom M, Tellegen A. Factor analysis in psychological assessment research: common pitfalls and recommendations. Psychol Assess 2019; 31: 1428–1441. [DOI] [PubMed] [Google Scholar]
  • 48.Widaman KF, Reise SP. Exploring the measurement invariance of psychological instruments: applications in the substance use domain. In: Bryant KJ, Windle M, West SG. (eds) The science of prevention: methodological advances from alcohol and substance abuse research. Washington, DC: American Psychological Association, 1997, pp.281–324. [Google Scholar]
  • 49.Putnick DL, Bornstein MH. Measurement invariance conventions and reporting: the state of the art and future directions for psychological research. Dev Rev 2016; 41: 71–90. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Kim H, Xie B. Health literacy in the eHealth era: a systematic review of the literature. Patient Educ Couns 2017; 100: 1073–1082. [DOI] [PubMed] [Google Scholar]
  • 51.Korp P. Health on the internet: implications for health promotion. Health Educ Res 2006; 21: 78–86. [DOI] [PubMed] [Google Scholar]
  • 52.Chang SJ, Jang SJ, Lee H, et al. Building on evidence to improve eHealth literacy in older adults: a systematic review. Comput Inform Nurs 2021; 39: 241–247. [DOI] [PubMed] [Google Scholar]
  • 53.Watkins I, Xie B. Ehealth literacy interventions for older adults: a systematic review of the literature. J Med Internet Res 2014; 16: e225. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Smith B, Magnani JW. New technologies, new disparities: the intersection of electronic health and digital health literacy. Int J Cardiol 2019; 292: 280–282. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Initiative D21. Digital Index 2021/2022. Jährliches Lagebild zur Digitalen Gesellschaft. https://initiatived21.de/app/uploads/2022/02/d21-digital-index-2021_2022.pdf. (Accessed 04.01.23). 2022.
  • 56.Deutsche Herzstiftung eV [German Heart Foundation eV]. Deutscher Herzbericht 2021. https://herzstiftung.de/system/files/2022-09/DHB21-Herzbericht-2021.pdf. Accessed 7 Juni 2023. 2022.

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

sj-docx-1-dhj-10.1177_20552076231194915 - Supplemental material for Psychometric properties of the German revised version of the eHealth literacy scale in individuals with cardiac diseases: Validation and test of measurement invariance

Supplemental material, sj-docx-1-dhj-10.1177_20552076231194915 for Psychometric properties of the German revised version of the eHealth literacy scale in individuals with cardiac diseases: Validation and test of measurement invariance by Alexander Bäuerle, Matthias Marsall, Lisa Maria Jahre, Christos Rammos, Charlotta Mallien, Eva-Maria Skoda, Tienush Rassaf, Julia Lortz and Martin Teufel in DIGITAL HEALTH


Articles from Digital Health are provided here courtesy of SAGE Publications

RESOURCES