Abstract
Objective:
Digital Health Literacy (DHL) is becoming a cardinal competence for all healthcare professionals (HCPs) including medical students for meaningful digital transformation of healthcare. As medical students need to navigate an increasingly digitalized healthcare environment, thus the study’s objective was to assess digital health literacy among medical students.
Methods:
This cross-sectional analytical study was conducted at King Edward Medical University, Lahore from October 2022 to August 2023. Medical students were asked to complete a pen and paper questionnaire of the Digital Health Literacy Instrument (DHLI) after informed consent. DHLI covers seven categories: operational skills, information searching strategy, analyzing the usefulness of online information, navigational abilities, contributing user-generated material to internet-based platforms, and privacy protection. SPSS was used for data analysis.
Results:
Eight hundred ninety one medical students, from first year to final year, participated in the study. The overall mean score for DHL was 63.5 (SD=8.82). Medical students achieved a score of 83.2% of total score in their operational abilities, and 82.3% proficiency in privacy protection, which were deemed highly desirable. Furthermore, they achieved a satisfactory level in navigation skill (76.0%), information searching (73.1%), adding content (71.0%), determining the significance of data (70.1%), and assessing data reliability (68.7%), based on the overall score. A significant relationship was observed between the performance level of DHL domains and gender with higher scores in males in all domains except protecting privacy, which was higher in females and clinical years students (p-value < 0.05).
Conclusion:
The assessment of the DHL of medical students was deemed desirable. But certain obstacles were encountered in few domains of DHL i.e., data reliability, relevance determination, and content augmentation. It is imperative to elevate the level of DHL of medical students to harness the potential of digital technologies in enhancing healthcare.
KEYWORDS: Digital health literacy, DHL, eHealth literacy, Medical students, Medical education
INTRODUCTION
Digitalization in medicine is being considered as a critical answer to the various challenges being faced by healthcare systems all around the globe. These challenges include but are not limited to scarce resources especially in low and middle-income countries (LMICs), shortage of health services workforce, changing demographics of population, rise in non-communicable diseases and comorbidities.1
Digital health technologies harbor the potential to transform the health services delivery landscape and enhance outcomes for patients, healthcare workers and health systems. Therefore, the World Health Organization has placed Digital health as a top priority within their digital agenda.2 Considering the rapidly evolving state of global health, the widespread accessibility to web-based apps and greater merger between digital technologies and health, it takes a diverse range of skills—referred to as “digital health literacy” (DHL)—to make the most of these opportunities. DHL is described as “the ability to search, find, understand, and evaluate health information from electronic resources and to use the knowledge gained to solve health-related problems”.3
DHL is becoming an essential competence for all healthcare professionals (HCPs) for meaningful digital transformation of healthcare. Despite the requirement, existing literature on DHL among healthcare workers is not consistent, with some studies noting that the health care industry is adequately skilled in several DHL areas, including patient privacy protection and operational proficiency,4 while other studies found limited DHL of HCPs to act as a barrier to implement digital health services.5,6 Some challenges to digital health literacy have also been noted, such as users’ lack of the necessary skills in complex online information, online fraud and unverified information, and power outages in low-income nations.7-9 Various determinants influencing DHL have been identified; Personal determinants (age, gender, ethnicity, level of education), Relational Determinants (Language and cultural barriers), Knowledge determinants (Preexisting knowledge about health issues) and technological determinants like access to devices/ gadgets etc.).10-12
Medical students, being the future “frontline” workers, need to be prepared with essential skills to navigate an increasingly digitalized healthcare environment.13 Studies on DHL of medical students are limited. Studies from Europe noted good DHL in medical students, however difficulties in creating online content and evaluating online information were still faced by many.14,15 DHL is important not only in service delivery and patient support but also plays a role in medical student’s own health and wellbeing and role as health promoters. Thus, understanding and awareness of level of DHL among medical students can help in guiding curriculum, planning interventions, and addressing it at policy level.16
Currently, to our knowledge, there are no studies in Pakistan focusing on DHL among medical students only. Considering the relevance of digital health literacy for medical students joining the health sector, the purpose of this study was to investigate the levels of digital health literacy among undergraduate medical students in Lahore, Pakistan.
METHODS
In 2023, a cross-sectional analytical study was conducted. Registered undergraduate medical students in all five years at KEMU (a public sector medical school) were eligible to participate. Principal Investigators explained the purpose and significance of the study, its voluntary and confidential nature, and benefits of participation at the beginning of study and participants gave written informed consent. The anonymous pen and paper questionnaire was distributed among all students during lectures. It had two main sections. 1) Personal demographic information. 2) Digital Health Literacy Instrument (DHLI).17 The Digital Health Literacy Index (DHLI) was used to assess the digital health literacy of medical students, following communication with the questionnaire authors via email and obtaining their consent. The first five of these categories were graded on a Likert scale of 1–4 (1-very difficult, 2- difficult, 3-easy, and 4-very easy). Navigational skills and protecting privacy were assessed on a four point scale as never-1, 2-sometimes, 3-often, 4-always. The internal consistency of DHLI was measured by Cronbach’s alpha index which was 0.8.
Ethical Approval
The Institutional Review Board of King Edward Medical University (KEMU) granted ethical approval (112/RC/KEMU).
Statistical Analysis
After data collection, it was analyzed using SPSS version 26. Descriptive statistics were computed for demographic variables. To compare means between different student groups, analytical statistics (Independent t-test) was used. A p-Value <0.05 was considered statistically significant. Furthermore, the criteria for evaluating each of the seven skills were a percentage of the overall score attained in each skill. Less than 20% score means that skill is ‘very undesirable’, 21-40% means ‘undesirable’, 41-60% means ‘average’, 61-80% means ‘desirable’ and 81-100% means ‘very desirable’.4
RESULTS
Nine hundred fifteen questionnaires were returned out of a total of one thousand distributed to undergraduate medical students (return rate = 91.5%). Because the questionnaires of 24 individuals were incomplete, they were not included in the analysis; hence, the data from N=891 questionnaires was used. Most of them (55% of them) were females. The average age of the students was 21.1 years (standard deviation=1.63). Table-I describes the demographic characteristics of all participants.
Table-I.
Demographic characteristics of all the participants (N=891).
| Category | Number of participants (n) | Percentage (%) | |
|---|---|---|---|
| Age in years (mean, SD) | 21.1 (1.63) | ||
| Gender | Female | 490 | 55 |
| Male | 392 | 44 | |
| Prefer not to say. | 9 | 1 | |
| Living arrangement | Hostellite | 615 | 69 |
| Day scholars | 271 | 30.4 | |
| Year of Study | First-year | 140 | 15.7 |
| Second year | 312 | 35 | |
| Third year | 112 | 12.6 | |
| Fourth year | 161 | 18.1 | |
| Fifth year | 165 | 1 | |
The participants’ internet usage trends are shown in Table-II. Of the students, 51.1% reported that they used the internet “almost every day.” Only 101 students claimed to have ‘almost never’ used the internet’s services. The most used device was discovered to be a mobile phone, followed by a laptop, while a public computer was found to be the least liked. The majority of respondents (45.6%) gave themselves “Good” ratings for their internet skills. Numerous internet usage factors that are related to health were also evaluated. The most frequent justification for using the internet was to ‘search information on health and illnesses.
Table-II.
Pattern of internet usage among the participants. (N=891)
| Parameters | Number of participants (n) | Percentage (%) |
|---|---|---|
| Frequency of Internet use | ||
| (Almost) every day | 455 | 51.1 |
| Several days a week | 190 | 21.3 |
| About once a week | 139 | 15.6 |
| (Almost) never | 101 | 11.3 |
| Means of Internet access | ||
| Mobile phone | 848 | 95.2 |
| Laptop | 340 | 38.2 |
| Tablet | 89 | 10 |
| Personal computer at home | 57 | 6.9 |
| Computer at work | 26 | 2.9 |
| Public computer | 26 | 2.9 |
| Self-rated Internet skills | ||
| Excellent | 173 | 19.4 |
| Good | 406 | 45.6 |
| Average | 241 | 27 |
| Reasonable | 40 | 4.5 |
| Poor | 20 | 2.2 |
| Number of respondents who have ever used the Internet to… | ||
| Search for information on health or illness | 809 | 90.8 |
| Read/post a health relayed review. | 625 | 70.1 |
| Monitor disease symptoms. | 605 | 67.9 |
| Use any health-related app. | 531 | 59.6 |
| Schedule an appointment with their health care provider | 283 | 31.8 |
| Share personal medical information with others. | 249 | 27.9 |
| Ask a question of their health care provider. | 240 | 26.9 |
| Post a message on a peer support forum or social media website. | 196 | 22 |
| Take a web based self-management course. | 165 | 18.5 |
| Log on to their own electronic medical record | 153 | 17.2 |
The overall mean score for DHL was 63.5 (SD=8.82). It implies that on average, the students manifested a commendable degree of proficiency in digital health literacy. The mean score values of various domains of DHL are shown in Table-III. It shows that the scores of participants in various domains of DHL are ‘desirable’ or ‘very desirable’.
Table-III.
Digital Literacy Domains and Interpretation.
| Domains of Digital literacy | Percentage of Total Score | Mean±SD | Interpretation |
|---|---|---|---|
| Operational skills | 83.22 | 9.98 ± 1.81 | Very Desirable |
| Information searching | 73.15 | 8.77± 1.67 | Desirable |
| Evaluating data reliability | 68.78 | 8.25 ± 1.79 | Desirable |
| Determining data relevance | 70.11 | 8.41 ± 2.10 | Desirable |
| Navigational skills | 76.09 | 9.13 ± 1.72 | Desirable |
| Adding content | 71.08 | 8.53 ± 1.84 | Desirable |
| Protecting privacy | 82.37 | 9.88 ± 1.64 | Very Desirable |
The independent T-test was utilized to compare the DHLI mean scores and showed significant statistical difference between the two genders. The mean score was higher in males in all DHL domains (p<0.05) other than protecting privacy (p>0.05). There was no statistically significant difference, in mean DHLI scores of students in preclinical years of study than those who study in clinical years in terms of operational and navigational skills, searching information, evaluating data reliability, determining data relevance, and adding content on social media forums (p>0.05), but the mean score for protecting privacy was higher for students studying in clinical years than those studying in preclinical years (p<0.05).
DISCUSSION
In today’s era of rapidly developing technology and increasing prevalence of digital solutions within the healthcare industry, the value of digital health literacy cannot be overlooked. HCP’s own Digital health literacy is noted to have a significant impact on DHL of patients. Currently, we believe this is the first study in Pakistan to focus on digital health literacy of medical students. The findings indicate that in general, the DHL of medical students is at a desirable level.
Advancements in this field have significant potential that may lead to improved health outcomes and reduce the technology barrier.18 Factors such as age, ethnicity, academic background contribute to varying levels of digital literacy across regions of the.19 In terms of digital usage patterns among student participants, mobile phones were the most often utilized technical equipment (848, 95%). This discovery is hardly surprising given the swift rise in mobile phone ownership and usage worldwide, including in Pakistan.20
The internet is rapidly becoming the primary source of students seeking health information.21,22 Like previous studies of medical students, study results also indicated searching for information related to health and illness as the most frequent purpose of internet use (91%).20 Students medical background can be a contributing factor to the wide gap with only 33%-63% of general internet users using internet for seeking health information.21,22
Medical students have stronger digital health literacy on average than members of the general public and university students.23 DHL demands crucial operational and navigation abilities for searching for and implementing online information in daily life. The current study’s participants received a remarkable 83% of the overall score in the “operational skills” domain; this also being the highest score of all DHL categories and at a highly desired level. Medical students were more likely to navigate the Internet with ease and research on health issues and search with specific keywords (73%). We believe that this could be due to several reasons. A previous study showed that the general public of Pakistan suffers from a lack of access to the latest technologies which contributed to a factor of low digital health literacy.12 Medical students, on the other hand, have access to a wide library of academic resources which equip them with up-to-date information on digital health. Digital health topics are also widely integrated into their training which gives them the exposure to be more proficient in using digital health tools. Furthermore, clinical experience helps students to interact with cutting-edge digital technology, increasing their comfort level with these tools. These characteristics offer them far more exposure than the broader population, which might explain these outcomes. It should be noted, however, that while medical majors may have a higher level of digital literacy, this is also reliant on the amount of exposure they receive and their own desire to incorporate it into their everyday practice. A study based in Taiwan also found that Medical Students tend to have greater health concerns which lead to improved eHealth Literacy Development.24
Evaluating the quality of health information is an important aspect of health literacy. Unreliable information can have major implications for patient treatment. The greatest obstacles were identified in determining the dependability of data available on the internet and in adding material. We found that while medical students had a desired level of rating the dependability of health information (69%), they had a somewhat wide gap with the desirable level. They were less confident to rely on this information (69%) and use it to take health related decisions for patients. This is in line with other studies where the confidence of reliable information comes into play. A study in Brazil found that students find it difficult to differentiate quality of online resources .11 With millions of health-related websites available, it can often become confusing for people to choose a reliable source for their questions.25 As the availability of online health information increases, it is imperative to tackle the issue of reliable information and guide people towards approved/validated websites. Promoting awareness and education about reliable health-related sources can assist the public in making informed decisions and avoiding potential hazards connected with misinformation or low-quality resources. This might include identifying reliable sources and fostering critical thinking skills to assess the authenticity of internet health information. Furthermore, students require more supervision and encouragement in terms of adding content as well as their ability to frame health-related queries and communicate their opinions in a comprehensible manner that the recipient of the message may understand.17
This study’s findings also revealed that the average DHL of students varied greatly depending on their gender. Male students exhibited higher levels of DHL as compared to females. This aligns with previous studies, which indicate that gender influences one’s ability to assess and evaluate information online.8,26 As a result, it is critical to devise methods that explicitly target and assist females’ digital health literacy needs to close the gender gap in online health information assessment and evaluation.
Limitations
Our results are limited by data collection from one Institute, which does not allow generalization of results. Social Desirability Bias is one of the most common sources of research bias. As with most self-reported studies, participants have the tendency to select certain answers which they may believe to be perceived as more desirable. While the study included research design to incorporate self-report measures and maintained anonymity, this could affect the validity of the research. It is recommended that future studies should have both self-report as well as performance-based evaluation methods to reduce bias. Furthermore, given the survey was carried out in the English native language, participants may have misinterpreted certain questions. However, given the fact that medical studies in Pakistan are in the English language, this is not expected to be a significant barrier.
CONCLUSION
Study contributes to an expanding body of information based on DHL among medical students, who as future healthcare professionals should be able to use technology effectively for better healthcare outcomes. Although overall, DHL of medical students was assessed as desirable, challenges were noted in evaluating reliability, determining relevance, and adding content. It is imperative to increase the DHL levels to a very desirable level in all domains. Study results give medical schools the opportunity for proper policy making and planning for educating and engaging the medical students in improving their DHL skills to an optimal level. Recommendation of incorporating digital health skills explicitly within the medical college curriculum may provide sound basic understanding of digital health and technology assisted care.27
Authors’ contribution:
ZF did data collection, statistical analysis and contributed in manuscript writing.
AI did literature review and helped with synopsis and writing of manuscript.
NI conceptualized the study, supervised the research, did literature review, and critically reviewed the manuscript and is responsible for overall integrity of the work.
Acknowledgement:
We are grateful to Prof Dr Farooq Naeem, Dr Mirrat Gul Butt and Dr Zainab Pervaiz for their guidance and support in conceptualization of the projects related to digital literacy.
Footnotes
Data Availability Statement: Data is available from the corresponding author upon reasonable request.
Competing Interests: None.
Grant Support & Financial Disclosures: None.
REFERENCES
- 1.European C. Communication on enabling the digital transformation of health and care in the Digital Single Market;empowering citizens and building a healthier society. [(Accessed on 3rd Feb 2023)]. https://ec.europa.eu.:European Commission;2018. Website:https://ec.europa.eu/newsroom/dae/document.cfm?doc_id=51628.
- 2.World Health Organization. WHO Guideline:recommendations on digital interventions for health system strengthening. World Health Organization. WHO guideline. 2019. [(Accessed on 4th Feb 2023)]. Website: https://apps.who.int/iris/bitstream/handle/10665/311941/9789241550505-eng.pdf?ua=1 . [PubMed]
- 3.Krausz M, Westenberg JN, Vigo D, Spence RT, Ramsey D. Emergency response to COVID-19 in Canada:platform development and implementation for eHealth in crisis management. JMIR Public Health Surveill. 2020;6(2):e18995. doi: 10.2196/18995. doi:10.2196/18995. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Alipour J, Payandeh A. Assessing the level of digital health literacy among healthcare workers of teaching hospitals in the southeast of Iran. Inform Med Unlocked. 2022;29:100868. [Google Scholar]
- 5.Machleid F, Kaczmarczyk R, Johann D, Balčiūnas J, Carbonell AB, Maltzahn VF, et al. Digital health in medical education:Findings from a mixed-methods survey among European medical students. J Med Internet Res. 2020:10. doi: 10.2196/19827. doi:10.2196/preprints.19827. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Schreiweis B, Pobiruchin M, Strotbaum V, Suleder J, Wiesner M, Bergh B, et al. Barriers, and facilitators to the implementation of eHealth services:systematic literature analysis. J Med Internet Res. 2019;21(11):e14197. doi: 10.2196/14197. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Adil A, Usman A, Jalil A. Qualitative analysis of digital health literacy among university students in Pakistan. J Hum Behav Soc Environ. 2021;31(6):771–781. doi:10.1080/10911359.2020.1812462. [Google Scholar]
- 8.Dadaczynski K, Okan O, Messer M, Leung AY, Rosário R, Darlington E, et al. Digital health literacy and web-based information-seeking behaviors of university students in Germany during the COVID-19 pandemic:cross-sectional survey study. J Med Internet Res. 2021;23(1):e24097. doi: 10.2196/24097. doi:10.2196/24097. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Rosario R, Martins MRO, Augusto C, Silva MJ, Martins S, Duarte A, Fronteira I, et al. Associations between covid-19-related digital health literacy and online information-seeking behavior among Portuguese university students. Int J Environ Res Public Health. 2020;17(23):8987. doi: 10.3390/ijerph17238987. doi:10.3390/ijerph17238987. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Paige SR, Stellefson M, Krieger JL, Lewis AC, Cheong J, Stopka C, et al. Proposing a Transactional Model of eHealth Literacy:Concept Analysis. J Med Internet Res. 2018;20(10):e10175. doi: 10.2196/10175. doi:10.2196/10175. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Macedo BS, Yamaguchi MU, Santos ER, Dias KM, Aprile DC, Lopes CT, et al. Digital health literacy of nursing or medical students:related factors. Acta Paul Enferm. 2022:35. doi:10.37689/acta-ape/2022AO026477. [Google Scholar]
- 12.Adil A, Usman A, Khan NM, Mirza FI. Adolescent health literacy:factors effecting usage and expertise of digital health literacy among universities students in Pakistan. BMC Public Health. 2021;21(1):1–6. doi: 10.1186/s12889-020-10075-y. doi:10.1186/s12889-020-10075-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Usmani A, Imran M, Javaid Q. Usage of artificial intelligence and virtual reality in medical studies. Pak J Med Sci. 2022;38(4):777–779. doi: 10.12669/pjms.38.4.5910. doi:10.12669/pjms.38.4.5910. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Doherty OD, Lougheed J, Hannigan A, Last J, Dromey M, Tuathaigh OC, et al. Internet skills of medical faculty and students:is there a difference? BMC Med Educ. 2019;19(1):39. doi: 10.1186/s12909-019-1475-4. doi:10.1186/s12909-019-1475-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Loda T, Erschens R, Junne F, Stengel A, Zipfel S, Werner HA, et al. Undergraduate medical students'search for health information online:explanatory cross-sectional study. JMIR Med Inform. 2020;8(3):e16279. doi: 10.2196/16279. doi:10.2196/16279. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Frings D, Sykes S, Ojo A, Rowlands G, Trasolini A, Dadaczynski K, et al. Differences in digital health literacy and future anxiety between health care and other university students in England during the COVID-19 pandemic. BMC Public Health. 2022;22(1):658. doi: 10.1186/s12889-022-13087-y. doi:10.1186/s12889-022-13087-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Van der Vaart R, Drossaert C. Development of the digital health literacy instrument:measuring a broad spectrum of health 1.0 and health 2.0 skills. J Med Internet Res. 2017;19(1):e27. doi: 10.2196/jmir.6709. doi:10.2196/jmir.6709,eng. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Yang K, Hu Y, Qi H. Digital health literacy:bibliometric analysis. J Med Internet Res. 2022;24(7):e35816. doi: 10.2196/35816. doi:10.2196/35816. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Paakkari L, Okan O. COVID-19:health literacy is an underestimated problem. Lancet Public Health. 2020;5(5):249–250. doi: 10.1016/S2468-2667(20)30086-4. doi:10.1016/S2468-2667(20)30086-4. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Hassan R, Elsalamony OK, Aziz AS, Fathelbab M, Sabry HA. Digital Health Usage and Awareness among Medical Students:A Survey Study. Open Access Maced J Med Sci. 2021;9:867–71. doi:10.3889/oamjms.2021.7007. [Google Scholar]
- 21.Ashkanani H, Asery R, Bokubar F, Ali AN, Mubarak S, Buabbas A, et al. Web-based health information seeking among students at Kuwait University:cross-sectional survey study. JMIR Form Res. 2019;3(4):e14327. doi: 10.2196/14327. doi:10.2196/14327. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Alkhatlan HM, Rahman KF, Aljazzaf BH. Factors affecting seeking health-related information through the internet among patients in Kuwait. Alex J Med. 2018;54(4):331–336. doi:10.1016/j.ajme.2017.05.008. [Google Scholar]
- 23.Zakar R, Iqbal S, Zakar MZ, Fischer F. COVID-19 and health information seeking behavior:digital health literacy survey amongst university students in Pakistan. Int J Environ Res Public Health. 2021;18(8):4009. doi: 10.3390/ijerph18084009. doi:10.3390/ijerph18084009. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Hsu W, Chiang C, Yang S. The effect of individual factors on health behaviors among college students:the mediating effects of eHealth literacy. J Med Internet Res. 2014;16(12):e287. doi: 10.2196/jmir.3542. doi:10.2196/jmir.3542. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Sethuram R, Weerakkody AN. Health information on the internet. J Obstet Gynaecol. 2010;30(2):119–121. doi: 10.3109/01443610903440927. doi:10.3109/01443610903440927. [DOI] [PubMed] [Google Scholar]
- 26.Liu TT, Sun HB. Gender differences on information literacy of science and engineering undergraduates. Int. J. Mod. Educ. Comput. Sci. 2012;4(2):23–30. doi:10.5815/ijmecs.2012.02.04. [Google Scholar]
- 27.Baumgartner M, Sauer C, Blagec K, Dorffner G. Digital health understanding and preparedness of medical students:a cross-sectional study. Med Edu Online. 2022;27(1):2114851. doi: 10.1080/10872981.2022.2114851. doi:10.1080/10872981.2022.2114851. [DOI] [PMC free article] [PubMed] [Google Scholar]
