Abstract
Background
The opioid crisis in the US remains a critical public health issue. Accessible, high-quality online health information is vital for educating the public about opioid use disorder (OUD) and available treatment options. This study aims to evaluate and compare the readability, accessibility, and quality of OUD-related information on government and non-government websites to identify areas for improvement.
Methods
A total of 30 websites, 21 government-operated and 9 non-governmental, were selected through a systematic search. Readability was assessed using Gunning Fog, Simple Measure of Gobbledygook (SMOG), and Flesch Reading Ease Score (FRES) tests. Accessibility was evaluated using the WAVE tool, which checks for errors and adherence to Web Content Accessibility Guidelines (WCAG). Quality was measured using the DISCERN Instrument, a standardized tool for evaluating the quality of health information. Data were analyzed for statistical differences between government and non-government websites.
Results
The average readability grade level across all websites was 14.63 and average FRES score was 31.63, indicating content requiring advanced reading skills, with no significant difference between government and non-government websites. Accessibility issues were more prevalent on non-government websites. Government websites scored significantly lower in terms of quality, with 80.95% of them rated as “poor” or “very poor” compared with 22.22% of non-government websites. The overall quality scores for both groups remained suboptimal, with an average DISCERN score of 39.52 out of 80.
Conclusions
The findings highlight a critical need for improvements in the readability, accessibility, and quality of online health information on OUD. Government websites, in particular, require enhancements to ensure they meet the public's need for reliable, accessible, and comprehensible health resources.
Keywords: Readability, accessibility, quality, health literacy, internet, information
BACKGROUND
Opioid use disorder (OUD) has been declared a public health emergency in the United States due to its devastating impact on individuals, families, and communities.1 The crisis is marked by persistently high rates of misuse, dependence, and overdose mortality, with annual deaths nearly doubling between 2019 and 2022 to more than 81,000.2 Beyond mortality, OUD contributes to extensive health and social harms, including increased risk of infectious disease transmission,3 co-occurring mental health disorders,4 child welfare involvement,5 and criminal justice involvement.6 Addressing this crisis requires a comprehensive approach that integrates prevention, treatment, harm reduction, and recovery support, while also ensuring that the public has access to accurate, timely, and accessible information on opioid risks and evidence-based treatment options.
Public health interventions have increasingly focused on expanding access to evidence-based treatments by mitigating systemic barriers, including limited access to clinicians, insurance challenges, and inequities in the distribution of treatment resources. Despite these efforts, gaps remain; in 2021, approximately 2.5 million adults in the US were estimated to have opioid use disorder, yet only 36% received treatment, with an even smaller fraction (around 22%) receiving medications despite clinical guidelines that recommend the use of medications for OUD.7
Online health information is a crucial asset in combating the opioid epidemic by facilitating better public education, expanding access to treatment resources, and fostering community engagement, all of which are necessary components in reducing opioid-related harm. Effective public information and communication strategies are critical to reducing stigma, shaping public attitudes, and increasing treatment engagement.8–10
Despite the growing availability of online resources for OUD, there is a scarcity of research that systematically assesses the readability, accessibility, and quality of webbased information. Studies have consistently shown that online health materials across topics are written above recommended reading levels, limiting their utility for the general public.11–13 In the context of OUD, the evidence base is particularly limited a few studies highlight readability concerns in naloxone (an opioid overdose reversal medication) and OUD-related websites,14,15 while others point to the spread of misinformation related to medications for OUD.16 Accessibility has also been underexamined in OUD research, though broader evaluations of health websites demonstrate persistent gaps, including barriers for people with disabilities.17,18
Notably, there is a particular lack of research directly comparing government versus non-government websites, despite both being key sources of information for the public. Government-based websites hold a unique responsibility in this landscape due to their role in disseminating accurate, high-quality, and inclusive information. Given their public trust, legal obligations, and ethical mandates, these sites should prioritize readability, accessibility, and reliability, as they are crucial for ensuring equitable access to health information across diverse populations. Historical research suggested that government websites were often more accessible than privately operated ones due to compliance requirements, yet still fell short of optimal standards.19,20
More recent work underscores these concerns. Analyses of state and territorial public health websites and patient education resources show poor accessibility and readability,21,22 provincial government messaging has been found to exceed recommended readability thresholds,23 and even international and federal agency websites have been criticized for overly complex language.24 These findings indicate that while government websites may in some respects be more accessible than their counterparts, neither consistently reaches acceptable levels of readability or accessibility. Therefore, the objective of this study was to systematically evaluate the readability, accessibility, and quality of online health information on OUD, with a particular emphasis on comparing government-operated websites with non-government websites. This evaluation aims to provide insights into the current state of online health information and identify areas for improvement to better serve the public in addressing the opioid epidemic.
Health Literacy
Health literacy remains a significant public health concern in the United States, with many Americans struggling to understand and use health information effectively. According to the 2023 U.S. Program for International Assessment of Adult Competencies (PIAAC) report, 28% of adults scored at or below Level 1, indicating they could understand only simple sentences.25 In contrast, only 44% reached Level 3 or higher, the threshold considered the minimum for full proficiency. Alarmingly, the proportion of adults scoring below or at a Level 1 has risen from 19% in 2017 to 28% in 2023, highlighting a notable decline in adult literacy over time.25 Populations disproportionately affected include racial/ethnic minorities and individuals with lower educational attainment.26 Limited health literacy is associated with poorer health outcomes, increased hospitalizations, higher mortality, and reduced use of preventive services.27–29
Inadequate health literacy affects nearly 88% of U.S. adults, limiting their ability to effectively navigate the health system and optimize their health outcomes.30 Health literacy disparities also influence preventive health behaviors and self-rated health status among older adults.26 Addressing health literacy by simplifying communication and tailoring information to the cultural, linguistic, or community context can reduce disparities and improve health outcomes.30,31
Online-Based Health Information/Misinformation
Online-based health information is crucial due to its accessibility, convenience, cost-effectiveness, and empowering potential. In 2022, 58.5% of adults sought health or medical information online.32 Online platforms provide immediate access to diverse formats, including articles, videos, infographics, and interactive tools, catering to various learning styles and preferences. Additionally, online forums and support groups offer emotional support and practical advice for individuals with health conditions. These platforms also facilitate access to the latest research, clinical trials, and medical advancements.
However, the prevalence of online health misinformation poses a significant challenge. Research highlights that such misinformation often includes negative sentiments, anecdotal evidence, and anti-science narratives.33 Social media accelerates the spread of these inaccuracies, potentially harming public health.34 Persuasive strategies in misinformation include fabricating narratives, using personal anecdotes, and distrusting authorities.35 Factors such as health-related anxiety, preexisting misinformation beliefs, and repeated exposure contribute to the acceptance of false information, with demographic variables like gender, age, and socioeconomic status also playing a role.36
Despite the prevalence of misinformation, several sources are generally considered reliable for online health information. These include government agencies, medical institutions, and recognized health organizations, which adhere to rigorous accuracy standards. However, research indicates that government websites are not always immune to inaccuracies or unclear information.37 Government- funded sites, while typically more readable than commercial ones,38 sometimes disseminate unvetted third-party content that may be misleading.39 During public health crises, government agencies and news media are generally more effective at correcting misinformation compared to social peers.40 Thus, while government websites offer certain advantages, they are not exempt from the risk of health-related misinformation.
Readability of Online-Based Health Information
Online health information often exceeds recommended readability levels, potentially compromising public understanding. Studies have found that health-related websites in the United States and Canada have mean readability grades ranging from 10 to 15, which is significantly higher than the recommended 6th-grade level.11,41 This issue persists across various health topics and organizational types.13,42,43 Government-funded websites tend to be slightly more readable than those funded by the private sector, although both still fall short of ideal levels.24,38 This is problematic because high readability levels can contribute to misinformation and adverse health outcomes.
Accessibility of Information Online
Accessibility of online health information is crucial for promoting health equity and improving outcomes, yet significant barriers persist. A study evaluating 139 health-related websites reported that 91% contained accessibility issues, with government websites ranking third in overall error density.17 In a separate review of 157 US children's hospital websites, none were found to be fully compliant with established web accessibility guidelines.44 Similarly, an assessment of 106 leading hospital websites revealed that only 4.9% fully met the Web Content Accessibility Guidelines (WCAG), a set of internationally-recognized standards developed by the World Wide Web Consortium (W3C) to make web content accessible to people with disabilities.18 Additional evaluations of major health information platforms have documented widespread navigation challenges for users with disabilities.45 These findings are especially concerning in light of recent federal guidance. The US Department of Justice's 2022 Americans with Disabilities Act (ADA) Web Accessibility Guidance46 and the US Department of Health and Human Services' Office of Civil Rights Guidance on Nondiscrimination in Telehealth47 both reaffirm that public-facing websites, including those delivering health information, are subject to the ADA and must meet accessibility standards such as WCAG. Together, these studies and policies underscore the urgent need to improve web accessibility, ensuring equitable access to online health information for all users, including individuals with disabilities and older adults.
Quality of Online-Based Health Information
The quality of online health information is crucial, as it can significantly influence users' health decisions and behaviors.48,49 Research evaluating health websites using various criteria has shown mixed results: while some studies report high-quality information,48,50 others indicate that overall quality remains suboptimal and unreliable for laypersons.50 Quality varies by health topic, website affiliation, and medical specialty,48,50 with government and academic sites generally providing higher-quality content.51 The emphasis on user-centered design and socio-technical aspects in quality assessments highlights their growing importance.52 Despite these efforts, online health information often remains inconsistent and can be misleading, making it challenging for consumers to discern its credibility.53
Study Objective
This study aims to systematically assess the readability, accessibility, and quality of online health information concerning OUD, with a specific focus on comparing government-operated websites wit non-governmental websites. Research examining online information on OUD, while very limited, reveals concerns about readability, usability, quality, and misinformation. Several studies have found that OUD-related websites and educational materials often exceed recommended readability levels, with content written at a level above college, making it difficult for many users to understand.54,55 Usability analyses have shown that OUD websites frequently lack user-friendly navigation and accessibility features, posing barriers for people seeking help.15 In addition, studies analyzing video content and social media platforms (eg, YouTube, Reddit) have identified widespread dissemination of low-quality information and persistent myths about OUD and treatment.55–57
However, to date, no research has simultaneously examined three dimensions (readability, accessibility, and quality) in the context of online health information regarding OUD specifically. Furthermore, no study has compared these dimensions between government and non-government websites. This investigation seeks to elucidate the current state of online health information regarding OUD and to identify areas for potential improvement.
METHODS
Search Strategy
In January 2024, we conducted internet searches using keywords related to OUD: “opioid addiction,” “opioid dependence,” and “opioid abuse.” We analyzed the initial 30 English-language websites resulting from each query, mirroring the approach of an average user with limited medical or internet literacy.58 Exclusions comprised sponsored links, news articles, inaccessible sites requiring payment or membership, sites lacking pertinent information on opioid addiction/abuse/dependence, discussion groups or forums, non-website sources like books or videos, and non-English content.
Sample
We assessed ninety websites in total. Significant overlap existed among the websites yielded by each search term, resulting in 63 distinct websites. Subsequent exclusions, totaling 26 websites, were warranted for various reasons: 17 were deemed non-website entities (ie, links to books, videos, news articles, or discussion groups), 1 was inaccessible, 2 were sponsored links, and 6 were found to lack pertinent information. During the various analytical tests for readability, accessibility, and quality, 7 websites resulted in errors and were therefore excluded from the final sample; consequently, our final sample comprised 30 websites. Twenty-one of the websites were government websites (ie, had a suffix of .gov), and 9 were other classifications of websites (ie, “.com,” “.org,” “.int”). Most of the websites resulted from the search term “opioid addiction.” See Table 1 for complete sample characteristics.
Table 1.
Sample Characteristics
| Website Suffix | Percent (n) |
|---|---|
| .ca | 3.33 (1) |
| .com | 3.33 (1) |
| .gov | 70.00 (21) |
| .int | 3.33 (1) |
| .org | 20.00 (6) |
Evaluation of the Websites
Websites were evaluated for their readability, accessibility, and quality. Results were compared between government websites and non-government websites.
Readability
Text readability is “the determination by systematic formulae of the reading comprehension level a person must have to understand written materials.”59 This investigation evaluated readability using Readability Studio Professional Edition, Version 2024 (Oleander Software Ltd; Vandalia, Ohio). Three distinct instruments were employed to assess readability. These comprised two reading grade level tests, (Gunning Fog [FOG] and Simple Measure of Gobbledygook [SMOG]), and one index score test (Flesch Reading Ease Score [FRES]). The FOG60 and SMOG61 tests estimate the years of education needed to comprehend a passage of text based on factors such as the number of characters, syllables, words, or sentences in a text sample and have been widely used to assess the readability of health information.43,62,63 For instance, a text with a FOG/SMOG score of 8 would be understandable to an 8th-grade student. Scores higher than 12 (ie, 12th grade) suggest the text is quite challenging to read and comprehend; therefore, it falls into the “college level” or “beyond college level” categories, requiring a high level of education to achieve a complete understanding. The FRES test computes a text's readability as an index score based on factors such as sentence length and syllable count.64 This score ranges from 0 to 100, with higher values indicating greater ease of comprehension. A score of 90-100 is considered “very easy” or at a 5th grade level, 60-70 is considered “standard” or 8th-9th grade level, 30-50 is considered “difficult” or 10th-12th grade level, and 0-30 is considered “very difficult” or college level. This scale is widely used to evaluate health information.50,65
Accessibility
Web accessibility ensures that all users, including those with disabilities, can perceive, understand, navigate, interact with, and contribute to websites without encountering barriers to accessing content like text, images, audio, video, or multimedia. Accessibility guidelines, such as the Web Content Accessibility Guidelines (WCAG) established by the World Wide Web Consortium (W3C), provide technical requirements for making digital content accessible and usable.66 To assess web accessibility, we employed the WAVE automatic accessibility testing tool.67 WAVE is designed to help developers, content creators, and researchers assess the accessibility of web pages, particularly in alignment with WCAG, by identifying accessibility errors, alerts, and features that may affect how well users, especially those with disabilities, can navigate and understand the page. Its evaluation generates a report outlining errors (eg, missing alternative text, empty buttons or links), alerts (eg, small font sizes, long link texts), features (eg, properly structured headings), contrast issues (eg, contrast ratio standard), structural element problems (eg, semantic structures like headings and lists), and usage of HTML5 and Accessible Rich Internet Applications (ARIA), a set of attributes that improve the accessibility of web content, within a webpage.
Quality
The DISCERN Instrument helps consumers and information providers assess the quality of health information. The DISCERN Handbook ensures all users understand and apply the instrument effectively.68 It consists of 16 questions covering clarity, balance, and content, each representing a separate quality criterion. Questions are rated on a 5-point scale (1 = definite ‘no’; 2-4 = ‘partially meets criteria’; 5 = definite ‘yes’). The first eight questions assess the reliability of publication, while the last seven address details of treatment information. The final question offers an overall quality rating. A website's quality, as assessed by the DISCERN instrument, is classified according to its total score: 63-80 indicates “excellent” quality, 51-62 “good,” 39-50 “fair,” 27-38 “poor,” and 15-26 “very poor.”
Data Analysis
Readability
FOG, SMOG, and FRES scores were calculated for each website, as using multiple tools enhances confidence in evaluations by covering different dimensions and reducing bias. To simplify interpretation, a single reading grade (RG) was derived for each website by averaging the FOG and SMOG scores (similar to a previous study43). T-tests were used to determine significant differences in RG between government and non-government websites. Statistical analysis was performed using the Stata software (v.17).69
Accessibility
The WAVE tool evaluates web content for conformance with WCAG 2.1 Levels A and AA, which represent the most widely adopted accessibility standard and are often required by law under statutes such as the Americans with Disabilities Act (ADA) and Section 508 of the Rehabilitation Act. Univariate analyses (ie, measures of central tendency) were conducted on the data using Stata Software (v.17).69
Quality
Final DISCERN scores were calculated by summing the ratings across all 16 items, with higher scores indicating greater quality. Two researchers independently assessed each website, and the average of their total scores was used for analysis to ensure consistency and reduce bias. Wilcoxon rank sum tests were conducted to analyze the differences in quality scores between government and nongovernment websites using Stata software (v.17).69
RESULTS
Readability
A single reading grade (RG) was created for each website by averaging the FOG and SMOG scores. To justify this approach, correlations among the readability measures were examined. FOG and SMOG were strongly correlated (r = 0.8437, p < 0.0001). The RG also showed strong correlations with both FOG (r = 0.9627, p < 0.0001) and SMOG (r = 0.9575, p < 0.0001), and a strong negative correlation with FRES (r = −0.6904, p < 0.0001). The analysis of 30 websites yielded an average RG of 14.63, indicating that the content was written above the college level. The average FRES was 31.63. The FRES range from 1 to 100, with higher scores indicating greater readability. We found that government websites had an average RG of 15.00 and a FRES of 30.38, while non-government websites showed an average RG of 13.74 and a FRES of 34.56. These findings suggest that most websites assessed contain content that is likely too complex for the average reader to comprehend. There was no significant effect on RG by website type (t[28] =−1.77, p = 0.087), despite government websites (M = 15.0, SD=1.71) attaining higher reading grade levels than non-government websites (M=13.74, SD=1.98). Table 2 shows complete readability results.
Table 2.
Average Reading Grade and Reading Ease
| Overall Sample | ||
|---|---|---|
| Mean | SD | |
| RG* | 14.63 | 1.85 |
| FOG | 14.27 | 1.99 |
| SMOG | 14.98 | 1.87 |
| FRES | 31.63 | 11.97 |
| By Website Type | ||
|---|---|---|
|
Government
Mean (SD) |
Non-Government
Mean (SD) |
|
| RG* | 15.00 (1.71) | 13.74 (1.98) |
| FRES | 30.38 (9.07) | 34.56 (17.31) |
Note: *Reading grade is the average of the FOG and SMOG scores.
FOG, Gunning Fog Index; FRES, Flesch Reading Ease Score; SMOG, Simple Measure of Gobbledygook; RG, Reading Grade.
Accessibility
The WAVE tool evaluates website accessibility across six categories: (1) Errors, (2) Alerts, (3) Structural elements, (4) Contrast, (5) Features, and (6) ARIA. Among the 30 websites analyzed, 12 (40%) passed without any errors, all of which were government websites. Across all websites, 149 errors were detected, with an average of 4.967 errors per site and a maximum of 63 errors. Ten websites (33.3%) exceeded the average of 4 errors. The most common issues were related to structural elements (26%) and ARIA compliance (54%). Non-government websites exhibited a higher mean number of total errors (M = 308.5, SD = 218.7) compared to government websites (M = 203, SD = 230.7). Table 3 shows complete accessibility results.
Table 3.
WAVE tool Accessibility Results
| Government Websites (n-21) | Non-Government Websites (n=9) | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Error | Alerts | Structural | Contrast | Features | ARIA | Total | Error | Alerts | Structural | Contrast | Features | ARIA | Total | |
| 1. | 0 | 21 | 17 | 30 | 8 | 57 | 133 | 5 | 8 | 61 | 0 | 18 | 152 | 244 |
| 2. | 0 | 5 | 48 | 2 | 4 | 68 | 127 | 3 | 7 | 75 | 0 | 23 | 279 | 387 |
| 3. | 5 | 66 | 45 | 0 | 5 | 317 | 438 | 1 | 25 | 138 | 0 | 15 | 442 | 621 |
| 4. | 14 | 7 | 116 | 0 | 9 | 33 | 179 | 1 | 13 | 45 | 4 | 11 | 13 | 87 |
| 5. | 0 | 33 | 47 | 7 | 28 | 46 | 161 | 14 | 81 | 70 | 4 | 13 | 13 | 195 |
| 6. | 0 | 6 | 22 | 0 | 26 | 14 | 68 | 63 | 50 | 99 | 0 | 16 | 291 | 519 |
| 7. | 0 | 15 | 39 | 2 | 24 | 40 | 120 | 1 | 8 | 60 | 2 | 51 | 49 | 171 |
| 8. | 0 | 8 | 124 | 6 | 13 | 101 | 252 | 1 | 2 | 1 | 0 | 1 | 0 | 5 |
| 9. | 0 | 6 | 37 | 0 | 11 | 69 | 123 | 9 | 66 | 99 | 19 | 32 | 323 | 548 |
| 10. | 5 | 18 | 38 | 2 | 23 | 43 | 129 | |||||||
| 11. | 0 | 10 | 48 | 1 | 14 | 27 | 100 | |||||||
| 12. | 2 | 17 | 55 | 3 | 34 | 58 | 169 | |||||||
| 13. | 1 | 38 | 156 | 0 | 9 | 944 | 1148 | |||||||
| 14. | 5 | 3 | 34 | 0 | 7 | 18 | 67 | |||||||
| 15. | 7 | 13 | 47 | 16 | 15 | 26 | 124 | |||||||
| 16. | 0 | 6 | 32 | 1 | 11 | 69 | 119 | |||||||
| 17. | 4 | 17 | 50 | 0 | 10 | 71 | 152 | |||||||
| 18. | 0 | 6 | 35 | 1 | 10 | 36 | 88 | |||||||
| 19. | 8 | 31 | 28 | 5 | 29 | 48 | 149 | |||||||
| 20. | 0 | 37 | 77 | 0 | 47 | 75 | 236 | |||||||
| 21. | 0 | 26 | 66 | 0 | 35 | 54 | 181 | |||||||
| Mean | 2.429 | 18.524 | 55.286 | 3.619 | 17.714 | 105.429 | 203 | 10.889 | 28.889 | 72 | 3.222 | 20 | 173.556 | 308.556 |
| SD | 3.749 | 15.52 | 35.453 | 7.124 | 11.735 | 201.857 | 230.709 | 20.053 | 29.328 | 38.506 | 6.16 | 14.361 | 164.683 | 218.693 |
| Overall Sample (n=30) | |||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Error | Alerts | Structural | Contrast | Features | ARIA | Total | |||||||
| Total | 149 | 649 | 1809 | 105 | 552 | 3776 | 7040 | ||||||
| Mean | 4.967 | 21.633 | 60.3 | 3.5 | 18.4 | 125.867 | 234.667 | ||||||
| SD | 11.669 | 20.657 | 36.559 | 6.745 | 12.37 | 191.287 | 228.74 | ||||||
Quality
The two researchers' total scores were averaged to enhance consistency and reduce individual scoring bias. Their scores demonstrated a strong correlation (r = 0.723, p < 0.0001), supporting the decision to use the averaged value in analyses. Out of the thirty websites evaluated, 11 (36.67%) achieved a total DISCERN score of 39 or higher, classifying them as “fair” or above. The mean DISCERN score was 39.52 out of 80, which corresponds to a “fair” ranking. However, the majority of websites (56.67%) were rated as “poor.” Specifically, 80.95% of government websites were ranked as “poor” or “very poor,” compared to 22.22% of non-government websites. A Wilcoxon rank sum test revealed that the median quality scores were statistically significantly lower for government websites than for non-government websites (Z = 2.67, p < .01). Table 4 shows complete quality results.
Table 4.
Quality Rankings
| Overall Sample (n=30) | Non-Government Websites (n=9) | Government Websites (n=21) | |
|---|---|---|---|
| Quality Ranking | Percent (n) | Percent (n) | Percent (n) |
| Excellent | 3.33 (1) | 11.11 (1) | 0 (0) |
| Good | 13.33 (4) | 33.33 (3) | 4.76 (1) |
| Fair | 20.00 (6) | 33.33 (3) | 14.29 (3) |
| Poor | 56.67 (17) | 22.22 (2) | 71.43 (15) |
| Very poor | 6.67 (2) | 0 (0) | 9.52 (2) |
Note: Websites were classified based on their total scores as ‘excellent' (63–80), ‘good' (51–62), ‘fair' (39-50), ‘poor' (27–38), or ‘very poor' (15–26).
DISCUSSION
Readability, accessibility, and quality of online health information are crucial for informed decision-making, equitable access, and improved health outcomes. Studies have consistently found that online health information is written at a level too complex for the general public, requiring high school or higher reading ability.11,70 This poor readability can lead to misinformation and potentially harm patients' health.11 Accessibility issues also exist, with search engines often providing inefficient results and many websites lacking comprehensive coverage of key clinical information.70 Factors influencing readability include the health condition, website domain, and paragraph position within texts.43 Improving the readability and accessibility of online health information is essential to enhance health literacy and ensure equitable access to healthcare services.
Our findings indicate that the majority of websites analyzed in this study had a reading grade level exceeding that of a college education, reflecting a high degree of complexity in the website's content. This observation is consistent with previous research, which has similarly identified that the readability of health-related websites often far surpasses the recommended 6th-grade level.11,41 While prior studies have suggested that government websites tend to be marginally more readable than their non-government counterparts,24,38 our analysis revealed that government websites were actually less readable, though the difference was not statistically significant. These results suggest that many websites are written at a level higher than the average American reading proficiency. This can adversely affect users' understanding of the information and, in turn, impact their decision-making and expectations. Moreover, research shows that individuals with OUD have lower levels of education than the general population.71 Therefore, these results are even more detrimental to the population that is most likely to search for OUD-related information online.
Research has consistently highlighted readability issues in online health information.11,12,14,72,73 The ongoing prevalence of these readability problems is a matter of significant concern. It is particularly alarming that government websites—designed to be accessible to the public—continue to present information in a manner that may obstruct understanding, especially regarding critical topics such as opioid use disorder. This ongoing issue highlights a significant barrier to effective communication. It underscores the need for improvement in the readability and accessibility of online health information to ensure that it meets the needs of the entire population.
Our analysis revealed an average of 4.967 accessibility errors per website, with non-government websites exhibiting a higher error rate than government sites. While our findings align with existing literature,17,74–76 which suggests that government websites are generally more accessible, it is noteworthy that many errors on these sites were related to ARIA compliance issues. ARIA attributes, defined by the W3C, are crucial for enhancing web content accessibility, particularly for dynamic elements and advanced user interface controls. Significant ARIA errors indicate impaired accessibility and unequal information access. This is particularly significant considering the 2022 US DOJ and DHHS web accessibility guidelines, which reaffirmed that public-facing websites, including those operated by government agencies, must comply with the ADA and meet recognized accessibility standards such as the WCAG, which include proper ARIA implementation.46,47 The persistence of ARIA-related errors, even on government websites, suggests gaps in full compliance and highlights the need for ongoing monitoring and remediation to uphold legal and ethical standards for digital accessibility. Persistent accessibility issues may damage the reputation of government agencies, eroding public trust in their commitment to inclusivity.
Our analysis revealed that 56.67% of websites were rated as “poor” quality, with a notable 80.95% of government websites falling into the “poor” or “very poor” categories, substantially higher than the 22.22% of non-government websites rated similarly. Low-quality online health information poses significant risks, including the potential for users to make incorrect health decisions, which may result in harmful outcomes or ineffective treatments. Such information can promote unsafe practices or unproven remedies, increasing the risk of adverse health effects. Persistent exposure to misleading content can erode trust in online health resources and healthcare professionals, contributing to the spread of misinformation, particularly on social media. This can impair users' health literacy and lead to disparities in care for those who rely on online information without proper professional guidance. Ensuring that online health information is accurate, evidence-based, and clearly presented is crucial for informed decision-making, effective self-care, and maintaining public trust in health resources.
It is crucial to recognize that not all websites are designed for a general audience. For instance, academic texts cater to a different readership than government websites or charities that aim to disseminate health information. The diversity of website types appearing on the first page of search results is expected, as various entities compete to promote their content. Given that online information increasingly serves as the primary source for many individuals, it is essential that the information featured prominently in search results is both accessible and accurate, even though achieving such accessibility and accuracy is challenging due to the internet's rapidly evolving nature.
Limitations and Future Research
Our study focused on analyzing the first 30 search results on Google for three specific search terms. Future research should consider larger sample sizes and include other popular search engines to enhance the robustness of the findings. Additionally, the results reflect the content available at the time of data collection, and given the dynamic nature of the internet, these findings may not be applicable at other times.
The DISCERN quality assessment tool, while useful for evaluating the quality of online health information, may be less effective for assessing other types of website content. For instance, many websites in our sample did not emphasize treatment options for OUD, though the DISCERN tool includes several questions on treatment, potentially skewing the overall quality scores. Therefore, evaluating the accuracy of online health information content is also recommended.
Our study did not examine user-generated content or social media platforms, which are increasingly significant sources of health information. Future research should address these sources to provide a more comprehensive view. Lastly, our analysis was limited to English-language websites, yet the US population is diverse and includes many non-English speakers. Exploring non-English websites could reveal similar issues in other languages.
CONCLUSIONS
Our study reveals that websites on OUD are generally difficult to read, access, and of low quality, with government websites performing poorer than non-government sites in these areas. Given the pivotal role of online information in public health crises, there is an urgent need to improve and update websites addressing opioid use disorder. Online platforms are crucial for disseminating information on the risks of opioid misuse, signs of addiction, treatment options, and contact details for support services. They also facilitate emotional support and connection through online communities and forums. It is especially important for government websites to meet high standards of readability, accessibility, and quality, given their perceived trustworthiness due to regulatory oversight, expert input, and public accountability.
DISCLOSURES
The authors have nothing to disclose.
FUNDING SOURCES
The authors received no funding for this research.
Funding Statement
The authors received no funding for this research.
Footnotes
REFERENCES
- 1.U.S. Department of Health and Human Services. Secretary Kennedy Renews Public Health Emergency Declaration to Address National Opioid Crisis. HHS Press Office. March 18, 2025. Accessed November 8, 2025. https://www.hhs.gov/press-room/secretary-kennedy-opiod-crisis-emergency-declaration.html. [Google Scholar]
- 2.Centers for Disease Control and Prevention, National Center for Health Statistics. Multiple causes of death 19992023 on CDC WONDER online database. January 2025. https://nida.nih.gov/research-topics/trends-statistics/overdose-death-rates#Fig3.
- 3.Fleischauer AT, Ruhl L, Rhea S, Barnes E.. Hospitalizations for endocarditis and associated health care costs among persons with diagnosed drug dependence—North Carolina 20102015. MMWR Morb Mortal Wkly Rep. 2017;66(22):569-573. doi: 10.15585/mmwr.mm6622a1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Santo T Jr, Campbell G, Gisev Net al. Prevalence of mental disorders among people with opioid use disorder a systematic review and metaanalysis. Drug Alcohol Depend. 2022;238:109551. doi: 10.1016/j.drugalcdep.2022.109551. [DOI] [PubMed] [Google Scholar]
- 5.Moreland A, Newman C, Crum K, Are F.. Types of child maltreatment and child welfare involvement among opioidusing mothers involved in substance use treatment. Child Youth Serv Rev. 2021;126:106021. doi: 10.1016/j.childyouth.2021.106021. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Winkelman TN, Chang VW, Binswanger IA.. Health polysubstance use and criminal justice involvement among adults with varying levels of opioid use. JAMA NetwOpen. 2018;1(3):e180558. doi: 10.1001/jamanetworkopen.2018.0558. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Jones CM, Han B, Baldwin GT, Einstein EB, Compton WM.. Use of medication for opioid use disorder among adults with pastyear opioid use disorder in the US 2021. JAMA Network Open. 2023;6(8). doi: 10.1001/jamanetworkopen.2023.27488. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Kennedy-Hendricks A, Barry CL, Gollust SE.. Enrolling in opioid agonist treatment the role of stigma and insurance. Health Aff Millwood. 2017;36(6):972-979. doi: 10.1377/hlthaff.2016.1358. [DOI] [Google Scholar]
- 9.McGinty EE, Kennedy-Hendricks A, Baller J, Niederdeppe J, Gollust S, Barry CL.. Public support for safe consumption sites and syringe services programs to combat the opioid epidemic. Prev Med. 2016;92:16-22. doi: 10.1016/j.ypmed.2016.08.027. [DOI] [PubMed] [Google Scholar]
- 10.Yang LH, Wong LY, Grivel MM, Hasin DS.. Stigma and substance use disorders an international phenomenon. Curr Opin Psychiatry. 2017;30(5):378-388. doi: 10.1097/YC0.0000000000000351. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Daraz L, Morrow AS, Ponce OJet al. Readability of online health information a metanarrative systematic review. American Journal of Medical Quality. 2018;33(5):487-492. doi: 10.1177/1062860617751639. [DOI] [PubMed] [Google Scholar]
- 12.Rooney MK, Santiago G, Perni Set al. Readability of patient education materials from highimpact medical journals a 20-year analysis. J Patient Exp. 2021;8:2374373521998847. doi: 10.1177/2374373521998847. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Okuhara T, Furukawa E, Okada H, Yokota R, Kiuchi T.. Readability of written information for patients across 30 years a systematic review of systematic reviews. Patient Educ Couns. 2025;108:108656. doi: 10.1016/j.pec.2025.108656. [DOI] [PubMed] [Google Scholar]
- 14.Dang N, Khunte M, Zhong A, Chatterjee A.. Naloxone online information exceeds the recommended reading level for patient education materials. J Stud Alcohol Drugs. 2023;84(5):680-683. doi: 10.15288/jsad.23-00108. [DOI] [PubMed] [Google Scholar]
- 15.He S, Shyamsundar S, Chong Pet al. Analyzing opioiduse disorder websites in the United States An optimized website usability study. Digital Health. 2022;8. doi: 10.1177/20552076221121529. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.ElSherief M, Sumner SA, Jones CMet al. Characterizing and identifying the prevalence of webbased misinformation relating to medication for opioid use disorder machine learning approach. J Med Internet Res. 2021;23(12):e30753. doi: 10.2196/30753. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Mason AM, Compton J, Bhati S.. Disabilities and the digital divide assessing web accessibility readability and mobility of popular health websites. J Health Commun. 2021;26(10):667-674. doi: 10.1080/10810730.2021.1987591. [DOI] [PubMed] [Google Scholar]
- 18.Krupa A, Roark JB, Barrett KB.. The Critical Role of Web Accessibility in Health Information Access Understanding and Use. AHIMA Foundation; 2022. https://ahimafoundation.ahima.org/media/wplbdhso/the-critical-role-of-web-accessibility-in-health-information-access-understanding-and-use.pdf. [Google Scholar]
- 19.Zeng X, Parmanto B.. Web accessibility of consumer health information web sites for people with disabilities a cross sectional evaluation. J Med Internet Res. 2004;6(2):e19. doi: 10.2196/jmir.6.2.e19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.West DM, Miller EA.. The digital divide in public ehealth barriers to accessibility and privacy in state health department websites. J Health Care Poor Underserved. 2006;17(3):652-667. doi: 10.1353/hpu.2006.0105. [DOI] [PubMed] [Google Scholar]
- 21.Eckert C, Price-Haywood EG, Yan F, Krousel Wood M.. Accessibility of state and territory public health websites. JAMA Netw Open. 2023;6(2):e2255727. doi: 10.1001/jamanetworkopen.2022.55727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Sharma S, Patel A, Singh Ret al. Readability and accessibility of patient education materials a comparative evaluation of government public and private online resources. Patient Educ Couns. 2025;108:106961. doi: 10.1016/j.pec.2024.106961. [DOI] [Google Scholar]
- 23.Kelly M, LeBlanc B, Smith Aet al. Evaluation of the readability understandability and actionability of COVID19 public health messaging in Atlantic Canada. Front Commun. 2023;8:1006784. doi: 10.3389/fcomm.2023.1006784. [DOI] [Google Scholar]
- 24.Mishra V, Dexter JP.. Comparison of readability of official public health information about COVID19 on websites of international agencies and governments. JAMA Netw Open. 2020;3(8):e2018033. doi: 10.1001/jamanetworkopen.2020.18033. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.U.S. Department of Education, National Center for Education Statistics. Highlights of the 2023 US PIAAC Results Web Report ; 2024. https://nces.ed.gov/surveys/piaac/2023/national_results.asp.
- 26.Bennett IM, Chen J, Soroui JS, White S.. The contribution of health literacy to disparities in selfrated health status and preventive health behaviors in older adults. The Annals of Family Medicine. 2009;7(3):204-211. doi: 10.1370/afm.940. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Berkman ND, Sheridan SL, Donahue KE, Halpern DJ, Crotty K.. Low health literacy and health outcomes an updated systematic review. Annals of Internal Medicine. 2011;155(2):97-107. doi: 10.7326/0003-4819-155-2-201107190-000. [DOI] [PubMed] [Google Scholar]
- 28.Rasu RS, Bawa WA, Suminski R, Snella K, Warady B.. Health literacy impact on national healthcare utilization and expenditure. International Journal of Health Policy and Management. 2015;4(11):747. doi: 10.15171/ijhpm.2015.151. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Moser DK, Robinson S, Biddle MJ, Pelter MM, Nesbitt TSet al. Health literacy predicts morbidity and mortality in rural patients with heart failure. Journal of Cardiac Failure. 2015;21(8):612-618. doi: 10.1016/j.cardfail.2015.04.004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.Lopez C, Kim B, Sacks K.. Health literacy in the United States enhancing assessments and reducing disparities. Milken Institute. Published online May 20, 2022. doi: 10.2139/ssrn.4182046. [DOI] [Google Scholar]
- 31.Stormacq C, Wosinski J, Boillat E, Van den Broucke S.. Effects of health literacy interventions on healthrelated outcomes in socioeconomically disadvantaged adults living in the community a systematic review. JBI Evid Synth. 2020;18(7):1389-1469. doi: 10.11124/JBISRIR-D-19-00340. [DOI] [PubMed] [Google Scholar]
- 32.Wang X, Cohen RA.. Health Information Technology Use Among Adults United States, July-December 2022. US Department of Health and Human Services, Centers for Disease Control and Prevention, National Center for Health Statistics; 2023. https://www.cdc.gov/nchs/data/databriefs/db482.pdf. [Google Scholar]
- 33.Nan X, Wang Y, Thier K.. Health misinformation. In: Thompson TL, Harrington NG,eds. The Routledge Handbook of Health Communication. Routledge; 2021:318-332. doi: 10.4324/9781003043379-27. [DOI] [Google Scholar]
- 34.Chen C, Wang H, Shapiro M, Xiao Y, Wang F, Shu K.. Combating health misinformation in social media characterization detection intervention and open issues. arXiv. Published online November 10, 2022. doi: 10.48550/arXiv.2211.05289. [DOI] [Google Scholar]
- 35.Peng W, Lim S, Meng J.. Persuasive strategies in online health misinformation a systematic review. Information Communication & Society. 2023;26(11):2131-2148. doi: 10.1080/1369118X.2022.2085615. [DOI] [Google Scholar]
- 36.Pan W, Liu D, Fang J.. An examination of factors contributing to the acceptance of online health misinformation. Frontiers in Psychology. 2021;12. doi: 10.3389/fpsyg.2021.630268. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Alajarmeh N. Evaluating the accessibility of public health websites an exploratory crosscountry study. Universal Access in the Information Society. 2022;21(3):771-789. doi: 10.1007/s10209-020-00788-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.Cochrane ZR, Gregory P, Wilson A.. Readability of consumer health information on the internet a comparison of US governmentfunded and commercially funded websites. Journal of Health Communication. 2012;17(9):1003-1010. doi: 10.1080/10810730.2011.650823. [DOI] [PubMed] [Google Scholar]
- 39.Freilich J. Government Misinformation Platforms. University of Pennsylvania Law Review. 2024;172(6):1537. https://scholarship.law.upenn.edu/cgi/viewcontent.cgi?article=9857&context=penn_law_review. [Google Scholar]
- 40.Van der Meer TG, Jin Y.. Seeking formula for misinformation treatment in public health crises The effects of corrective information type and source. Health Communication. 2020;35(5):560-575. doi: 10.1080/10410236.2019.1573295. [DOI] [PubMed] [Google Scholar]
- 41.Walsh TM, Volsko TA.. Readability assessment of internetbased consumer health information Respiratory Care. 2008;53(10):1310-1315. doi: 10.4187/respcare.08531310. [DOI] [PubMed] [Google Scholar]
- 42.Wasir AS, Volgman AS, Jolly M.. Assessing readability and comprehension of webbased patient education materials by American Heart Association AHA and CardioSmart online platform by American College of Cardiology ACC How useful are these websites for patient understanding? American Heart Journal Plus Cardiology Research and Practice. 2023;32. doi: 10.1016/j.ahjo.2023.100308. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Mcinnes N, Haglund BJ.. Readability of online health information implications for health literacy. Informatics for Health and Social Care. 2011;36(4):173-189. doi: 10.3109/17538157.2010.542529. [DOI] [PubMed] [Google Scholar]
- 44.Huerta TR, Walker DM, Ford EW.. An evaluation and ranking of children's hospital websites in the United States. J Med Internet Res. 2016;18(8):e5799. doi: 10.2196/jmir.5799. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.French-Lawyer J, Siano S, Ioerger M, Young V, Turk MA.. Health information seeking and people with disability a systematic search and scoping review. Disabil Health J. 2021;14(1):100983. doi: 10.1016/j.dhjo.2020.100983. [DOI] [PubMed] [Google Scholar]
- 46.U.S. Department of Justice Civil Rights Division Guidance on Web Accessibility and the ADA. 2022. https://www.ada.gov/resources/web-guidance/.
- 47.U.S. Department of Health and Human Services. Guidance on Nondiscrimination in Telehealth Federal Protections to Ensure Accessibility to People with Disabilities and Limited English Proficient Persons; 2022. https://www.hhs.gov/sites/default/files/guidance-on-nondiscrimination-in-telehealth.pdf. [Google Scholar]
- 48.Kitchens B, Harle CA, Li S.. Quality of health related online search results. Decision Support Systems. 2014;57:454-462. doi: 10.1016/j.dss.2012.10.050. [DOI] [Google Scholar]
- 49.Nădăşan V. The quality of online healthrelated informationan emergent consumer health issue. Acta Marisiensis-Seria Medica. 2016;62(4):408-421. doi: 10.1515/amma-2016-0048. [DOI] [Google Scholar]
- 50.Wrigley Kelly NE, Murray KE, McCarthy C, O'shea DB.. An objective analysis of quality and readability of online information on COVID19. Health and Technology. 2021;11(5):1093-1099. doi: 10.1007/s12553-021-00574-2. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51.Daraz L, Morrow AS, Ponce OJet al. Can patients trust online health information? A metanarrative systematic review addressing the quality of health information on the internet. Journal of General Internal Medicine. 2019;34:1884-1891. doi: 10.1007/s11606-019-05109-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52.Zhang Y, Sun Y, Xie B.. Quality of health information for consumers on the web a systematic review of indicators criteria tools and evaluation results. Journal of the Association for Information Science and Technology. 2015;66(10):2071-2084. doi: 10.1002/asi.23311. [DOI] [Google Scholar]
- 53.Sbaffi L, Rowley J.. Trust and credibility in web based health information a review and agenda for future research. J Med Internet Res. 2017;19(6):e218. doi: 10.2196/jmir.7579. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Heringer D, Campos VM, Costa GPA, Anand A.. Assessing Readability and Stigma of ChatGPT's Opioid Use Disorder FAQs. Poster presented at ASAM Annual Conference; April 24-27, 2025. https://annualconference.asam.org/fsPopup.asp?PosterID=722118. [Google Scholar]
- 55.O’Kelly B, Holmes P, Cheng A, Lee JD, Tofighi B.. Dissemination of health content through social networks YouTube and opioid use disorders. Journal of Substance Use and Addiction Treatment. Published online October 1, 2024:165. doi: 10.1016/j.josat.2024.209475. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Laud T, Kacha-Ochana A, Sumner SAet al. Largescale analysis of online questions related to opioid use disorder on Reddit. Proceedings of the International AAAI Conference on Web and Social Media. 2025;19:1068-1084. doi: 10.1609/icwsm.v19i1.35861. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 57.Jung H, Mittal S, Aatreya A, Kaur N, De Choudhury M, Mitra T.. MythTriage Scalable Detection of Opioid Use Disorder Myths on a VideoSharing Platform. arXiv. Published online May 30, 2025. doi: 10.48550/arXiv.2506.00308. [DOI] [Google Scholar]
- 58.Szmuda T, Ozdemir C, Ali S, Singh A, Syed MT, Sloniewski P.. Readability of online patient education material for the novel coronavirus disease COVID19 a crosssectional health literacy study. Public Health. 2020;185:21-25. doi: 10.1016/i.puhe.2020.05.041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 59.Albright J, de Guzman C, Acebo P, Paiva D, Faulkner M, Swanson J.. Readability of patient education materials implications for clinical practice. Applied Nursing Research. 1996;9(3):139-143. https://d1wqtxts1xzle7.cloudfront.net/101268470/s0897-189728962980254-020230419-1-op7nsg-libre.pdf?1681923163=&response-content-disposition=inline%3B±filename%3DReadability_of_patient_education_materia.pdf&Expires=1750958625&Signature=ctCB2cIqvX18wRrT-vB72RaaGoLki∼k3wVbtQ2PkupudfF6lMG84LVW0gI6ifCK2wZl5pa8dWVCZSFbkNVi0XbSRkvHgRn8PurTIdy0WRo4yVni2rRKaQ∼HBWlizQZ2Y8eH5oGlWHpd∼AIporZOvDFc3XM9m0gu∼kQ5LeqEbHix9-6iQzb3QmR5KBto8etZVauXwAyWbRk7-zPClM0E93F2FZxeHaUX8PWeaB3OhJyE-s1g1qKI6vgSKdhMYF6l21X6yCf7PLQ9rZyT2P4r2LYmPRwzSk0fV3PEtGiCIDiULJMVuMyATd2V64g-Sc-B1rpruWZPvFXHc∼sDm2RQEQg&Key-Pair-Id=APKAJLOHF5GGSLRBV4ZA. [DOI] [PubMed] [Google Scholar]
- 60.McLaughlin GH. SMOG grading—a new readability formula. Journal of Reading. 1969;12(8):639-646. https://ogg.osu.edu/media/documents/health_lit/WRRSMOG_Readability_Formula_G._Harry_McLaughlin_1969.pdf. [Google Scholar]
- 61.Gunning R. The Technique of Clear Writing. McGraw-Hill; 1952. [Google Scholar]
- 62.Worrall AP, Connolly MJ, O’Neill Aet al. Readability of online COVID19 health information a comparison between four English speaking countries. BMC Public Health. 2020;20:1-2. doi: 10.1186/s12889-020-09710-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Raia H, Lodhi S.. Assessing the readability and quality of online information on anosmia. The Annals of The Royal College of Surgeons of England. 2024;106(2):178-184. doi: 10.1308/rcsann.2022.0147. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64.Kincaid JPF, Robert RP Jr, Rogers RL, Chissom BS.. Derivation Of New Readability Formulas Automated Readability Index Fog Count And Flesch Reading Ease Formula For Navy Enlisted Personnel. Published online 1975. doi: 10.21236/ADA006655. [DOI] [Google Scholar]
- 65.Murphy B, Irwin S, Condon F, Kennedy C.. Readability and quality of online information for patients pertaining to revision knee arthroplasty an obiective analysis. The Surgeon. 2022;20(6). doi: 10.1016/i.surge.2021.12.009. [DOI] [PubMed] [Google Scholar]
- 66.World Wide Web Consortium (W3C). Web Content Accessibility Guidelines WCAG 21. W3C. 2018. Accessed June 24, 2024. https://www.w3.org/TR/WCAG21/. [Google Scholar]
- 67.WebAIM. WAVE Web Accessibility Evaluation Tool. Utah State University. 2024. Accessed June 24, 2025. https://wave.webaim.org. [Google Scholar]
- 68.Charnock D, Shepperd S, Needham G, Gann R.. DISCERN an instrument for iudging the quality of written consumer health information on treatment choices. Journal of Epidemiology & Community Health. 1999;53(2):105-111. doi: 10.1136/iech.53.2.105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69.StataCorp. Stata Statistical Software Release 17. StataCorp LLC; 2021. [Google Scholar]
- 70.Berland GK, Elliott MN, Morales LSet al. Health information on the Internet accessibility quality and readability in English and Spanish. JAMA. 2001;285(20):2612-2621. doi: 10.1001/iama.285.20.2612. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71.Ellis MS, Kasper ZA, Cicero TJ.. The impact of opioid use disorder on levels of educational attainment Perceived benefits and consequences. Drug and Alcohol Dependence. 2020;206. doi: 10.1016/i.drugalcdep.2019.107618. [DOI] [PubMed] [Google Scholar]
- 72.Gu JZ, Baird GL, Guevara AEet al. A systematic review and metaanalysis of English language online patient education materials in breast cancer is readability the only story? Breast. 2024;75:103722. doi: 10.1016/i.breast.2024.103722. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73.Karimi AH, Shah AK, Hecht CJ II, Burkhart RJ, Acuna AJ, Kamath AF.. Readability of online patient education materials for total ioint arthroplasty a systematic review. J Arthroplasty. 2023;38(7):1392-1399. doi: 10.1016/i.arth.2023.02.078. [DOI] [PubMed] [Google Scholar]
- 74.Giummarra MJ, Brown E, Rose TAet al. How accessible are the websites of health services for people who have had a stroke? Int J Equity Health. 2025;24(1):112. doi: 10.1186/s12939-025-02459-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75.Yu DX, Parmanto B.. US state government websites demonstrate better in terms of accessibility compared to federal government and commercial websites. Government Information Quarterly. 2011;28(4):484-490. doi: 10.1016/i.giq.2011.05.003. [DOI] [Google Scholar]
- 76.Polireddi NS, Chaitanya K.. Web accessibility evaluation of private and government websites for people with disabilities through fuzzy classifier in the USA. Soft Computing. Published online 2023:1-9. doi: 10.1007/s00500-023-08740-6. [DOI] [Google Scholar]
