Abstract
Objectives
Digital health equity, the opportunity for all to engage with digital health tools to support good health outcomes, is an emerging priority across the world. The field of digital health equity would benefit from a comprehensive and systematic understanding of digital health, digital equity, and health equity, with a focus on real-world applications. We conducted a scoping review to identify and describe published frameworks and concepts relevant to digital health equity interventions.
Materials and Methods
We conducted a scoping review of published peer-reviewed literature guided by the PRISMA Extension for Scoping Reviews. We searched 5 databases for frameworks related to or applied to digital health or equity interventions. Using deductive and inductive approaches, we analyzed frameworks and concepts based on the socio-ecological model.
Results
Of the 910 publications initially identified, we included 44 (4.8%) publications in our review that described 42 frameworks that sought to explain the ecosystem of digital and/or health equity, but none were comprehensive. From the frameworks we identified 243 concepts grouped into 43 categories including characteristics of individuals, communities, and organizations; societal context; perceived value of the intervention by and impacts on individuals, community members, and the organization; partnerships; and access to digital health services, in-person services, digital services, and data and information, among others.
Discussion
We suggest a consolidated definition of digital health equity, highlight illustrative frameworks, and suggest concepts that may be needed to enhance digital health equity intervention development and evaluation.
Conclusion
The expanded understanding of frameworks and relevant concepts resulting from this study may inform communities and stakeholders who seek to achieve digital inclusion and digital health equity.
Keywords: digital equity, health equity, consumer health informatics, community engagement, socioecological model
Background
Digital health equity, the opportunity for all to engage with digital health tools to support good health outcomes,1 is an emerging global priority.2–4 Those working to develop, deploy, and attain adoption of real-world digital health equity interventions would benefit from a comprehensive and systematic understanding of digital health equity. Digital health equity exists within a complex socio-ecological system in which individuals are nested within interpersonal relationships, the community, and society—therefore, their engagement with digital solutions can be impacted by biases, whether explicit, implicit, or structural, integrated into policies, healthcare practices, and socio-cultural norms,5–12 and impact an individual intersectionally.13,14 However, consensus on its definition is currently lacking and digital health equity research is often critiqued for simplistic conceptualization of patient technology engagement.13,14 This signals a need to develop unified conceptualizations of digital health equity that capture its complexity, given healthcare is increasingly reliant on digital solutions such as telehealth, remote patient monitoring, patient portals, virtual health education, and care coordination.6
Definitions
While there is no widely accepted definition of digital health equity, there are related terms that may provide a foundation for such a definition. First, digital health, defined by the World Health Organization (WHO) as “the field of knowledge and practice associated with the development and use of digital technologies to improve health” (p. 11).15 The United States (U.S.) Food and Drug Administration’s definition of digital health technologies encompasses “mobile health (mHealth), health information technology (IT), wearable devices, telehealth and telemedicine, and personalized medicine.”11
Second, digital equity is “the condition in which individuals and communities have the information technology capacity that is needed for full participation in the society and economy.”16 Digital equity impacts lives broadly, in ways that include supporting education and employment. Gaps in digital equity may arise from discrimination embedded in: (1) social norms (eg, racism, ablism) that can impact design of technologies and opportunities to learn about or engage with technology;17–20 and (2) historic and contemporary policies (eg, Civil Rights Act of 1964) that can impact access to resources and opportunities among marginalized populations.21–23 An example of how discrimination can impact digital equity is via digital gatekeepers such as internet companies engage in digital redlining within neighborhoods with residents who were from Black and other communities of color; many of these Black neighborhoods had formed due to past policies allowing racial segregation in housing among Black community members (redlining) that was made illegal in 1968 yet persists today.24,25
Third, health equity is “the attainment of the highest level of health for all people” that “requires valuing everyone equally with focused and ongoing societal efforts to address avoidable inequalities, historical and contemporary injustices, and the elimination of health and health care disparities.”26 Health equity impacts an individual’s health and access to health services.27 Gaps in health equity can involve discrimination embedded in contextually complex societal, economic, and institutional factors, including policy.27,28
Frameworks
Frameworks, conceptual models, and theories (hereafter referred to collectively as “frameworks”) provide a common understanding and language about complex phenomenon and a structured way to develop and/or evaluate interventions.29–32 For example, the socio-ecological model (SEM) was developed within the field of psychology and describes 4 nested levels of influence that impact each other: microsystem/individual, mesosystem/interrelations, exosystem/social structures, and macrosystem/institutional patterns of culture.12 A number of researchers and public health agencies have applied this seminal model to understand the complexities of digital and health equity.21,33–35 An updated SEM that includes an institutional/organizational level36 has also been applied to public health and social institutions37,38 and technology.39–41
Need for a unified definition and framework
There is a need for a clear conceptualization of digital health equity. The field is still developing as the rapid deployment of digital health interventions occurs within changing, complex ecosystems in which users live. Whether a user can access digital health technologies can be impacted by social determinants, or drivers, of health (SDOH)4,42 (in this paper we use “driver” to align with efforts to assess and address SDOH in a way that is more immediately understandable and actionable).43
The WHO deems access to broadband internet as an SDOH necessary for full participation in society and the economy,44 yet 12% of United States adults are without home internet access,45 which may prevent them from benefiting from digital health technologies. Understanding the underlying causes for lack of internet is key to identifying appropriate interventions to improve access. In the United States, reasons may include digital redlining (the “intentional lack of investment in broadband infrastructure and affordable service,” p. 2) among minority and low-income neighborhoods,21 policing of free internet resources in non-minoritized and wealthier areas,46 and the legacy of colonization of and discrimination against minoritized populations as codified and institutionalized in laws and their enforcement, education, and access to resources.47 These practices can lead to decreased trust in digital resource providers, including government institutions and programs.47–49 For example, the United States Affordable Connectivity Program was an intervention that provided subsidies for affordable internet subscriptions and a one-time discount for a device that connects to the internet. However, not all who qualified for the program could benefit due to lack of trust in federal programs or challenges enrolling among those whose primary language is not English or those with disabilities.50
Literature suggests that a lack of clear conceptualizations of digital health equity can have real-world impacts. During the COVID-19 public health emergency in 2020, healthcare organizations rapidly deployed telehealth.51 However, marginalized populations experienced unequal access to telehealth and its benefits.52–54 Researchers suggest that a possible factor is the lack of a strong theoretical foundation for digital health equity interventions.13
Therefore, to address this gap, we conducted a scoping review of the literature.55 Our objectives were to identify and describe published frameworks relevant to digital health equity interventions, identify and describe definitions of “digital health equity,” and understand the breadth and potential gaps in concepts represented in those frameworks.
Methods
This work is part of a larger study to develop guidance for community-based organizations in their digital health equity intervention work.50
Study design
This scoping review, guided by the PRISMA Extension for Scoping Reviews (PRISMA-ScR),56 was conducted from March 2023 to March 2024. The search included all literature published prior to January 1, 2024, using broad search terms: (framework OR conceptual model OR theory) AND (equit* OR inequit* OR disparit*) AND (connectivity OR broadband OR internet OR technolog* OR informatics OR digital) AND (program evaluation OR planning techniques). We conducted an additional search for papers using the phrase “digital health equity” to capture the variety of disciplines engaging in digital health equity research. We queried the following databases: CINAHL (nursing), Engineering Village (computer science and engineering), PsycINFO (psychology), PubMed (biomedical), and Web of Science (social health sciences). Database yields were uploaded to Covidence (Melbourne, Australia).
Researchers with expertise in digital health and health equity and experienced in conducting scoping and systematic reviews conducted the screening in 2 phases. In phase 1, 1 reviewer screened abstracts, applying inclusion criteria to select articles considered for full-text review. In phase 2, 2 independent reviewers screened full text papers, applying inclusion criteria and documenting reasons for exclusion. The reviewers discussed discrepancies and came to consensus on decisions with the help of a third reviewer.
We included peer-reviewed articles that were written in English and published before January 1, 2024 that described studies that were: empirical; identified an existing or proposed a new conceptual framework/model/theory; involved technology, health, and equity; and described planning, implementation, and/or evaluation of a related program or intervention. Inclusion criteria were applied only to the studies and not to the frameworks; therefore, identified frameworks did not need to include digital health equity concepts if the study they were used in met the inclusion criteria. Systematic or scoping literature reviews and papers presenting only computational or mathematical models were excluded.
For the criterion of being a framework/model/theory, we accepted author-identified labeling and did not attempt to clearly differentiate between the 3 types given that authors often use the terms interchangeably.57 We used the following definitions to determine whether the criterion was met: conceptual framework are a graphical or narrative explanation of “the main things to be studied—the key factors, concepts, or variables—and the presumed relationships among them;”58 a conceptual model is a “diagram of proposed and causal linkages among a set of concepts believed to be related” to a specific issue under investigation and represents “empirical findings or the experience of practicing professionals;”57 a theory is a “set of interrelated constructs (concepts), definitions, and propositions that present a systematic view of phenomena by specifying relations among variables, with the purpose of explaining and predicting the phenomena” (p.11).32 We collectively describe these conceptualizations as “frameworks” in this paper.
A researcher re-read the final yield and extracted the following information: publication and study information; the name and purpose of the framework; evidence used, if any, to develop the framework; whether the framework was validated; names and definitions for framework concepts; and definitions and descriptions of “digital health equity” anywhere in the publication. We defined a concept as “a word or phrase that summarizes ideas, observations, and experiences” (p. 4). Propositions were defined as the relationships between concepts.59
Analysis
To address the study purposes, we conducted the following analytic steps.
Step 1. Characteristics of Published Frameworks. We labelled each framework identified in the papers as 1 of 3 types: “digital health equity-major” if digital health equity was explicitly described as a purpose of the framework (not to be confused with the purpose of the paper) and if named concepts related to digital equity, health equity, and/or digital health equity were present; “digital health equity-minor” if digital health equity was not an explicit purpose of the framework, but there were named concepts related to the same 3 terms present within the framework; and “general focus” if digital health equity was not included within the purpose of the framework or its concepts. We calculated basic counts and percents to quantify study and framework characteristics.
Step 2. Proposed Definition. We used the content analysis method to inductively identify common features across the definitions of digital health equity or their component words.60,61
Step 3. Concepts by SEM Level. We applied a deductive approach, the directed content analysis method, which uses existing theory to guide analysis categories, to organize concepts. We chose this method because applying a widely used framework that takes into account the complex context of digital health equity allowed us to assess gaps in the corpus of concepts used in digital health equity intervention research. We chose the version of the SEM that includes the organizational level in addition to the individual, interpersonal, community, and society levels.36,58 One investigator independently assigned each concept using the definition provided by the source author to an SEM level. The other investigator independently reviewed the assignments, then both met to come to consensus of the finalized assignments.
Step 4. Breadth of Concepts. We conducted an inductive analysis using conventional content analysis,62 during which concept categorization is guided by what emerges from the data. We chose this method to understand the breadth of concepts represented within this relatively new field of study without constraining it to an existing framework. To complete this analysis, we independently grouped similar concepts into high-level categories then jointly came to consensus on groupings and category labels.
Results
Yield
Figure 1 provides the PRISMA Flow Diagram. We identified 638 references after removing duplicates. Upon completion of all screening steps, 44 publications (30.1% of full-text reviewed papers, 4.8% of the total screened sample) were included in this analysis. A complete bibliography is available in File S1.
Figure 1.
PRISMA flow diagram.
Study and framework characteristics
Most studies were conducted in North America (n = 32) and published in the past 5 years (see Table 1). Across the 44 studies, we identified 42 frameworks. 22 were existing frameworks and 20 were proposed frameworks. Thirty-four included definitions of some or all concepts. Among proposed new frameworks, most were informed by a combination of sources, including existing frameworks (n = 11), literature reviews (n = 8), and previous research (n = 7) (see Table 1).
Table 1.
Description of publications included in the scoping review (n = 44) and frameworks included in the publications (n = 42).
| Characteristics | Count (%) |
|---|---|
| Among all publications (n = 44) | |
| Location of study or framework development a | |
| Africa | 1 (2.3) |
| Asia | 4 (9.1) |
| Australia | 3 (6.8) |
| Caribbean | 1 (2.3) |
| Europe | 3 (6.8) |
| North America | 32 (72.7) |
| South and Central America | 1 (2.3) |
| Other | 1 (2.3) |
| Year of publication | |
| 2005, 2011, 2012, 2017 | 1 each |
| 2018 | 2 |
| 2019 | 3 |
| 2020 | 3 |
| 2021 | 6 |
| 2022 | 13 |
| 2023 | 13 |
| Among all frameworks (n = 42) | |
| Framework genesis | |
| Existing framework | 22 (52.4) |
| Newly proposed framework | 20 (47.6) |
| Framework’s level of focus on digital health equity | |
| Major focus (digital health equity-major) | 13 (31.0) |
| Concept definitions provided | 8 (19.0) |
| Minor focus (digital health equity-minor) | 8 (19.0) |
| Concept definitions provided | 7 (16.7) |
| General focus | 21 (50.0) |
| Concept definitions provided | 19 (45.2) |
| Among proposed new frameworks (n = 20) | |
| Sources of information used to develop the framework b | |
| Narrative literature review | 2 (10.0) |
| Literature review (type not specified) | 6 (30.0) |
| Previous research by publication authors | 7 (35.0) |
| Previously developed frameworks | 11 (55.0) |
| Interviews | 2 (10.0) |
| Focus groups | 2 (10.0) |
| Survey | 1 (5.0) |
| Other | 8 (40.0) |
Some studies occurred in more than 1 continent, therefore the total count for this variable is greater than the number of publications.
Some frameworks were developed using multiple types of evidence, therefore the total count for variable is greater than the number of publications that proposed a new framework.
Among the 42 frameworks identified, 13 had digital health equity as a major focus (digital health equity-major) (see Table 1). These included 7 new conceptualizations and 1 which built on an existing framework. Two papers noted that the frameworks were validated.63,64 Only 8 major-focus frameworks defined concepts within their frameworks and were included in the concept analysis (see Table 2).
Table 2.
Concepts organized by socio-ecological level among frameworks (n = 38).
|
Sociological level of influence (Papers with at least 1 concept defined and in the framework at the level) |
Individual | Interpersonal | Org. or program | Community | Societal | |
|---|---|---|---|---|---|---|
| Author | Framework | |||||
| Digital health major frameworks (n = 8) | ||||||
| Blanc et al. 20231 | Digital health equity and inclusion framework/model | X | X | X | ||
| Faber et al. 202373 | Guide for ehealth intervention design | X | ||||
| Foley et al. 202166 | Suggested pathways of access, use, and benefit from digital health services | X | X | X | ||
| Henson et al. 202374 | Djurali Model for digital health equity | X | X | X | ||
| Lyles et al. 202272 | Framework for digital health equity | X | X | X | X | |
| Richardson et al. 20224 | Framework for digital health equity* | X | X | X | X | |
| Pacifico Silva et al. 201863 | Responsible innovation in health (RIH) framework | X | X | X | ||
| Sun et al. 202364 | The impact of digital inclusion on health status: the mediating effect of cultural capital | X | ||||
| Digital health minor frameworks (n = 7) | ||||||
| De Souza et al. 202175 | Techno-economic framework for installing broadband networks in rural and remote areas | X | ||||
| Gauvreau et al. 202376 | Child-tailored health technology assessment (HTA) framework | X | X | X | X | |
| Kukhareva et al. 202277 | Evaluation in life cycle of IT (ELICIT) framework | X | ||||
| Nair et al. 202378 | ConNECT framework | X | X | |||
| Steinman et al. 202379 | Reach-effectiveness-adoption-implementation-maintenance + equity framework* | X | X | |||
| Whitehead et al. 202271 | National quality forum Telehealth measurement framework* | X | X | X | X | X |
| Zhang and Liu 202280 | Smart city ontology | X | ||||
| General-focus frameworks (n = 19) | ||||||
| Allicock et al. 201781 | The diffusion of innovation theory* | X | X | |||
| Spierling Bagsic et al. 202382 | Reach-effectiveness-adoption-implementation-maintenance framework* | X | ||||
| Belkin et al. 201183 | 5×5 framework | X | X | |||
| Braganza et al. 202284 | Learning health system framework* | X | X | |||
| Chanfreau-Coffinier et al. 201985 | A logic model for precision medicine implementation | X | ||||
| Cheng et al. 202186 | Self-determination theory* | X | ||||
| Eiraldi et al. 202287 | Interactive system framework for dissemination and implementation (ISF)* | X | ||||
| Gallo et al. 202188 | Four feedback mechanisms involving inputs, processes, outputs, and outcomes | X | ||||
| Kim et al. 202389 | Medical research council (MCR) process evaluation framework* | X | X | |||
| Kohn et al. 202390 | Framework for reporting adaptations and modifications-expanded (FRAME) | X | X | |||
| Steinman et al. 202379 | ||||||
| Kohn et al. 202390 | Implementation outcomes framework | X | X | |||
| Steinman et al 202379 | ||||||
| Laur et al. 202291 | Quadruple aim framework | X | X | X | ||
| Nelson et al. 202292 | Consolidated framework for implementation research (CFIR)* | X | X | X | ||
| Nelson and Zanti 202093 | Government alliance for race equity framework* | X | ||||
| Rhodes et al. 202194 | Community energy balance (CEB) framework* | X | X | X | X | |
| Ross et al. 201895 | Generalizable framework for multi-scale auditing of digital learning provision higher Ed. | X | ||||
| Stone and Lan 201296 | Planning and evaluating technology-based research and development* | X | ||||
| Tebb et al. 201997 | 6 PCORI (patient-centered outcomes research institute) Engagement Principles* | X | ||||
| Wieland et al. 202298 | Crisis and emergency risk communication (CERC) framework* | X | ||||
| *Existing framework | Number of frameworks covering each socio-ecological level | 17 | 6 | 27 | 13 | 7 |
Eight frameworks had digital health equity as a minor component, focusing instead on general technology development/integration or assessment/evaluation of health technologies (Table 1). Seven of these digital health equity-minor frameworks provided concept definitions and were included in the concept analysis; only one was not65 (Table 2). The remaining 19 frameworks included general-focus frameworks without a specific focus on digital heath equity, and all provided at least some concept definitions.
Definitions of “digital health equity”
Among the 44 publications included in our review, only 5 provided definitions or descriptions for digital health equity. Blanc et al. defines digital health equity and inclusion as “the fair and just opportunity to engage with digital health tools to support good health outcomes.” (p. 262).1 Foley et al.66 cites a previous definition by Kickbusch, “Digital health equity is concerned with fair and just access to, use of and benefit from digital health services and is a critical axis of contemporary health promotion.”67 Ha et al. describes it as “the readiness of all individuals to access digital health, regardless of age, race, income, or technology access, ensuring that no one is left behind due to a lack of connectivity or literacy” (p. 2),68 citing a previously published definition by Wood et al.69 Kaihlanen et al. refers to it as “…an equal opportunity for individuals to benefit from the knowledge and practices related to the development and use of digital technologies to improve health” (p. 2),70 citing previous definitions.3,15 The fifth definition is suggested by Richardson et al.: “… [digital health equity includes] equitable access to digital healthcare, equitable outcomes from and experience with digital healthcare, and equity in the design of digital health solutions” (p. 2),4 combining concepts from previous definitions.2,3
There are 5 common features across these definitions including: equity, a need or precursor to action, an action taken, a technology related solution, and a result of the action. Figure 2 shows these features with illustrative words from the definitions.
Figure 2.
Common concepts in definitions of digital health equity with illustrative words.
Concepts by SEM level
Of the 42 frameworks, 34 (81.0%) had at least some concepts defined. These frameworks also varied in the number of SEM levels covered by the framework (Table 2). About 44% of the frameworks (n = 15) had concepts addressing only 1 level of the SEM, while the other 56% (n = 19) were multi-level. Only 1 framework, National Quality Forum Telehealth Measurement Framework, referenced all SEM levels.71 The most commonly represented level was the organizational level, with 27 (79.4%) frameworks covering it, and the least represented was interpersonal level (n = 6, 17.6%).
Breadth of concepts
Among the 34 frameworks with definitions, 243 concepts (see File S1 for complete list of concepts and mapping to categories) were identified and grouped into 43 categories (see Table 3). No single framework referenced all 43 categories. The most comprehensive frameworks were the digital health equity frameworks by Lyles et al.72 and Richardson et al.4 which addressed 15 and 12 concept categories, respectively. Several categories were only incorporated into DHE-major frameworks: access to digital services, digital health services, digital equity, implicit algorithmic and technology bias, digital health/e-Health literacy, perceived value of an intervention to the community/population/society, and technology policy. Fourteen concept categories were not included in any DHE-major frameworks, but rather, were only included in DHE-minor or general frameworks. Examples include concepts related to an intervention (eg, implementation process for and impacts of the intervention), communication among intervention stakeholders, and motivational factors for developing an intervention (eg, needs of the community or population). Several concepts were only part of general-focus frameworks, such as: needs of the implementing organization/program, perceived value of the intervention to the individual, and transparency.
Table 3.
Digital health equity concept categories by focus of frameworks.
| Concept category | Citation, organized by digital health equity-major, -minor, and general-focus categories | |
|---|---|---|
| 1 | Access to digital health services (eg, telehealth) | Major: Foley 202166 |
| Minor: Whitehead 202271 | ||
| 2 | Access to digital services (eg, broadband internet) | Major: Henson 202374, Lyles 202272, Richardson 20224, Sun 202364 |
| 3 | Access to health information and dataa | Minor: Whitehead 202271 |
| General: Braganza 202284 | ||
| 4 | Access to in-person health care | Major: Foley 202166 |
| Minor: Whitehead 202271 | ||
| 5 | Autonomy of individualsb | General: Cheng 202186 |
| 6 | Characteristics of individuals involved in intervention (eg, patients, staff) | Major: Blanc 20231, Foley 202166, Lyles 202272, Richardson 20224, Sun 202364 |
| Minor: Gauvreau 202376, Zhang 202280 | ||
| General: Braganza 202284, Nelson 202292, Rhodes 202194 | ||
| 7 | Characteristics of interpersonal relationships | Major: Blanc 20231, Richardson 2022 |
| Minor: Gauvreau 202376 | ||
| General: Rhodes 202194 | ||
| 8 | Characteristics of community | Major: Blanc 20231, Foley 202166, Lyles 202272, Richardson 20224, Sun 202364 |
| General: Kohn 202390, Rhodes 202194 | ||
| 9 | Characteristics of populationa | Minor: Gauvreau 202376, Zhang 202280 |
| General: Laur 202291, Rhodes 202194 | ||
| 10 | Characteristics of intervention or program | Major: Blanc 20231, Henson 202374, Pacifico Silva 201863 |
| Minor: Nair 202378, Zhang 202280 | ||
| General: Chanfreau-Coffinier 201985, Eiraldi 202287, Kim 202389, Kohn 202390, Laur 202291, Nelson 202292, Rhodes 202194, Stone 201296 | ||
| 11 | Characteristics of organization | Major: Blanc 20231 |
| General: Gallo 202188, Kohn 202390, Nelson 202093, Nelson 202292, Stone 201296 | ||
| 12 | Co-learning among intervention stakeholders | Major: Lyles 202272 |
| General: Braganza 202284, Tebb 201997 | ||
| 13 | Communication among intervention stakeholdersa | Minor: Nair 202378 |
| General: Allicock 201781, Wieland 202298 | ||
| 14 | Competenceb | General: Cheng 202186 |
| 15 | Digital health services | Major: Foley 202166 |
| 16 | Emotionb | General: Wieland 202298 |
| 17 | Equity, digital | Major: Henson 202374, Lyles 202272, Richardson 20224, Sun 202364 |
| 18 | Equity, digital health | Major: Blanc 20231, Lyles 202272 |
| Minor: Gauvreau 202376, Whitehead 202271 | ||
| 19 | Equity, health | Major: Blanc 20231, Lyles 202272, Pacifico Silva 201863 |
| Minor: Gauvreau 202376, Nair 202378, Steinman 202379 | ||
| General: Kohn 202390, Nelson 202093 | ||
| 20 | Event causing risk to communityb | General: Wieland 202298 |
| 21 | Impacts of interventiona | Minor: Gauvreau 202376, Steinman 202379, Whitehead 202271 |
| General: Spierling Bagsic 202382, Chanfreau-Coffinier, 201985, Kohn 202390 | ||
| 22 | Implementation process for interventiona | Minor: Nair 202378, Steinman 202379 |
| General: Allicock 201781, Spierling Bagsic 202382, Chanfreau-Coffinier 201985, Eiraldi 202287, Gallo 202188, Kim 202389, Kohn 202390, Nelson 202093, Nelson 202292, Rhodes 202194, Stone 201296 | ||
| 23 | Implicit algorithmic bias | Major: Richardson 20224 |
| 24 | Implicit technology bias | Major: Blanc 20231, Richardson 20224 |
| 25 | Literacy, digital health/e-Health | Major: Foley 202166, Pacifico Silva 201863 |
| 26 | Literacy, digital | Major: Lyles 202272, Richardson 20224, Sun 202364 |
| General: Ross 201895 | ||
| 27 | Needs of organization implementing programb | General: Kohn 202390, Stone 201296 |
| 28 | Needs of community or populationa | Minor: Gauvreau 202376 |
| General: Kohn 202390, Stone 201296 | ||
| 29 | Outcomes and effectiveness of intervention | Major: Blanc 20231, Henson 202374, Sun 202364 |
| Minor: Gauvreau 202376, Steinman 202379, Whitehead 202271 | ||
| General: Allicock 201781, Spierling Bagsic 202382, Chanfreau-Coffinier 201985, Gallo 202188 | ||
| Kohn 202390, Kim 202389, Laur 202291, Stone 201296 | ||
| 30 | Partnerships | Major: Lyles 202272, Richardson 20224 |
| General: Allicock 201781, Rhodes 202194, Tebb 201997 | ||
| 31 | Perceived value of intervention to individualsb | General: Spierling Bagsic 202382 |
| 32 | Perceived value of intervention to organization or program | Major: Pacifico Silva 201863 |
| Minor: De Souza 202175, Whitehead 202271 | ||
| General: Braganza 202284 | ||
| 33 | Perceived value of intervention to community or population | Major: Foley 202166, Pacifico Silva 201863 |
| 34 | Perceived value of intervention to society | Major: Pacifico Silva 201863 |
| 35 | Reciprocal relationships among stakeholders | Major: Lyles 202272, Richardson 20224 |
| General: Allicock 201781, Tebb 201997 | ||
| 36 | Relatednessb | General: Cheng 202186 |
| 37 | Societal context | Major: Blanc 20231, Henson 202374, Lyles 202272, Pacifico Silva 201863, Richardson 20224 |
| Minor: DeSouza 202175, Gauvreau 202376, Zhang 202280 | ||
| General: Allicock 201781, Kim 202389, Kohn 202390, Nelson 202292, Stone 201296, Rhodes 202194 | ||
| 38 | Sustainability of intervention | Major: Pacifico Silva 201863 |
| Minor: Steinman 202379, Whitehead 202271, Zhang 202280 | ||
| General: Allicock 201781, Spierling Bagsic 202382, Gallo 202188, Kohn 202390 | ||
| 39 | Technology policy | Major: Lyles 202272, Richardson 20224 |
| 40 | Transparencyb | General: Braganza 202284, Tebb 201997 |
| 41 | Trust | Major: Blanc 20231, Foley 202166, Lyles 202272 |
| General: Tebb 201997 | ||
| 42 | User experience | Major: Lyles 202272 |
| Minor: Whitehead 202271 | ||
| General: Spierling Bagsic 202382, Braganza 202284, Laur 202291 | ||
| 43 | Workforce skills | Major: Lyles 202272 |
| Minor: Nair 202378 | ||
| General: Belkin 201183, Braganza 202284, Eiraldi 202287 |
Concept present only in digital health equity-minor or general-focus frameworks;
Concept present only in general-focus frameworks.
Discussion
The key findings reported here are relevant to researchers or program developers who may find the breadth of applicable frameworks helpful to their design and planning of comprehensive and effective interventions.
In this scoping review, frameworks relevant to digital health equity including some from the fields of biomedical, population health, business, implementation science, information, and computer sciences. The variety of frameworks indicates that authors are generating knowledge from cross-disciplinary perspectives. In addition, the frameworks vary in the level of focus within the SEM and the number of levels addressed (ie, individual, interpersonal, organizational, community, and societal). The frameworks refer to a multi-level constellation of concepts: 243 concepts grouped into 43 categories. These concepts also span all 5 SEM levels. The individual and organizational/program levels were well-represented among the frameworks, while the interpersonal, community, and societal levels were less represented.
Previous literature highlights the importance of accounting for community and societal context in addressing health equity and digital equity,99 aligning with recommendations that broadband interventions include educational outreach internally or via trusted community partners.100 Our findings also align with the elements of successful state programs for digital equity as described by the U.S. National Telecommunications and Information Administration (NTIA) which coordinates the national Internet for All program.101 One key aspects of Internet for All was the Affordable Connectivity Program (ACP), which addressed the individual-level concept that broadband and digital inclusion is an SDOH by providing internet subsidies for low-income families across the United States.102
Organizational/program level concept categories were represented in most papers: internal capacity and partnerships were important considerations when developing digital health equity interventions. Delivery of these interventions relies on the alignment of capabilities (eg, assets, skills, knowledge) and capacity (eg, funding, resources, time) of the community members, CBO, and partners to meet the community’s needs. Building comprehensive approaches using a community coalition, as advocated by National Digital Inclusion Alliance (NDIA),103 requires identifying and addressing mechanisms of minoritization, which can impact coalition relationships, and intervention design and efficacy.104
Fewer frameworks addressed interpersonal, community, and societal level concept categories. Several papers suggested that understanding community needs is key to intervention planning and evaluation. Yet, the frameworks infrequently defined community-level concepts explicitly. While publicly-available national data quantifying community needs and internet availability exist,105 these concepts may not be adequate for characterizing specific local needs. For example, in prior qualitative research, we identified gaps in data for identifying the particular needs of local communities and a lack of valid and reliable measures of digital health equity; key informants reported having to create customized surveys to try and capture these data, resulting in lack of comparability.47 While several assessment guides exist, including one from the NTIA106 and the National League of Cities Digital Equity Playbook,107 there is a need for validated measures that CBOs can easily use to plan and evaluate their digital health equity interventions.
Similarly, several papers mention the importance of relationships and trust between CBOs and communities, but do not specify concepts related to these interpersonal relationships. For example, papers suggest that community members must trust digital equity interventions, federal programs, internet service providers, and other providers of digital health, including clinicians.108 This finding aligns with previous work, highlighting the importance of trust in internet service providers and digital tools and policies supportive of consumer protection.48,104 Interestingly, the concepts we identified did not include trust related to data breaches. This aligns with our previous research which found that trust around data privacy and security was focused around the use of data for oppression. Understanding the sources of mistrust is important, as it identifies the upstream causes for mistrust, such as mistrust of the government or medical facilities among Black, Indigenous, and other communities of color due to legacies of colonization and slavery, and institutionalized racism integrated into medical practice.109 Additionally, there has been recent attention paid to the role of bias in technology and algorithms that may exacerbate health disparities.110–112 It may be interesting to understand how trustworthy interpersonal relationships are characterized and manifested through communication and behavior across stakeholders, and whether the influence of these relationships can ameliorate such biases.
Finally, the societal level is not often included in frameworks. Only 3 DHE-major 4,63,72, 1 DHE-minor,71 and 3 general frameworks 91,93,94 include concepts at the societal level, such as the societal context, technology policy, and impacts of an intervention on society. There are several societal factors and characteristics that can affect the individual, organizational, community, and interpersonal levels of the ecosystem. For example, legal and regulatory policies governing healthcare and technology, market dynamics that affect the supply and demand of digital health, and population characteristics would certainly affect digital health interventions.
Gaps
As one of the first scoping reviews to address frameworks and concepts of digital health equity, we noted several gaps based on the principal findings of our study. First, there is no consensus or widely accepted definition of digital health equity; there was variation across studies in how they defined the concept, if they defined it at all.
Second, there were concept categories present in digital health equity-minor and general focus frameworks but missing from digital health equity-major frameworks as shown in Table 3. Several of these categories related to the organization and program (eg, needs of the organization implementing the program, implementation process for the program), suggesting that health equity-major frameworks may be more conceptual than actionable for those looking to use a framework to guide an intervention.
Third, there is no comprehensive framework that encompasses all 5 SEM levels. In concert, these indicate an overall gap in understanding about how the intersection and application of digital health and equity concepts can inform the development and implementation of equitable digital health interventions.
Consolidated definition of digital health equity
Based on the findings of this scoping review, we first suggest a consolidated definition of digital health equity that addresses the 5 concepts of equity, a need or precursor to action, an action taken, a technology related solution, and a result of the action. We used wording from the papers and other cited literature. Our proposed definition is: Digital health equity is a multi-level socio-ecological concept that results from fair and just opportunities for everyone to attain their highest level of health through access to technology-enabled health resources and services.4,26,113–115 Digital health equity interventions apply technology-enabled solutions to deliver health equity impacts.
We discovered a number of intriguing concepts in this review that could contribute to a deeper characterization of digital health equity. Additional research is necessary to map the large number of identified concepts that could apply to digital health equity and validate which concepts are most relevant and useful. A more comprehensive framework including these concepts should highlight that digital health equity is not an effort that can be delivered by one sector alone but requires partnership across stakeholders from healthcare, economics, telecommunications and other industry players, CBOs, and community members themselves, among others. The findings we report may inform the development of a framework, and eventually an explanatory model of digital health equity intervention effectiveness. Additional investigation might determine the relevance of the 43 categories and 243 concepts we identified to see which are relevant and necessary for inclusion in a digital health equity framework.
Limitations
The purpose of a scoping review is to describe the landscape of knowledge in a field to identify concepts and highlight gaps. By design, this type of review is limited by searching for literature at one point in time. In a new topic, such as digital health equity, search terms are not standardized, so we may have missed papers that did not use the keywords we used in our search. To minimize these limitations, we cross-checked systematic reviews and reference lists of included paper, to be as thorough as possible.
Conclusions
Digital health equity is emerging as a priority across the world. As national and local investments are made to increase access to broadband for those who are currently underserved, we have the opportunity to leverage those investments to achieve improved health and health equity. As one of the first scoping reviews to address the need for frameworks for digital health equity, we offer several contributions to the field. First, we offer a consolidated definition of digital health equity. Second, the review highlights the diversity of frameworks that researchers might apply to their research questions and intervention developers might apply their program designs and evaluations. This greater awareness and understanding of frameworks may support improved study and program designs. Third, our research provides an inventory of the broad set of factors, represented by the concepts, concept categories and organization by SEM, that might impact whether and how digital health equity may be achieved. These data may form the basis of a more comprehensive framework for digital health equity. In future, these contributions may offer guidance to those communities and stakeholders who are working toward achieving both digital inclusion and digital health equity.
Supplementary Material
Acknowledgments
We thank Surya Mehta for assistance with data collection and Elizabeth Gloor for copy-editing support.
Contributor Information
Katherine K Kim, Department of Public Health Sciences/Division of Health Informatics, School of Medicine, University of California Davis, Sacramento, CA 95616, United States.
Uba Backonja, MITRE Corporation, Health Innovation Center, McLean, VA 22102, United States; Department of Biomedical Informatics and Medical Education, School of Medicine, University of Washington, Seattle, WA 98195, United States.
Author contributions
K.K. and U.B. are co-first authors and made equal and substantial contributions to the conceptualization, methodology, data acquisition, analysis, and investigation. Both K.K. and U.B. wrote major portions of the manuscript, had final approval of the version to be published, and are accountable for all aspects of the work.
Supplementary material
Supplementary material is available at Journal of the American Medical Informatics Association online.
Funding
This work was supported by The MITRE Innovation Program, an intramural funding program of the MITRE Corporation, which had no control over the conduct of the research nor the findings of the research.
Conflicts of interest
K.K. was previously employed by The MITRE Corporation, a non-profit research and development corporation, at the time the study was conducted. U.B. is currently employed by The MITRE Corporation. K.K. and U.B. received salary support from the MITRE Innovation Program during the study period.
Data availability
The original data generated in the course of the study is provided as Supplementary Material (File S1).
References
- 1. Blanc J, Hahn K, Oliveira B, et al. Bringing health care equity to diverse and underserved populations in sleep medicine and research through a digital health equity framework. Sleep Med Clin. 2023;18:255-267. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2. Lyles CR, Wachter RM, Sarkar U. Focusing on digital health equity. JAMA. 2021;326:1795-1796. [DOI] [PubMed] [Google Scholar]
- 3. Crawford A, Serhal E. Digital health equity and COVID-19: the innovation curve cannot reinforce the social gradient of health. J Med Internet Res. 2020;22:e19361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Richardson S, Lawrence K, Schoenthaler AM, Mann D. A framework for digital health equity. NPJ Digit Med. 2022;5:119. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5. Masters NT, Lindhorst TP, Meyers MK. Jezebel at the welfare office: how racialized stereotypes of poor women’s reproductive decisions and relationships shape policy implementation. J Poverty. 2014;18:109-129. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6. Kruse CS, Williams K, Bohls J, Shamsi W. Telemedicine and health policy: a systematic review. Health Policy Technol. 2021;10:209-229. [Google Scholar]
- 7. Nadasen P. From widow to “welfare queen”: welfare and the politics of race. Black Women, Gender Families. 2007;1:52-77. [Google Scholar]
- 8. Lapham J, Martinson ML. The intersection of welfare stigma, state contexts and health among mothers receiving public assistance benefits. SSM Popul Health. 2022;18:101117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9. Rose M, Baumgartner FR. Framing the poor: media coverage and US poverty policy, 1960–2008. Policy Stud J. 2013;41:22-53. [Google Scholar]
- 10. Hatton CR, Topazian RJ, Barry CL, McGinty EE, Levine AS. Predictors of public support for social safety net policy during the COVID-19 pandemic. Am J Prev Med. 2022;63:77-84. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11. Federal Communications Commission. Preventing Digital Discrimination, Report and Order and Further Notice of Proposed Rulemaking—GN Docket No. 22-69. 2023. 38 FCC Rcd 11440 (13). 89 FR 6477 (02/01/2024) 89 FR 4128 (01/22/2024).
- 12. Bronfenbrenner U. Toward an experimental ecology of human development. Am Psychol. 1977;32:513-531. [Google Scholar]
- 13. Husain L, Greenhalgh T, Hughes G, Finlay T, Wherton J. Desperately seeking intersectionality in digital health disparity research: narrative review to inform a richer theorization of multiple disadvantage. J Med Internet Res. 2022;24:e42358. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14. Fang ML, Canham SL, Battersby L, Sixsmith J, Wada M, Sixsmith A. Exploring privilege in the digital divide: implications for theory, policy, and practice. Gerontologist. 2019;59:e1-e15. [DOI] [PubMed] [Google Scholar]
- 15. World Health Organization. Global strategy on digital health 2020-2025. 2021. Accessed December 1, 2024. https://www.who.int/docs/default-source/documents/gs4dhdaa2a9f352b0445bafbc79ca799dce4d.pdf
- 16. U.S. Department of Education. Advancing Digital Equity for All: Community-Based Recommendations for Developing Effective Digital Equity Plans to Close the Digital Divide and Enable Technology-Empowered Learning. U.S. Department of Education, Office of Educational Technology; 2022.
- 17. Valdez RS, Swenor BK. Structural ableism—essential steps for abolishing disability injustice. N Engl J Med. 2023;388:1827-1829. [DOI] [PubMed] [Google Scholar]
- 18. Starks AC, Reich SM. “What about special ed?”: barriers and enablers for teaching with technology in special education. Comput Educ. 2023;193:104665. [Google Scholar]
- 19. Hankerson DL, Brown LX. Technology as a civil right and a move toward disability justice: ensuring digital access for disabled students in the pandemic. Drexel L Rev. 2020;13:869. [Google Scholar]
- 20. Vyas DA, Eisenstein LG, Jones DS. Hidden in plain sight—reconsidering the use of race correction in clinical algorithms. N Engl J Med. 2020;383:874-882. [DOI] [PubMed] [Google Scholar]
- 21. McCall T, Asuzu K, Oladele CR, Leung TI, Wang KH. A socio-ecological approach to addressing digital redlining in the United States: a call to action for health equity. Front Digit Health. 2022;4:897250. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22. Yearby R, Clark B, Figueroa JF. Structural racism in historical and modern US health care policy. Health Aff (Millwood). 2022;41:187-194. [DOI] [PubMed] [Google Scholar]
- 23.U.S. Equal Employment Opportunity Commission. Diversity in the High Tech Workforce and Sector 2014-2022. Accessed December 1, 2024. https://www.eeoc.gov/special-report/high-tech-low-inclusion-diversity-high-tech-workforce-and-sector-2014-2022
- 24. Massey DS. The legacy of the 1968 fair housing act. Sociol Forum (Randolph N J). 2015;30:571-588. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25. Raza MM, Venkatesh KP, Kvedar JC. Promoting racial equity in digital health: applying a cross-disciplinary equity framework. NPJ Digit Med. 2023;6:3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26. U.S. Department of Health and Human Services. Health Equity and Health Disparities Environmental Scan. U.S. Department of Health and Human Services, Office of the Assistant Secretary for Health, Office of Disease Prevention and Health Promotion; 2022.
- 27. National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Population Health and Public Health Practice; Committee on Community-Based Solutions to Promote Health Equity in the United States. Chapter 3 The root causes of health inequity. In: Baciu A, Negussie Y, Geller A, eds. Communities in Action: Pathways to Health Equity. National Academies Press; 2017. [PubMed] [Google Scholar]
- 28. Jones DS, Hammonds E, Gone JP, Williams D. Explaining health inequities—the enduring legacy of historical biases. N Engl J Med. 2024;390:389-395. [DOI] [PubMed] [Google Scholar]
- 29. Miles MB, Huberman AM, Saldana J. Qualitative Data Analysis: A Method Sourcebook. Sage Publications; 2014. [Google Scholar]
- 30. Nilsen P. Making sense of implementation theories, models and frameworks. Implement Sci. 2015;10:53. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Kivunja C. Distinguishing between theory, theoretical framework, and conceptual framework: a systematic review of lessons from the field. IJHE. 2018;7:44-53. [Google Scholar]
- 32. Kerlinger FN, Lee HB. Foundations of Behavioral Research. 4th ed. Holt; 2000:409. [Google Scholar]
- 33. Centers for Disease Control and Prevention. The social-ecological model: a framework for prevention. 2015. Accessed August 5, 2024. https://wwwcdcgov/violenceprevention/about/social-ecologicalmodelhtml
- 34. Ingram M, Wolf AMA, López-Gálvez NI, Griffin SC, Beamer PI. Proposing a social ecological approach to address disparities in occupational exposures and health for low-wage and minority workers employed in small businesses. J Expo Sci Environ Epidemiol. 2021;31:404-411. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35. Alvidrez J, Castille D, Laude-Sharp M, Rosario A, Tabor D. The national institute on minority health and health disparities research framework. Am J Public Health. 2019;109:S16-S20. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36. McLeroy KR, Bibeau D, Steckler A, Glanz K. An ecological perspective on health promotion programs. Health Educ Q. 1988;15:351-377. [DOI] [PubMed] [Google Scholar]
- 37. Stokols D. Translating social ecological theory into guidelines for community health promotion. Am J Health Promot. 1996;10:282-298. [DOI] [PubMed] [Google Scholar]
- 38. Golden SD, Earp JAL. Social ecological approaches to individuals and their contexts: twenty years of health education & behavior health promotion interventions. Health Educ Behav. 2012;39:364-372. [DOI] [PubMed] [Google Scholar]
- 39. Montero M, Stokols D. Psychology and the internet: a social ecological analysis. Cyberpsychol Behav. 2003;6:59-72. [DOI] [PubMed] [Google Scholar]
- 40. Mylonopoulou V, Weilenmann A, Buratti S, Torgersson O, Rost M. A socioecological approach to ICT use by adults over 65 and its implication on design. In: Proceedings of the 25th International Academic Mindtrek Conference. Association for Computing Machinery; 2022:203-218.
- 41. Park N-Y, Jang S. App-based digital health equity determinants according to ecological models: scoping review. Sustainability. 2024;16:2232. [Google Scholar]
- 42. Thomas Craig KJ, Fusco N, Gunnarsdottir T, Chamberland L, Snowdon JL, Kassler WJ. Leveraging data and digital health technologies to assess and impact social determinants of health (SDoH): a state-of-the-art literature review. Online J Public Health Inform. 2021;13:E14. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43. Halpin S, Tarrant N, de la Cruz Y. Using clear terms to advance health equity—“social drivers” vs “social determinants”. 2022. Accessed November 18, 2024. https://prapare.org/using-clear-terms-to-advance-health-equity-social-drivers-vs-social-determinants/
- 44.Measuring Digital Development: Facts and Figures 2023: United Nations Internet Telecommunications Union. 2023. Accessed August 16, 2024. https://www.itu.int/itu-d/reports/statistics/facts-figures-2023/index/
- 45. United States Census Bureau. American Community Survey 1-year Estimates Subject Tables. 2022. Accessed June 18, 2024. https://data.census.gov/table/ACSST1Y2022.S2801?q=internet
- 46. Yang T, Ticona J, Lelkes Y. Policing the digital divide: institutional gate-keeping & criminalizing digital inclusion. J Commun. 2021;71:572-597. [Google Scholar]
- 47. Kim KK, Backonja U. Perspectives of community-based organizations on digital health equity interventions: a key informant interview study. J Am Med Inform Assoc. 2024;31:929-939. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48. Gangadharan SP. The downside of digital inclusion: expectations and experiences of privacy and surveillance among marginal Internet users. New Media & Society. 2017;19:597-615. [Google Scholar]
- 49. Bastick Z, Mallet-Garcia M. Double lockdown: the effects of digital exclusion on undocumented immigrants during the COVID-19 pandemic. New Media Soc. 2022;24:365-383. [Google Scholar]
- 50. Kim KK, Backonja U. Perspectives of community-based organizations on digital health equity interventions: a key informant interview study. J Am Med Inf Assoc. 2024;31:929-939. ocae020. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 51. Shaver J. The state of telehealth before and after the COVID-19 pandemic. Prim Care. 2022;49:517-530. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 52. Cunha AS, Pedro AR, Cordeiro JV. Facilitators of and barriers to accessing hospital medical specialty telemedicine consultations during the COVID-19 pandemic: systematic review. J Med Internet Res. 2023;25:e44188. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53. Lau KHV, Anand P, Ramirez A, Phicil S. Disparities in telehealth use during the COVID-19 pandemic. J Immigr Minor Health. 2022;24:1590-1593. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54. Tong L, George B, Crotty BH, et al. Telemedicine and health disparities: association between patient characteristics and telemedicine, in-person, telephone and message-based care during the COVID-19 pandemic. IPEM Transl. 2022;3:100010. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 55. Tricco AC, Lillie E, Zarin W, et al. PRISMA extension for scoping reviews (PRISMA-ScR): checklist and explanation. Ann Intern Med. 2018;169:467-473. [DOI] [PubMed] [Google Scholar]
- 56. Peters MDJ, Marnie C, Tricco AC, et al. Updated methodological guidance for the conduct of scoping reviews. JBI Evid Synth. 2020;18:2119-2126. [DOI] [PubMed] [Google Scholar]
- 57. Earp JA, Ennett ST. Conceptual models for health education research and practice. Health Educ Res. 1991;6:163-171. [DOI] [PubMed] [Google Scholar]
- 58. Miles MB, Huberman AM. Qualitative Data Analysis: An Expanded Sourcebook. SAGE Publications; 1994. [Google Scholar]
- 59. Fawcett J, DeSanto-Madeya S. Contemporary Nursing Knowledge: Analysis and Evaluation of Nursing Models and Theories. Fa Davis; 2012.
- 60. Lawrence K. Chapter 9: Digital health equity. In: Linwood SL, ed. Digital Health [Internet]. Exon Publications; 2022. Accessed May 6, 2024. https://www.ncbi.nlm.nih.gov/books/NBK580635/. 10.36255/exon-publications-digital-health-health-equity [DOI] [PubMed]
- 61. Jaworski BK, Webb Hooper M, Aklin WM, et al. Advancing digital health equity: directions for behavioral and social science research. Transl Behav Med. 2023;13:132-139. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 62. Hsieh HF, Shannon SE. Three approaches to qualitative content analysis. Qual Health Res. 2005;15:1277-1288. [DOI] [PubMed] [Google Scholar]
- 63. Pacifico Silva H, Lehoux P, Miller FA, Denis JL. Introducing responsible innovation in health: a policy-oriented framework. Health Res Policy Syst. 2018;16:90. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 64. Sun Z, Sun W, Gao H, Fa R, Chen S, Qian D. Digital inclusion, cultural capital, and health status of urban and rural residents: an empirical study based on 2017 CGSS database. Int J Environ Res Public Health. 2023;20:4022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 65. Curfman AL, Haycraft M, McSwain SD, Dooley M, Simpson KN. Implementation and evaluation of a wraparound virtual care program for children with medical complexity. Telemed J E Health. 2023;29:947-953. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 66. Foley K, Freeman T, Ward P, Lawler A, Osborne R, Fisher M. Exploring access to, use of and benefits from population-oriented digital health services in Australia. Health Promot Int. 2021;36:1105-1115. [DOI] [PubMed] [Google Scholar]
- 67. Kickbusch I. Health Promotion 4.0. Oxford University Press; 2019:179-181. [Google Scholar]
- 68. Ha S, Ho SH, Bae Y-H, et al. Digital health equity and tailored health care service for people with disability: user-centered design and usability study. J Med Internet Res. 2023;25:e50029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 69. Wood BR, Young JD, Abdel-Massih RC, et al. Advancing digital health equity: a policy paper of the infectious diseases society of America and the HIV medicine association. Clin Infect Dis. 2021;72:913-919. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 70. Kaihlanen A-M, Virtanen L, Buchert U, et al. Towards digital health equity—a qualitative study of the challenges experienced by vulnerable groups in using digital health services in the COVID-19 era. BMC Health Serv Res. 2022;22:188-113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 71. Whitehead DC, Jaffe T, Hayden E, Zachrison KS. Qualitative evaluation of quality measurement within emergency clinician-staffed telehealth programs. Ann Emerg Med. 2022;80:401-407. [DOI] [PubMed] [Google Scholar]
- 72. Lyles CR, Nguyen OK, Khoong EC, Aguilera A, Sarkar U. Multilevel determinants of digital health equity: a literature synthesis to advance the field. Annu Rev Public Health. 2023;44:383-405. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 73. Faber JS, Al-Dhahir I, Kraal JJ, et al. Guide development for eHealth interventions targeting people with a low socioeconomic position: participatory design approach. J Med Internet Res. 2023;25:e48461. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 74. Henson C, Chapman F, Shepherd G, Carlson B, Rambaldini B, Gwynne K. Amplifying older aboriginal and torres strait islander women’s perspectives to promote digital health equity: co-designed qualitative study. J Med Internet Res. 2023;25:e50584. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 75. Souza MAD, Kuribayashi HP, Saraiva PA, et al. A techno-economic framework for installing broadband networks in rural and remote areas. IEEE Access. 2021;9:58421-58447. [Google Scholar]
- 76. Gauvreau CL, Wight L, Subasri M, et al. Access to novel drugs and therapeutics for children and youth: eliciting citizens’ values to inform public funding decisions. Health Expect. 2023;26:715-727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 77. Kukhareva PV, Weir C, Del Fiol G, et al. Evaluation in life cycle of information technology (ELICIT) framework: supporting the innovation life cycle from business case assessment to summative evaluation. J Biomed Inform. 2022;127:104014. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 78. Nair US, Kue J, Athilingam P, Rodríguez CS, Menon U. Application of the ConNECT framework to achieve digital health equity. Nurs Outlook. 2023;71:101991. [DOI] [PubMed] [Google Scholar]
- 79. Steinman L, Chavez Santos E, Chadwick K, et al. Remote evidence-based health promotion programs during COVID: a national evaluation of reach and implementation for older adult health equity. Health Promot Pract. 2023:25:475-491. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 80. Zhang L, Liu K, editors. Semantic Modeling for Supporting Planning Decision Making Toward Smart Cities. American Society of Civil Engineers (ASCE; ); 2022. [Google Scholar]
- 81. Allicock M, Haynes-Maslow L, Johnson L-S, et al. Peer connect for African American breast cancer survivors and caregivers: a train-the-trainer approach for peer support. Transl Behav Med. 2017;7:495-505. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 82. Spierling Bagsic SR, Savin KL, Soriano EC, et al. Process evaluation of dulce digital-me: an adaptive mobile health (mHealth) intervention for underserved Hispanics with diabetes. Transl Behav Med. 2023;13:635-644. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 83. Belkin GS, Unützer J, Kessler RC, et al. Scaling up for the “bottom billion”: “5 x 5” implementation of community mental health care in low-income regions. Psychiatr Serv. 2011;62:1494-1502. [DOI] [PubMed] [Google Scholar]
- 84. Braganza MZ, Pearson E, Avila CJ, Zlowe D, Øvretveit J, Kilbourne AM. Aligning quality improvement efforts and policy goals in a national integrated health system. Health Serv Res. 2022;57:9-19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 85. Chanfreau-Coffinier C, Peredo J, Russell MM, et al. A logic model for precision medicine implementation informed by stakeholder views and implementation science. Genet Med. 2019;21:1139-1154. [DOI] [PubMed] [Google Scholar]
- 86. Cheng VWS, Piper SE, Ottavio A, Davenport TA, Hickie IB. Recommendations for designing health information technologies for mental health drawn from self-determination theory and co-design with culturally diverse populations: template analysis. J Med Internet Res. 2021;23:e23502. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 87. Eiraldi R, McCurdy BL, Khanna MS, et al. Development and evaluation of a remote training strategy for the implementation of mental health evidence-based practices in rural schools: pilot study protocol. Pilot Feasibility Stud. 2022;8:128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 88. Gallo CG, Berkel C, Mauricio A, et al. Implementation methodology from a social systems informatics and engineering perspective applied to a parenting training program. Fam Syst Health. 2021;39:7-18. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 89. Kim H, Choi H, Jung YI, Kim E, Lee W, Yi JY. Evaluation of a technology-enhanced, integrated community health and wellness program for seniors (HWePS): protocol of a non-randomized comparison trial. BMC Public Health. 2023;23:25. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 90. Kohn MJ, Chadwick KA, Steinman LE. Adapting evidence-based falls prevention programs for remote delivery—implementation insights through the re-aim evaluation framework to promote health equity. Prev Sci. 2024;25:163-173. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 91. Laur C, Agarwal P, Thai K, et al. Implementation and evaluation of COVIDCare@Home, a family medicine-led remote monitoring program for patients with COVID-19: multimethod cross-sectional study. JMIR Hum Factors. 2022;9:e35091. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 92. Nelson LA, Roddy MK, Bergner EM, et al. Exploring determinants and strategies for implementing self-management support text messaging interventions in safety net clinics. J Clin Transl Sci. 2022;6:e126. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 93. Nelson ALH, Zanti S. A framework for centering racial equity throughout the administrative data life cycle. Int J Popul Data Sci (IJPDS). 2020;5:1367. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 94. Rhodes EC, Damio G, LaPlant HW, et al. Promoting equity in breastfeeding through peer counseling: the US breastfeeding heritage and pride program. Int J Equity Health. 2021;20:128. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 95. Ross S, Volz V, Lancaster MK, Divan A. A generalizable framework for multi-scale auditing of digital learning provision in higher education. OLJ. 2018;22:249-270. [Google Scholar]
- 96. Stone VI, Lane JP. Modeling technology innovation: how science, engineering, and industry methods can combine to generate beneficial socioeconomic impacts. Implement Sci. 2012;7:1–19. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 97. Tebb KP, Leng Trieu S, Rico R, Renteria R, Rodriguez F, Puffer M. A mobile health contraception decision support intervention for latina adolescents: implementation evaluation for use in school-based health centers. JMIR Mhealth Uhealth. 2019;7:e11163. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 98. Wieland ML, Asiedu GB, Njeru JW, et al. Community-engaged bidirectional crisis and emergency risk communication with immigrant and refugee populations during the COVID-19 pandemic. Public Health Rep. 2022;137:352-361. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 99. Chen W, Li X. Digital inequalities in American disadvantaged urban communities: access, skills, and expectations for digital inclusion programs. Inform Commun Soc. 2022;25:1916-1933. [Google Scholar]
- 100. Gleason K, Suen JJ. Going beyond affordability for digital equity: closing the “digital divide” through outreach and training programs for older adults. J Am Geriatr Soc. 2022;70:75-77. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 101. National Telecommunications and Information Administration. Digital Equity Guide for the States: How to Prepare for Success in Your State. 2022. Accessed May 6, 2024. https://broadbandusa.ntia.doc.gov/sites/default/files/2022-12/Digital_Equity_Guide_for_States_11.28.22.pdf
- 102. Sieck CJ, Sheon A, Ancker JS, Castek J, Callahan B, Siefer A. Digital inclusion as a social determinant of health. NPJ Digit Med. 2021;4:52. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 103. National Digital Inclusion Alliance. Digital Inclusion Coalition Guidebook. 2022. Accessed May 6, 2024. https://www.digitalinclusion.org/blog/2022/02/24/ndia-publishes-new-digital-inclusion-coalition-guidebook/
- 104. Koehle H, Kronk C, Lee YJ. Digital health equity: addressing power, usability, and trust to strengthen health systems. Yearb Med Inform. 2022;31:20-32. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 105. National Telecommunications and Information Administration. Broadband Data and Analytics. U.S. Department of Commerce; 2022. https://broadbandusa.ntia.doc.gov/resources/data-and-mapping [Google Scholar]
- 106. National Telecommunications and Information Administration. Internet for All, Needs Assessment Guide. Accessed May 6, 2024. https://broadbandusa.ntia.doc.gov/sites/default/files/2023-01/IFA_Digital_Equity_Needs_Assessment_Guide.pdf
- 107. National League of Cities. Digital Equity Playbook: How City Leaders Can Bridge the Digital Divide. Accessed May 6, 2024. https://www.nlc.org/resource/digital-equity-playbook-how-city-leaders-can-bridge-the-digital-divide/
- 108. Orrange S, Patel A, Mack WJ, Cassetta J. Patient satisfaction and trust in telemedicine during the COVID-19 pandemic: retrospective observational study. JMIR Hum Factors. 2021;8:e28589. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 109. Budhwani S, Fujioka J, Thomas-Jacques T, et al. Challenges and strategies for promoting health equity in virtual care: findings and policy directions from a scoping review of reviews. J Am Med Inform Assoc. 2022;29:990-999. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 110. Vela MB, Erondu AI, Smith NA, Peek ME, Woodruff JN, Chin MH. Eliminating explicit and implicit biases in health care: evidence and research needs. Annu Rev Public Health. 2022;43:477-501. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 111. Ratwani RM, Sutton K, Galarraga JE. Addressing AI algorithmic bias in health care. JAMA. 2024;332:1051-1052. [DOI] [PubMed] [Google Scholar]
- 112. Celi LA, Cellini J, Charpignon M-L, for MIT Critical Data, et al. Sources of bias in artificial intelligence that perpetuate healthcare disparities—a global review. PLOS Digit Health. 2022;1:e0000022. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 113. Braveman P. Defining health equity. J Natl Med Assoc. 2022;114:593-600. [DOI] [PubMed] [Google Scholar]
- 114. Braveman P. Health disparities and health equity: concepts and measurement. Annu Rev Public Health. 2006;27:167-194. [DOI] [PubMed] [Google Scholar]
- 115.Digital Equity Act of 2021, 117th Congress, 2021-2022 Sess. (2021), Vol. 43. 2021. Accessed June 18, 2024. https://www.congress.gov/bill/117th-congress/senate-bill/2018/text#id7b300608c1ed418fb7e69b97d2526ac3
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
The original data generated in the course of the study is provided as Supplementary Material (File S1).


