Abstract
Background
Data suggest that there were disparities in H1N1 vaccine uptake, and these may inform COVID-19 vaccination efforts. We conducted a systematic review to evaluate disparities in H1N1 vaccine uptake, factors contributing to disparities, and interventions to reduce them.
Methods
We searched English-language articles in MEDLINE ALL, PsycINFO, Cochrane Database of Systematic Reviews, and Cochrane Central Register of Controlled Trials from database inception through May 8, 2020. Observational studies examining H1N1 vaccine uptake by race/ethnicity, socioeconomic status, rurality, and disability status in US settings were included. Two reviewers independently assessed study eligibility. Single-reviewer data abstraction was confirmed by a second reviewer. We conducted independent dual quality assessment, and collective strength of evidence assessment.
Results
We included 21 studies. African American/Black, Latino, and low-socioeconomic status participants had disproportionately lower H1N1 vaccination rates (low- to moderate-strength evidence). However, Latinos were more likely than Whites to intend to be vaccinated, and African American/Blacks and participants with lower-socioeconomic status were just as likely to intend to be vaccinated as their White and higher-socioeconomic status counterparts (low-strength evidence). Vaccine uptake for other groups has been insufficiently studied. Factors potentially contributing to disparities in vaccine uptake included barriers to vaccine access, inadequate information, and concerns about vaccine safety and efficacy. Studies were largely cross-sectional. Many of the studies are a decade old and were conducted in the context of a different pandemic. The categorization of racial and ethnic groups was not consistent across studies and not all groups were well-studied.
Discussion
Efforts to avoid disparities in COVID-19 vaccination uptake should prioritize vaccine accessibility and convenience in African American/Black, Latino, and low-SES communities; engage trusted stakeholders to share vaccine information; and address concerns about vaccine safety and efficacy.
Primary Funding Source
Department of Veterans Affairs, Veterans Health Administration, Health Services Research & Development.
Protocol Registration
PROSPERO CRD42020187078
Supplementary Information
The online version contains supplementary material available at 10.1007/s11606-021-06715-7.
KEY WORDS: COVID-19 vaccine, health disparities, H1N1 vaccine, systematic review
Background
The distribution of COVID-19 vaccines is a public health campaign of unprecedented scope. Current estimates suggest that 60–90% of the US population will need to be vaccinated to reach herd immunity, depending on vaccine efficacy and duration of protection.1 Troubling levels of vaccine hesitancy, combined with longstanding disparities in vaccination rates (e.g., seasonal influenza), pose important challenges to COVID-19 vaccine uptake, particularly among vulnerable populations. For example, recent surveys suggest that compared to most groups, African American (AA)/Black participants are more hesitant about the COVID-19 vaccine.2, 3
Compounding this problem is that disadvantaged populations also have higher rates of COVID-19 exposure and infection,4 bear a disproportionate burden of chronic illness that may make them more vulnerable to COVID-19,5 and often have limited access to healthcare.6 Strategic approaches are needed to understand and overcome barriers to vaccination among vulnerable populations.
The last time a new vaccine was developed for a global pandemic was during the 2009 influenza A virus subtype H1N1 “swine flu” epidemic. Vaccination patterns observed during the H1N1 pandemic may offer insight as the US ramps up its COVID-19 vaccination campaign.
The aim of this systematic review was to understand disparities in H1N1 vaccine uptake by race/ethnicity, socioeconomic status (SES), rural/urban residence, population density, and disability status, and factors associated with unequal uptake, as well as the benefits and harms of interventions designed to attenuate inequities in H1N1 vaccine uptake—in an effort to address potential disparities in COVID-19 vaccine access and uptake.
METHODS
This study was part of a larger review commissioned by the Veterans Health Administration (VHA) focused on health-related inequalities in epidemics and pandemics pre-dating COVID-19.7 It includes the subset of studies from the parent review that focused on H1N1 vaccination. The protocol, which follows PRISMA guidelines,8 was registered to PROSPERO (CRD42020187078) before study initiation.
Data Sources and Searches
We searched MEDLINE ALL, PsycINFO, Cochrane Database of Systematic Reviews, and Cochrane Central Register of Controlled Trials from inception through May 8, 2020, using terms related to epidemics, pandemics, disasters, and health disparities, and a supplementary search of Ovid Medline targeting H1N1 vaccination on August 24, 2020. We reviewed the bibliographies of relevant articles and contacted experts to identify additional studies. Search strategies were developed in consultation with a research librarian (Appendix Item 1).
Study Selection
Eligible studies examined H1N1 vaccine-related inequalities by race/ethnicity, socioeconomic status (SES), disability, or urban/rural residence in US populations. Studies were independently screened for inclusion by two reviewers. Disagreements were resolved through consensus or a third reviewer (Appendix Table 1).
Data Extraction and Quality Assessment
We abstracted details related to sample size, setting, population characteristics, eligibility criteria, vaccination rates, and factors potentially contributing to vaccination inequalities. Data were abstracted by one investigator and confirmed by a second. Two reviewers independently assessed study risk-of-bias with the Newcastle-Ottawa Scale (NOS) for observational studies,9 and the Critical Appraisal Skills Programme (CASP) Qualitative Checklist for qualitative studies.10 Disagreements were resolved by consensus or a third reviewer.
Data Synthesis and Analysis
We qualitatively synthesized the evidence and present it in tables. Our approach was guided by the Social Ecological Model (SEM)—as utilized to describe H1N1 vaccine uptake in the USA (Table 1).11
Table 1.
Category | Examples |
---|---|
Intrapersonal: attitudes and beliefs | Perceived risk from illness; perceived safety of H1N1 vaccine; trust in government’s handling of the pandemic; perceived presence in a priority group; history of seasonal flu vaccine acceptance; attitude toward H1N1 vaccine |
Interpersonal: social influence and social network norms | Influence from friends, family, social networks; number of friends and family who received the H1N1 vaccine; belief that friends and family want them to be vaccinated |
Institutional: healthcare organizations and providers | Regular healthcare provider; Amount of information from healthcare provider about H1N1 and vaccine |
Community: collective social dynamics | Presence of disease; perceived risk in the community; concern about infecting others |
Policy: federal, state, local | Health insurance; priority group status for vaccination |
Social Ecological Model as described by Kumar et al.11
We rated the strength of evidence (SOE) for H1N1 vaccine uptake by group using an established method that considers study limitations, directness, consistency, precision, and reporting bias to classify the SOE for each outcome independently as high, moderate, low, or insufficient,12 as well as separate guidance for applicability of the evidence.13
RESULTS
We reviewed 9098 titles and abstracts, and 163 full-text articles for the parent review, and identified 21 studies examining H1N1 vaccine uptake and its associated factors. We found no studies of interventions to mitigate H1N1 vaccine-related disparities (Fig. 1). Thirteen studies were nationally representative, cross-sectional surveys11, 14–25; one was a national survey of Veterans with spinal cord conditions (two publications)26, 27; four were regional or population-specific cross-sectional surveys28–31; two were regional mixed-methods studies32, 33; and one was a qualitative study performed in California.34 Table 2 contains study overviews; Appendix Table 2, detailed characteristics; Table 3, results; and Appendix Tables 3 and 4, ROB. Unless otherwise noted, comparators are White or higher SES populations.
Table 2.
Author, year | N | Study design | Location | Target population |
---|---|---|---|---|
Boyd, 201332 | 56 | Mixed methods (cross-sectional; qualitative) | Georgia state | Women enrolled in WIC (rural and urban) |
Burger, 201818 | 11,834 | Cross-sectional survey | National | Representative (White and Latino) |
Cassady, 201234 | 90 | Qualitative focus groups | California state | Latino farmworkers, pregnant women, and indigenous Mexicans with LEP |
Etingen 201226/LaVela27 | 3384 | Cross-sectional survey | National | Veterans with spinal cord-related disabilities |
Freimuth, 201422 | 1543 | Cross-sectional survey | National | Representative |
Frew, 201228 | 503 | Cross-sectional survey | Atlanta, GA | Racial and ethnic minorities |
Galarce, 201119 | 1569 | Cross-sectional survey | National | Representative |
Gargano, 201129 | 102 | Cross-sectional survey | 2 rural counties, GA | Secondary school staff |
Hernandez, 201930 | 225 | Cross-sectional survey | 2 large, midwestern cities | Pregnant women |
Kumar, 201211 | 2042 | Cross-sectional survey | National | Representative |
Lin, 201825 | 1569 | Cross-sectional survey | National | Representative |
Mesch, 201421 | 1000 | Cross-sectional survey | National | Representative |
Mesch, 201420 | 968 | Cross-sectional survey | National | Representative |
Plough, 201133 | 163,087 | Mixed methods (cross-sectional; qualitative) | LA County, CA | Free public vaccination sites (distributing 20% of LA County’s total vaccine supply) |
Quinn, 200923 | 1543 | Cross-sectional survey | National | Representative |
Quinn, 201124 | 1479 | Cross-sectional survey | National | Representative |
Ramanadhan, 201517 | 1166 | Cross-sectional survey | National | Representative of those who had not received the H1N1 vaccine |
Redelings, 201231 | 1541 | Cross-sectional survey | LA County, CA | Public health clinic patients |
Santibanez, 201314 | 55,850 | Cross-sectional survey | National | Representative |
SteelFisher, 201515 | 2355 | Cross-sectional survey | National | Representative |
Uscher-Pines, 201116 | Cross-sectional survey | National | Representative |
Abbreviations: CA, California; GA, Georgia; LA, Los Angeles; LEP, limited English proficiency; WIC, Women, Infants and Children Program
Table 3.
Author, year | N | Unadjusted vaccine results | Results adjusted for demographics, or demographics and SES | Study quality comments |
---|---|---|---|---|
H1N1 vaccination | ||||
By race/ethnicity—compared to White participants unless otherwise noted | ||||
AA/Black populations | ||||
Galarce, 201119 Nationally representative |
1569 | --- | OR=0.78 (95% CI: 0.49 to 1.24)† | --- |
Kumar, 201211 Nationally representative |
2079 | RR=0.93 (95% CI: 0.74 to 1.16)* | --- | --- |
LaVela, 201227 Veterans with spinal cord conditions |
3384 | No difference among pts with disability (data not provided) | --- | --- |
Plough, 201133 LA County free vaccination sites |
163,087 | RR=0.49 (95% CI: 0.48 to 0.50)* | --- | No control for confounders; inappropriate denominator; sample not representative |
Redelings, 201131 LA County Public Health clinics |
1541 | OR=0.7 (95% CI: 0.6 to 1.0) | --- | --- |
Santibanez, 201314 Nationally representative |
55,850 | RR=0.63 (95% CI: 0.59 to 0.67)* | --- | --- |
SteelFisher, 201515 Nationally representative |
2355 | RR=0.92 (95% CI: 0.73 to 1.55) | --- | --- |
Uscher-Pines, 201116 Nationally representative |
4040 | RR=0.67 (95% CI: 0.57 to 0.80)* | --- | --- |
Latino | ||||
Burger, 201718 Nationally representative (White and Latino) |
11,834 |
US-born: RR=0.86 (95% CI: 0.76 to 0.98)* Foreign-born: RR=0.74 (95% CI: 0.66 to 0.83)* |
US-born: OR=1.05 (95% CI: 0.87 to 1.27)‡ Foreign-born: SES accounts for the disparity with Whites • Before SES added to model: OR=0.77 (95% CI: 0.65 to 0.90)‡ • With SES in model: OR=1.04 (95% CI: 0.87 to 1.23) |
No reporting on non-respondents |
Galarce, 201119 Nationally representative |
1569 | --- | OR=1.59 (95% CI: 1.11 to 2.28)† | --- |
Kumar, 201211 Nationally representative |
2079 | No difference RR=1.12 (95% CI: 0.91 to 1.37)* | --- | --- |
LaVela, 201227 Veterans with spinal cord conditions |
3384 | No difference by race (data not provided) | --- | --- |
Plough, 201133 LA County free vaccination sites |
163,087 | RR=1.45 (95% CI: 1.43 to 1.47)* | --- | No control for confounders; inappropriate denominator; sample not representative |
Redelings 201131 LA County Public Health clinics |
1541 | Less likely to report being vaccinated. | --- | --- |
Santibanez, 201314 Nationally representative |
55,850 | RR=0.80 (95% CI: 0.75 to 0.86)* | --- | --- |
SteelFisher 201515 Nationally representative |
2355 | RR=0.92 (95% CI: 0.73 to 1.16) | --- | --- |
Uscher-Pines, 201116 Nationally representative |
4040 | RR=0.91 (95% CI: 0.75 to 1.10) | --- | --- |
Asian and/or Pacific Islander | ||||
Plough, 201133 LA County free vaccination sites |
163,087 |
Asians: RR=3.16 (95% CI: 3.12 to 3.21)* PI: RR=4.34 (95% CI: 4.09 to 4.60)* |
--- | No control for confounders; inappropriate denominator; sample not representative |
Redelings 201131 LA County Public Health clinics |
1541 | Asian/PI: No difference in reported vaccinations | --- | --- |
SteelFisher 201515 Nationally representative |
2355 |
Asians: RR=1.16 (95% CI: 0.94 to 1.45)* PI: RR=1.25 (95% CI: 1.02 to 1.55)* |
--- | --- |
AI/AN | ||||
Plough, 201133 LA County free vaccination sites |
163,087 | RR=1.87 (95% CI: 1.72 to 2.03)* | --- | No control for confounders; inappropriate denominator; sample not representative |
SteelFisher 201515 Nationally representative |
2355 | RR=1.25 (95% CI: 1.02 to 1.55)* | --- | --- |
By SES | ||||
Burger, 201818 Nationally representative (White and Latino) |
11,834 | --- | Higher SES more likely (some college+ vs HS or less)‡ | No reporting on non-respondents |
Galarce, 201119 Nationally representative |
1569 | --- | No difference by poverty level or education, except lower uptake for those with HS education than those without: OR=0.65 (0.42 to 0.99)† | --- |
Hernandez, 201930 Pregnant women in Midwest |
225 | Low SES less likely (<bachelor’s degree vs bachelor’s degree+) | --- | Low response rate, and unclear if non-responders were different |
Kumar, 201211 Nationally representative |
2079 | No difference by education or income | --- | --- |
LaVela 201227 Veterans with spinal cord conditions |
3384 | No difference by SES (data not provided) | --- | --- |
Santibanez, 201314 Nationally representative |
55,850 | Less low SES (<college and making <$75k) | --- | --- |
By rural/urban status | ||||
Boyd, 201332 Low-SES women in Georgia |
56 | Rural 3% vs urban 15% | --- | --- |
Galarce, 201119 Nationally representative |
1569 | --- | Urban OR=1.15 (95% CI: 0.80 to 1.64)† | --- |
Vaccine intentions | ||||
By race/ethnicity—compared to White participants unless otherwise noted | ||||
AA/Black populations | ||||
Gargano, 201129 School staff in rural Georgia |
102 | OR=0.77 (95% CI: 0.33 to 1.82) | --- | Low response rate, small sample |
Kumar, 201211 Nationally representative |
2079 | RR=1.34 (95% CI: 0.88 to 2.12)* | OR=2.18 (95% CI: NR)§ | --- |
Mesch, 201520 Nationally representative |
968 | 25.0% vs 37.0% | --- | Unclear if respondents similar to non-respondents |
Mesch, 201521 Nationally representative |
1000 | 60.4% vs 47.6% | --- | --- |
Latino | ||||
Kumar, 201211 Nationally representative |
2079 | RR=2.62 (95% CI: 1.80 to 3.82)* | OR=4.69 (95% CI: NR)§ | --- |
Mesch, 201520 Nationally representative |
968 | 37.3% vs 37.0% | --- | Unclear if respondents similar to non-respondents |
Mesch, 201521 Nationally representative |
1000 | 63.6% vs 47.6% | More likely (White b=−0.57, SE=0.22 Odds=0.56; P<0.01)|| | --- |
By SES | ||||
Kumar, 201211 Nationally representative |
2079 | No difference by education or income | --- | --- |
Lin, 201825 Nationally representative |
1569 | --- | No difference in seeking vaccine for self or loved one by income or education, except unemployed more likely than employed¶ | --- |
Mesch, 201520 Nationally representative |
968 | 43.3% <HS vs 37.8% some college+ | --- | Unclear if respondents similar to non-respondents |
Mesch, 201521 Nationally representative |
1000 | No difference by education | No difference by education or income|| | --- |
Willingness to receive H1N1 vaccine under EUA | ||||
By race/ethnicity—compared to White participants unless otherwise noted | ||||
AA/Black | ||||
Quinn, 200923 Nationally representative |
1543 |
Willing: 4.2% vs 7.2% Undecided: 35.8% vs 26.2% (p < 0.001) |
--- | --- |
Latino | ||||
Quinn, 200923 Nationally representative |
1543 |
Willing: 16.7% vs 7.2% (p < 0.001) Undecided: 35.9% vs 26.2% (p < 0.001) |
--- | --- |
By SES | ||||
Quinn, 200923 Nationally representative |
1543 |
No difference in willingness by education or income More were undecided (p < 0.001) |
--- | --- |
Abbreviations: AA, African American; AI/AN, American Indian/Alaska Native; APR, adjusted prevalence ratio; CI, confidence interval; HS, high school; NR, not reported; OR, odds ratio; RR, relative risk; SES, socioeconomic status
Bold text indicates statistical significance
*Calculated from study data by reviewers. RRs were calculated using MedCalc35
†Controlling for age, gender, urbanicity, and SES
‡Controlling for demographics and comorbid conditions
§Controlling for income, education, age, gender, and race
||Controlling for age, race, gender, marital status, # children, homeownership, income, education
¶Controlling for income, education, and employment
H1N1 Vaccine Uptake
We identified 11 studies (12 publications) reporting H1N1 vaccine receipt by group,11, 14–16, 18, 19, 26, 27, 30–33 and six studies reporting differences in vaccine intentions,11, 20, 21, 23, 25, 29 one of which examined willingness to receive the vaccine under a US Food and Drug Administration (FDA) emergency use authorization (EUA).23 Vaccination was self-reported in all but one study.33 Ten of 11 studies of vaccine receipt and five of six intention studies provided unadjusted data for at least one inter-group comparison. Studies reporting adjusted rates controlled for a wide range of factors. As such, SOE is based on unadjusted data (Table 4). We also report findings adjusted for sociodemographics where available. Differences by race/ethnicity were examined in 11 studies, by SES in nine, and by rural/urban residence in two. We identified no studies of uptake by disability status.
Table 4.
Population of interest | Comparator population | # of studies | Vaccine uptake likelihood | Strength of evidence | SOE justification | Notes |
---|---|---|---|---|---|---|
Vaccination | ||||||
AA/Black | White | 7 | Less likely | Moderate | --- | Most studies (including the large, good-quality studies), found significantly lower uptake; all general population studies found the same direction of effect |
Latino | 8 | Less likely | Low | Inconsistency | Studies with non-significant differences largely found lower vaccination rates; the 2 largest, good-quality studies found that Latinos were significantly less likely | |
Asian | 2 | Unclear | Insufficient | Inconsistency, imprecision, indirectness | --- | |
AI/AN | 2 | Unclear | Insufficient | Indirectness | --- | |
Pacific Islander | 1 | Unclear | Insufficient | Indirectness | --- | |
Asian/Pacific Islander | 1 | Unclear | Insufficient | Indirectness, imprecision | --- | |
Lower SES (education and/or income) | Higher SES | 4 | Less likely | Low | Inconsistency | --- |
Rural | Urban | 1 | Unclear | Insufficient | Single, small study with multiple limitations | --- |
With disabilities | Without disabilities | 0 | No evidence | --- | --- | --- |
Vaccine intentions | ||||||
AA/Black | White | 4 | No difference | Low | Imprecision | --- |
Latino | 3 | More likely | Low | Inconsistency | --- | |
Lower SES (education and/or income) | Higher SES | 3 | No difference | Low | Unclear precision | --- |
Rural | Urban | 0 | No evidence | --- | --- | --- |
With Disabilities | Without disabilities | 0 | No evidence | --- | --- | --- |
Willingness to take H1N1 vaccine under FDA EUA | ||||||
AA/Black | White | 1 | Unclear | Insufficient | Unclear consistency—one study | --- |
Latino | 1 | Unclear | Insufficient | Unclear consistency—one study | --- | |
Lower SES (education and/or income) | Higher SES | 1 | Unclear | Insufficient | Unclear consistency—one study | --- |
Abbreviations: AA, African American; AI, American Indian; AN, Alaska Native; EUA, Emergency Use Authorization; FDA, Food & Drug Administration; SES, socioeconomic status
Vaccination Rates
By Racial/Ethnic Group
Seven studies provide moderate-strength evidence of lower H1N1 vaccination rates in AA/Blacks.11, 14–16, 27, 31, 33 Two national (N=55,850; N=4040)14,16 and one regional study (N=1541)31 found that significantly fewer AA/Blacks reported receiving the H1N1 vaccine. In two other national studies (N=2079; N=2355),11, 15 lower vaccine uptake was reported by AA/Blacks but the differences were not significant. A study of Veterans with spinal cord conditions reported no differences by race/ethnicity.27 A final study, by Plough et al.33 compared the racial and ethnic breakdown of the population vaccinated at free vaccination sites in Los Angeles (LA) County to estimates of each group’s total county population. AA/Black residents were half as likely to receive the H1N1 vaccine despite targeted outreach. However, vaccinations at free sites accounted for only 20% of the vaccinations in LA County during the study period, leaving a high degree of uncertainty.
One additional study reported data adjusted for sociodemographic factors and found non-significantly lower vaccination rates among AA/Black respondents.19
Eight studies provide low-strength evidence of lower H1N1 vaccination rates among Latinos.11, 14–16, 18, 27, 31, 33 Two nationally representative studies (N=55,850; N=11,834) and one in LA county31 found lower vaccination rates for Latinos. Three nationally representative studies (N=2079; N=2355; N=4040)11, 15, 16 and one study of Veterans with spinal cord conditions (N=3384)27 found no difference in vaccine uptake by Latino ethnicity; however, the directions of effects were largely consistent with lower rates. Plough et al.’s free vaccination site study in LA County found that Latinos were more likely to be vaccinated.33
One study found that foreign-born Latinos reported lower vaccination rates than those born in the USA.18 It also reported adjusted data and found that controlling for demographics and comorbidities accounted for the disparity for US-born Latinos. Further adjustment for SES explained the disparity for foreign-born Latinos.18
Three studies found similar or higher vaccination rates in Asian, American Indian/Alaska Native (AI/AN), and/or Pacific Islander populations.15, 31, 33 These studies, however, did not provide sufficient evidence to draw conclusions due to inconsistency in results across the studies, imprecise effect estimates, and limited generalizability.
By Socioeconomic Status
Four studies provide low-strength evidence that low-SES populations were less likely to be vaccinated.11, 14, 27, 30 One large nationally representative study (N=55,850)14 and a small study of pregnant women in the Midwest (N=225)30 found that significantly fewer low-SES adults reported receiving the H1N1 vaccine. One study found no difference in vaccine receipt by education or income,11 and another found no difference by education.27
One study found that after controlling for age, gender, and race/ethnicity, those with a high school education reported lower vaccination rates than all other education levels.19
By Rurality
A small study (N=56) found that fewer rural than urban participants reported being vaccinated.32 The evidence was insufficient to draw conclusions.
A nationally representative study (N=1569) found that after controlling for age, gender, and SES, urban and rural residents reported similar rates of vaccination.19
Vaccine Intentions
By Racial/Ethnic Group
Three nationally representative studies (N=2079; N=968; N=1000)10, 19, 20 and one regional study (N=102)29 provide low-strength evidence that AA/Black participants were similar in reported intention to be vaccinated.
One study found that after adjusting for SES, age, and gender, AA/Black participants were more likely to intend to be vaccinated.11
The same three nationally representative studies provide low-strength evidence of Latinos’ greater intention to be vaccinated.11, 20, 21 One found a significantly greater likelihood of intention to be vaccinated.11 The second found that more Latinos reported the intention to be vaccinated; however, the difference was not significant,21 and the third found no difference.20
Two of the studies also reported adjusted results—one accounting for demographics11 and the second accounting for demographic factors plus SES21—and found that Latinos remained more likely to intend to be vaccinated.
By Socioeconomic Status
The same studies provide low-strength evidence of no difference in vaccination intentions by SES.11, 20, 21
Two studies controlled for demographic factors and found no difference in vaccine intentions by SES.21, 25
Willingness to Receive H1N1 Vaccine Under EUA
A nationally representative study (N=1543) examined willingness to accept a vaccine under FDA EUA.23 Respondents were able to select “yes,” “no,” or “undecided.” There was no difference in willingness among AA/Black respondents, though significantly more AA/Blacks were undecided. Latinos were more willing to accept the vaccine and also more likely to be undecided. Finally, there was no difference in willingness by SES, but a greater proportion of less educated participants were undecided.23
Factors Associated with Vaccine Uptake
Twenty-one studies examined factors associated with vaccination or vaccine intentions. Some of these studies examined whether disparities in H1N1 vaccine uptake were mediated by a given factor by analyzing whether the association between group status and vaccine uptake changed when that factor was incorporated in a statistical model. Other studies examined only whether group status was associated with the hypothesized mediator, without examining whether the mediator explained disparities in vaccine uptake. In qualitative studies, participants discussed factors potentially contributing to vaccine decisions. We have summarized key results by their corresponding construct of the SEM (detailed results in Appendix Table 5).
Intrapersonal
Perceptions of H1N1 Illness and Vaccine
Perceived susceptibility and illness severity. The largest national survey study found that more Latinos than Whites or AA/Blacks believed their chances of getting H1N1 were high if they were unvaccinated, as did those with the lowest education and income.14 Another national study found that those who were “very concerned” that someone in their family could get H1N1 were more likely to be vaccinated than those who were less concerned, and concern was higher for all minority groups.15 A small regional study found that among rural participants, fear of getting H1N1 was associated with increased vaccine intentions, but perceived severity of H1N1 was not.29 In two qualitative studies, perceptions of risk from H1N1 (severity and susceptibility) among vulnerable participants were generally low.32, 34
Perceived effectiveness and safety of the vaccine. In the largest national survey study, belief in vaccine effectiveness was associated with uptake, and AA/Black and low-SES participants were less likely to believe the vaccine was effective in preventing H1N1.14 Multiple studies noted concerns over the novelty of the vaccine and whether it had been adequately tested. The same large study found more vaccine safety concerns among Latino participants, followed by AA/Blacks; however, fear of getting sick from the vaccine did not influence vaccine uptake.14 Another national survey found that belief in H1N1 vaccine safety was highly predictive of vaccination, and low-SES and urban participants were less likely to believe the vaccine was safe.19 In another, safety beliefs were associated with vaccination, and AA/Black participants were less likely to believe the vaccine was safe.15 Two more studies, both in LA, found that AA/Black participants were more concerned about safety and side effects of the H1N1 vaccine than other racial/ethnic groups.31, 33 One national study found no racial/ethnic differences in perceptions of vaccine safety, but in all groups the proportion who believed it was safe was less than 45%.16 Fears about vaccine novelty and safety were also highlighted in qualitative studies.32, 34
Government and Provider Trust
A survey of racial and ethnic minority adults in Atlanta, GA, found that higher trust in the US government and greater disagreement with vaccine conspiracy beliefs were associated with intention to receive the H1N1 vaccine.28 In a national study, government trust was not associated with vaccine uptake for AA/Black or Latino participants, but a positive relationship existed for Whites.22 Another found higher trust in government for AA/Black and Latino participants.23 Qualitative studies noted vaccine hesitancy related to mistrust for some AA/Blacks and Latinos in the studied communities.33, 34
Trust in healthcare providers was not examined for its association with H1N1 vaccine uptake, but one study in LA found that AA/Blacks were less likely to report that they trusted providers when they recommend vaccines.31
Interpersonal
Influence from friends, family, and social networks was examined in three studies.28–30 A study of pregnant women in the Midwest found that while lower education predicted lower vaccination rates, the relationship was explained by a lower proportion of social network connections who were college-educated H1N1 vaccine supporters.30 One study examined normative approval (the belief that one’s friends, family, and healthcare providers would approve of their being vaccinated) among minorities, and found no association with H1N1 vaccine uptake.28 Among rural residents, after controlling for other factors, talking with friends about H1N1 was not a significant predictor of vaccination.29
Institutional
H1N1 Information or Recommendation from Provider
AA/Black and Latino participants in a national survey reported receiving provider recommendations to be vaccinated at similar rates, but it was not clear whether recommendations led to uptake.15 The same study found that after controlling for sociodemographics, healthcare access, and attitude-related variables, AA/Black, Latino, and AI/AN participants were more likely to have asked their healthcare provider about how to protect themselves from H1N1.15 Among Veterans with spinal cord conditions, those with adequate and accurate information about H1N1 were more likely to be vaccinated, and AA/Black, Latino, and less educated participants were more likely to report not receiving sufficient information.26 Finally, a qualitative study found that participants were motivated to be vaccinated by provider recommendations, but many hesitated to bring up vaccination themselves without provider prompting.32
Community
The study in Atlanta examined the relationship between community factors and intention to vaccinate. Among racial/ethnic minorities, perceived salience of H1N1 to one’s community was associated with greater vaccine uptake.28 In a small regional study, rural residents were less concerned that the virus was widely circulating in their communities.32
Policy
Health Insurance and Access
Four studies examined the association between health insurance coverage and H1N1 vaccine uptake.11, 15, 16, 18 Health insurance coverage was associated with greater vaccine uptake in two studies, and minority and low-SES groups in those studies were less likely to have insurance coverage.15, 18 In one of these studies, the health insurance status of foreign-born Latino respondents was a significant predictor of H1N1 vaccine receipt.18 Among all Latinos, those of lower SES were less likely to be vaccinated even after controlling for sociodemographics and insurance status.18 Another study found that AA/Black participants remained less likely to be vaccinated after controlling for sociodemographic factors and insurance status.16 However, a different national study did not find racial/ethnic differences in H1N1 vaccine uptake by insurance coverage, nor an association between insurance and vaccination.11
Priority Status
In a qualitative study, several pregnant women (an H1N1 vaccine priority group) were included, and many who were vaccinated had done so at the behest of their providers. However, those with concerns about vaccine safety refused.34
Vaccine Access
In one study, workplace vaccination was lower for Latinos,16 and in another, more AA/Black, Latino, and low-SES participants reported being unable to obtain a vaccine.19 Barriers identified in qualitative studies included work-related factors (e.g., inability to take time off due to inflexible scheduling, or potential loss of income or job), lack of vaccine availability, cost concerns, and inconvenient vaccination locations/settings.32, 34
Interventions to Reduce Disparities in H1N1 Vaccine Uptake
We found no studies of interventions addressing H1N1 vaccine-related disparities.
DISCUSSION
We identified 21 studies examining inequalities in H1N1 vaccine uptake during the 2009–2010 flu season in the USA. Studies were largely cross-sectional; the majority were well conducted and adequately reported. The qualitative studies clearly reported methodology and findings. We identified no studies of interventions targeting disparities in H1N1 vaccine uptake. Low- to moderate-strength evidence indicated that vaccine uptake was lower in AA/Black, Latino, and low-SES populations. Evidence was insufficient to draw conclusions about disparities in vaccine uptake for Asian, AI/AN, and Pacific Islander populations or by rural/urban residency status, and there was no evidence for those with disabilities. Findings about intention to be vaccinated differed from those examining vaccine receipt. We found low-strength evidence that AA/Black populations were similar and that Latinos were more likely to intend to be vaccinated. There was no difference in intention by SES. There was no evidence for populations by rural/urban residency status or those with disabilities. Intention to be vaccinated under EUA did not differ by race/ethnicity or SES, but a greater share of these populations were undecided, albeit the evidence was insufficient.
These findings of similar or greater intentions to be vaccinated among minorities and low-SES groups suggest that lower H1N1 vaccination rates were related more to vaccine access than hesitancy. Studies in our review found that AA/Black, Latino, and low-SES adults had lower rates of insurance coverage, and insurance coverage was associated with vaccine uptake. Insurance coverage may have provided financial access to vaccines, or it may even have facilitated uptake of free vaccines through increased healthcare connectedness.36 Other factors potentially affecting vaccine access included location and ability to take time off work. Indeed, exposure-related factors likely help account for marked racial/ethnic COVID-19-related health disparities.4 Those who have the least work flexibility, such as frontline workers, also face the greatest exposure to COVID-19, highlighting the imperative to overcome these hurdles to vaccination.
Studies of H1N1 perceptions indicated that AA/Black, Latino, and low-SES populations generally had more concerns about contracting H1N1 and also more concerns about vaccine efficacy and safety. While these concerns did not translate into differences in intention to be vaccinated, there was some evidence that minorities and low-SES groups felt less adequately informed and were more likely to be undecided about a vaccine approved under EUA. Given that the vaccines for COVID-19 are also currently under EUA, this study is especially salient today and suggests that, although recent data indicate that many at-risk populations are unsure about the COVID-19 vaccine,37 efforts to help ease uncertainty are worthwhile and have the potential to increase equity.
The H1N1 pandemic happened over a decade ago, and COVID-19 is a very different pandemic. SARS-CoV-2 is more infectious and more widespread than H1N1 and has been much more widely disruptive to our daily lives, potentially limiting the applicability of our review to the present. The COVID-19 vaccines were developed rapidly (under an operation called “Warp Speed”), and some use novel mechanisms (e.g., mRNA). There are, however, many similarities—including the fact that both H1N1 and COVID are global pandemics that have disproportionately affected minority communities—that we believe allow lessons to be drawn from the H1N1 experience. In Text box 1, we suggest several recommendations, based on our review, that may help mitigate disparities in COVID-19 vaccine uptake.
Text box 1 Recommendations to improve equity of COVID-19 vaccinations
• Vaccine should be offered at no cost. • Target vaccination outreach to communities with larger AA/Black, Latino, and low-SES populations, particularly those with fewer healthcare providers and other traditional vaccination locations. - Make use of unconventional venues, including mobile and drive-through vaccine clinics, community gathering places, churches, schools, stadiums, etc. - Provide vaccination in or near workplaces, particularly for frontline workers. • Engage trusted messengers within minority and low-SES communities40 to provide accurate and adequate vaccine-related information that addresses concerns about vaccine efficacy and safety. - Concerns about the newness of the vaccine and the rapidity of its development should be addressed. |
One salient factor that may have shifted since 2009–2010 is trust. Although trust in healthcare providers or government is an often-cited contributor to disparities in vaccine uptake,38 we did not find evidence that either played a strong role in H1N1 vaccine disparities. However, during the H1N1 pandemic, Barack Obama was president, and surveys indicated that minority groups had high levels of trust in President Obama and his administration.22 Since that time, misinformation about COVID-19 and vaccines on social media,39 racist and anti-immigrant federal policies, high-profile acts of police brutality in minority communities, and heightened awareness of structural racism and its contribution to disparities in COVID-19 infection and mortality, among myriad other factors, may have exacerbated minority and low-income communities’ already fragile trust in government and healthcare institutions.40
There are also limitations of the evidence base. Studies were largely cross-sectional. Racial and ethnic groups were not consistently categorized across studies, and few or no studies examined disparities among Asian, Pacific Islander, and AI/AN populations, or by rurality or disability status. The strength of evidence on H1N1 vaccine uptake was limited by imprecision, indirectness, and/or inconsistency, and vaccine uptake was measured by self-report in all but one study. No studies examined interventions or programs to mitigate vaccination disparities during the H1N1 pandemic. These are important areas for future disparities research.
Overall, our evidence review indicates that AA/Black, Latino, and low-SES adults were less likely to receive an H1N1 vaccine despite having similar or greater intent to receive it. Efforts to mitigate the identified causes of inequitable vaccine uptake from that pandemic will be essential to stem the disproportionate impact the COVID-19 pandemic has had on the same communities.
Supplementary Information
Acknowledgements
The authors would like to acknowledge Robin Paynter, MLIS, for conducting the searches for this review.
Funding
This research was funded by the Department of Veterans Affairs, Veterans Health Administration, Health Services Research and Development.
Declarations
Conflict of Interest
The authors declare that they do not have a conflict of interest.
Disclaimer
The findings and conclusions in this document are those of the author(s) who are responsible for its contents; the findings and conclusions do not necessarily represent the views of the Department of Veterans Affairs or the United States government. Therefore, no statement in this article should be construed as an official position of the Department of Veterans Affairs.
Footnotes
Prior Presentations
No prior presentations
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Anderson RM, Vegvari C, Truscott J, Collyer BS. Challenges in creating herd immunity to SARS-CoV-2 infection by mass vaccination. The Lancet. 2020;396(10263):1614–6. doi: 10.1016/S0140-6736(20)32318-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 2.Malik AA, McFadden SM, Elharake J, Omer SB. Determinants of COVID-19 vaccine acceptance in the US. EClinicalMedicine. 2020;26:100495. doi: 10.1016/j.eclinm.2020.100495. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kreps S, Prasad S, Brownstein JS, Hswen Y, Garibaldi BT, Zhang B, et al. Factors Associated With US Adults’ Likelihood of Accepting COVID-19 Vaccination. JAMA Network Open. 2020;3(10):e2025594–e. doi: 10.1001/jamanetworkopen.2020.25594. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Mackey K, Ayers CK, Kondo KK, Saha S, Advani SM, Young S, et al. Racial and Ethnic Disparities in COVID-19-Related Infections, Hospitalizations, and Deaths : A Systematic Review. Ann Intern Med. 2020. doi: 10.7326/m20-6306. [DOI] [PMC free article] [PubMed]
- 5.National Academies of Sciences, Engineering, and Medicine; Health and Medicine Division; Board on Population Health and Public Health Practice; Committee on Community-Based Solutions to Promote Health Equity in the United States; Baciu A, Negussie Y, Geller A, et al., editors. Communities in Action: Pathways to Health Equity. Washington (DC): National Academies Press (US); 2017 Jan 11. 2, The State of Health Disparities in the United States. Available from: https://www.ncbi.nlm.nih.gov/books/NBK425844/. [PubMed]
- 6.Agency for Healthcare Research and Quality. 2015 National Healthcare Quality and Disparities Report and 5th Anniversary Update on the National Quality Strategy: Access and Disparities in Access to Health Care Rockville, MD2015 [updated June 2018December, 21, 2020]. Available from: https://www.ahrq.gov/research/findings/nhqrdr/nhqdr15/access.html.
- 7.Kondo KK, Ayers CK, Williams BE, Kansagara D, Smith M, Mackey KM, Advani S, Saha S. Health Inequalities in Infectious Disease Epidemics Predating COVID-19 in the United States. Washington, DC: Evidence Synthesis Program, Health Services Research and Development Service, Office of Research and Development, Department of Veterans Affairs; 2020. [Google Scholar]
- 8.Moher D, Liberati A, Tetzlaff J, Altman DG. Preferred reporting items for systematic reviews and meta-analyses: the PRISMA statement. BMJ. 2009;339:b2535. doi: 10.1136/bmj.b2535. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Wells GA, Shea B, O’Connell D, Peterson J, Welch V, Losos M, et al. The Newcastle-Ottawa Scale (NOS) for assessing the quality of nonrandomised studies in meta-analyses. Available from: http://www.ohri.ca/programs/clinical_epidemiology/oxford.asp.
- 10.Critical Appraisal Skills Programme. CASP Qualitative Checklist 2018 [27 May 2020]. Available from: https://casp-uk.net/wp-content/uploads/2018/01/CASP-Qualitative-Checklist-2018.pdf.
- 11.Kumar S, Quinn SC, Kim KH, Musa D, Hilyard KM, Freimuth VS. The social ecological model as a framework for determinants of 2009 H1N1 influenza vaccine uptake in the United States. Health Education & Behavior. 2012;39(2):229–43. doi: 10.1177/1090198111415105. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Berkman ND, Lohr KN, Ansari MT, Balk EM, Kane R, McDonagh M, et al. Grading the strength of a body of evidence when assessing health care interventions: an EPC update. J Clin Epidemiol. 2015;68(11):1312–24. doi: 10.1016/j.jclinepi.2014.11.023. [DOI] [PubMed] [Google Scholar]
- 13.Atkins D, Chang SM, Gartlehner G, Buckley DI, Whitlock EP, Berliner E, et al. Assessing applicability when comparing medical interventions: AHRQ and the Effective Health Care Program. J Clin Epidemiol. 2011;64(11):1198–207. doi: 10.1016/j.jclinepi.2010.11.021. [DOI] [PubMed] [Google Scholar]
- 14.Santibanez TA, Singleton JA, Santibanez SS, Wortley P, Bell BP. Socio-demographic differences in opinions about 2009 pandemic influenza A (H1N1) and seasonal influenza vaccination and disease among adults during the 2009-2010 influenza season. Influenza & Other Respiratory Viruses. 2013;7(3):383–92. doi: 10.1111/j.1750-2659.2012.00374.x. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.SteelFisher GK, Blendon RJ, Kang M, Ward JR, Kahn EB, Maddox KE, et al. Adoption of preventive behaviors in response to the 2009 H1N1 influenza pandemic: a multiethnic perspective. Influenza & Other Respiratory Viruses. 2015;9(3):131–42. doi: 10.1111/irv.12306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Uscher-Pines L, Maurer J, Harris KM. Racial and ethnic disparities in uptake and location of vaccination for 2009-H1N1 and seasonal influenza. Am J Public Health. 2011;101(7):1252–5. doi: 10.2105/AJPH.2011.300133. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Ramanadhan S, Galarce E, Xuan Z, Alexander-Molloy J, Viswanath K. Addressing the Vaccine Hesitancy Continuum: An Audience Segmentation Analysis of American Adults Who Did Not Receive the 2009 H1N1 Vaccine. Vaccines. 2015;3(3):556–78. doi: 10.3390/vaccines3030556. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Burger AE, Reither EN, Hofmann ET, Mamelund SE. The Influence of Hispanic Ethnicity and Nativity Status on 2009 H1N1 Pandemic Vaccination Uptake in the United States. Journal of Immigrant & Minority Health. 2018;20(3):561–8. doi: 10.1007/s10903-017-0594-4. [DOI] [PubMed] [Google Scholar]
- 19.Galarce EM, Minsky S, Viswanath K. Socioeconomic status, demographics, beliefs and A(H1N1) vaccine uptake in the United States. Vaccine. 2011;29(32):5284–9. doi: 10.1016/j.vaccine.2011.05.014. [DOI] [PubMed] [Google Scholar]
- 20.Mesch GS, Schwirian KP. Social and political determinants of vaccine hesitancy: Lessons learned from the H1N1 pandemic of 2009-2010. American Journal of Infection Control. 2015;43(11):1161–5. doi: 10.1016/j.ajic.2015.06.031. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Mesch GS, Schwirian KP. Confidence in government and vaccination willingness in the USA. Health Promotion International. 2015;30(2):213–21. doi: 10.1093/heapro/dau094. [DOI] [PubMed] [Google Scholar]
- 22.Freimuth VS, Musa D, Hilyard K, Quinn SC, Kim K. Trust during the early stages of the 2009 H1N1 pandemic. Journal of health communication. 2014;19(3):321–39. doi: 10.1080/10810730.2013.811323. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Quinn SC, Kumar S, Freimuth VS, Kidwell K, Musa D. Public willingness to take a vaccine or drug under Emergency Use Authorization during the 2009 H1N1 pandemic. Biosecur Bioterror. 2009;7(3):275–90. doi: 10.1089/bsp.2009.0041. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Quinn SC, Kumar S, Freimuth VS, Musa D, Casteneda-Angarita N, Kidwell K. Racial disparities in exposure, susceptibility, and access to health care in the US H1N1 influenza pandemic. Am J Public Health. 2011;101(2):285–93. doi: 10.2105/AJPH.2009.188029. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Lin L, McCloud RF, Jung M, Viswanath K. Facing a Health Threat in a Complex Information Environment: A National Representative Survey Examining American Adults’ Behavioral Responses to the 2009/2010 A(H1N1) Pandemic. Health Educ Behav. 2018;45(1):77–89. doi: 10.1177/1090198117708011. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Etingen B, LaVela SL, Miskevics S, Goldstein B. Health information during the H1N1 influenza pandemic: Did the amount received influence infection prevention behaviors? Journal of Community Health: The Publication for Health Promotion and Disease Prevention. 2013;38(3):443–50. doi: 10.1007/s10900-012-9647-8. [DOI] [PubMed] [Google Scholar]
- 27.Lavela SL, Goldstein B, Etingen B, Miskevics S, Weaver FM. Factors Associated With H1N1 Influenza Vaccine Receipt in a High-Risk Population During the 2009-2010 H1N1 Influenza Pandemic. Topics in Spinal Cord Injury Rehabilitation. 2012;18(4):306–14. doi: 10.1310/sci1804-306. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Frew PM, Painter JE, Hixson B, Kulb C, Moore K, del Rio C, et al. Factors mediating seasonal and influenza A (H1N1) vaccine acceptance among ethnically diverse populations in the urban south. Vaccine. 2012;30(28):4200–8. doi: 10.1016/j.vaccine.2012.04.053. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 29.Gargano LM, Painter JE, Sales JM, Morfaw C, Jones LM, Weiss P, et al. Correlates of 2009 pandemic H1N1 influenza vaccine acceptance among middle and high school teachers in rural Georgia. Journal of School Health. 2011;81(6):297–303. doi: 10.1111/j.1746-1561.2011.00594.x. [DOI] [PubMed] [Google Scholar]
- 30.Hernandez EM, Pullen E, Brauer J. Social Networks and the Emergence of Health Inequalities Following a Medical Advance: Examining Prenatal H1N1 Vaccination Decisions. Social Networks. 2019;58:156–67. doi: 10.1016/j.socnet.2019.03.002. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Redelings MD, Piron J, Smith LV, Chan A, Heinzerling J, Sanchez KM, et al. Knowledge, attitudes, and beliefs about seasonal influenza and H1N1 vaccinations in a low-income, public health clinic population. Vaccine. 2012;30(2):454–8. doi: 10.1016/j.vaccine.2011.10.050. [DOI] [PubMed] [Google Scholar]
- 32.Boyd CA, Gazmararian JA, Thompson WW. Knowledge, attitudes, and behaviors of low-income women considered high priority for receiving the novel influenza A (H1N1) vaccine. Maternal & Child Health Journal. 2013;17(5):852–61. doi: 10.1007/s10995-012-1063-2. [DOI] [PubMed] [Google Scholar]
- 33.Plough A, Bristow B, Fielding J, Caldwell S, Khan S. Pandemics and health equity: lessons learned from the H1N1 response in Los Angeles County. Journal of Public Health Management & Practice. 2011;17(1):20–7. doi: 10.1097/PHH.0b013e3181ff2ad7. [DOI] [PubMed] [Google Scholar]
- 34.Cassady D, Castaneda X, Ruelas MR, Vostrejs MM, Andrews T, Osorio L. Pandemics and vaccines: perceptions, reactions, and lessons learned from hard-to-reach Latinos and the H1N1 campaign. Journal of Health Care for the Poor & Underserved. 2012;23(3):1106–22. doi: 10.1353/hpu.2012.0086. [DOI] [PubMed] [Google Scholar]
- 35.MedCalc. Free statistical calculators: Relative risk calculator [2 October 2020]. Available from: https://www.medcalc.org/calc/relative_risk.php.
- 36.Budhwani H, De P. Disparities in influenza vaccination across the United States: Variability by minority group, Asian sub-populations, socio-economic status, and health insurance coverage. Public Health. 2016;138:146–53. doi: 10.1016/j.puhe.2016.04.003. [DOI] [PubMed] [Google Scholar]
- 37.Hamel L, Kirzinger A, Lopes L, Kearney A, Sparks G, Brodie M. KFF COVID-19 Vaccine Monitor: January 2021: Kaiser Family Foundation,; 2021 [updated January 22February 2, 2021]. Available from: https://www.kff.org/report-section/kff-covid-19-vaccine-monitor-january-2021-vaccine-hesitancy/.
- 38.Laine C, Cotton D, Moyer DV. COVID-19 Vaccine: Promoting Vaccine Acceptance. Ann Intern Med. 2020. doi: 10.7326/m20-8008. [DOI] [PMC free article] [PubMed]
- 39.Abbasi J. COVID-19 Conspiracies and Beyond: How Physicians Can Deal With Patients’ Misinformation. JAMA. 2021;325(3):208–10. doi: 10.1001/jama.2020.22018. [DOI] [PubMed] [Google Scholar]
- 40.Alsan M, Stanford FC, Banerjee A, Breza E, Chandrasekhar AG, Eichmeyer S, et al. Comparison of Knowledge and Information-Seeking Behavior After General COVID-19 Public Health Messages and Messages Tailored for Black and Latinx Communities : A Randomized Controlled Trial. Ann Intern Med. 2020.. doi: 10.7326/m20-6141. [DOI] [PMC free article] [PubMed]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.