ABSTRACT
Objective: We sought to examine the effectiveness of persuasive communication interventions on influenza vaccination uptake among black/African American pregnant women in Atlanta, Georgia. Methods: We recruited black/African American pregnant women ages 18 to 50 y from Atlanta, GA to participate in a prospective, randomized controlled trial of influenza immunization messaging conducted from January to April 2013. Eligible participants were randomized to 3 study arms. We conducted follow-up questionnaires on influenza immunization at 30-days post-partum with all groups. Chi-square and t tests evaluated group differences, and outcome intention-to-treat assessment utilized log-binomial regression models. Results: Of the 106 enrolled, 95 women completed the study (90% retention), of which 31 were randomly assigned to affective messaging intervention (“Pregnant Pause” video), 30 to cognitive messaging intervention (“Vaccines for a Healthy Pregnancy” video), and 34 to a comparison condition (receipt of the Influenza Vaccine Information Statement). The three groups were balanced on baseline demographic characteristics and reported health behaviors. At baseline, most women (63%, n = 60) reported no receipt of seasonal influenza immunization during the previous 5 y. They expressed a low likelihood (2.1 ± 2.8 on 0-10 scale) of obtaining influenza immunization during their current pregnancy. At 30-days postpartum follow-up, influenza immunization was low among all participants (7-13%) demonstrating no effect after a single exposure to either affective messaging (RR = 1.10; 95% CI: 0.30-4.01) or cognitive messaging interventions (RR = 0.57; 95% CI: 0.11-2.88). Women cited various reasons for not obtaining maternal influenza immunizations. These included concern about vaccine harm (47%, n = 40), low perceived influenza infection risk (31%, n = 26), and a history of immunization nonreceipt (24%, n = 20). Conclusion: The findings reflect the limitations associated with a single exposure to varying maternal influenza immunization message approaches on vaccine behavior. For this population, repeated influenza immunization exposures may be warranted with alterations in message format, content, and relevance for coverage improvement.
KEYWORDS: Elaboration Likelihood Model, Health Messages, Maternal Immunization, Pregnancy, Persuasion Theory, Randomized Controlled Trial
Introduction
Influenza-related infections are a significant contributor to population morbidity and mortality on a global and national scale, particularly among immunocompromised populations including pregnant women.1-4 The American College of Obstetricians and Gynecologists (ACOG) and the Advisory Committee on Immunization Practices (ACIP) recommend that pregnant women (and women who expect to be pregnant during the influenza season) receive the trivalent inactivated influenza vaccination.1,2 Yet, vaccination rates among racially and ethnically diverse pregnant women are significantly lower than those of whites despite persistently higher rates of morbidity, mortality, and hospitalizations due to influenza.3-11
Even with a substantial body of scientific evidence documenting the safety of the influenza vaccine for pregnant women, and the corresponding risk of severe influenza-related complications including low infant birth weight and preterm birth outcomes, vaccination among pregnant women remains suboptimal to Healthy People 2020 goals.12 For example, prior to our undertaking this study, an Internet panel survey conducted by the Centers for Disease Control and Prevention (CDC) during the 2010-2011 influenza season with women who were pregnant during the 2010 influenza season (N = 1,457), found that only 32% of pregnant women received the influenza vaccine during pregnancy.13 The most cited reason for not receiving the influenza vaccine was concern about the safety of the vaccine.12-14
Overall female adult influenza vaccination rates have remained historically low, particularly within minority communities. During the 2011-2012 influenza season, only 40% of pregnant non-Hispanic black women received an influenza vaccine compared to 49% of pregnant Hispanic women and 48% of pregnant non-Hispanic white women.15 Low uptake of the influenza vaccine in these populations may be due to negative vaccine attitudes, poor experiences with healthcare providers, and general concerns about vaccine safety and effectiveness.16
Improvements in cost and access barriers (e.g. free prenatal care, free vaccines) have not eliminated racial and ethnic disparities in immunization rates among pregnant women. Evidence suggests that misperceptions of influenza illness and immunization significantly influence the decision to vaccinate during pregnancy. An array of factors, ranging from individual issues such as previous immunization behavior and attitudes toward vaccination, to patient-provider vaccine communication, and social network influences may impact maternal vaccination decisions.17-21
Immunization message framing
Various forms of persuasion theory have been applied to immunization decision-making and have therefore informed message framing strategies for pregnant women.22 One of these frameworks, the Elaboration Likelihood Model (ELM), posits that individuals tend to engage in 2 types of information processing depending on the extent of risk associated with a behavior.23 For example, many “low risk” decisions do not require extensive issue-relevant considerations (e.g., buying distilled water) and thus these types of decisions are motivated by heuristic or peripheral cues (i.e., a brand logo). Yet, many health decisions require careful consideration that invokes higher cognitive processing (or central-route) functioning.24,25
ELM suggests that influenza vaccination attitudes and beliefs are influenced by the interplay of variables as the recipient evaluates a message (i.e., “get immunized”) and the message source (i.e., government, clinic, and/or physician recommending vaccine).26,27 Application of the model would suggest that those who consider immunization would face a risk-taking decision, and therefore may engage in careful thinking about immunization information. This high degree of cognitive engagement (i.e., “high involvement” processing) would theoretically sustain counterpersuasion efforts (e.g., friends and family's negative reactions) and would result in temporal persistence and predicted behavioral outcomes (e.g., influenza immunization).28,29 Yet, strong affective evaluations of information may also occur with emotional responses invoked especially due to the incongruence such action poses to strongly held vaccine beliefs (i.e., cognitive dissonance) among racial and ethnic minorities.26
Given the challenges associated with improving maternal immunization coverage among this vulnerable population, this study sought to test 2 forms of targeted persuasive messaging models in comparison to generic influenza Vaccine Information Statements (VIS) developed by the CDC. Thus, the study fills an important gap in our understanding of how to effectively persuade pregnant women to accept influenza immunization.
Results
Baseline characteristics and vaccine attitudes of study participants
Of the 95 who completed follow-up assessment that we were able to include in this analysis, 31 were randomly assigned to Arm 2 affective messaging intervention (“Pregnant Pause” video), 30 to Arm 3 cognitive messaging intervention (“Vaccines for a Healthy Pregnancy” video), and 34 to the control group (VIS). The three groups were well balanced in terms of baseline demographic characteristics (Table 1). Overall, participants' mean age was around 26 years, many had achieved a high school education or less (60%, n = 57), and most had some form of health insurance (92%, n = 87).
Table 1.
Overall (n = 95) | Arm 1 Comparison Group (n = 34) | Arm 2 (Pregnant Pause movie) (n = 31) | Arm 3 (Vaccines for a Healthy Pregnancy) (n = 30) | p-value | |
---|---|---|---|---|---|
Mean age at baseline (years) | 26.1 ± 5.5 | 25.3 ± 6.0 | 25.8 ± 5.1 | 27.4 ± 5.1 | |
Education | |||||
Less than high school | 12 (13%) | 5 (15%) | 4 (13%) | 3 (10%) | 0.925 |
High school graduate or equivalent (GED) | 45 (47%) | 17 (50%) | 15 (48%) | 13 (43%) | |
Technical/vocational or associates | 29 (31%) | 9 (26%) | 10 (32%) | 10 (33%) | |
Bachelor degree | 8 (8%) | 3 (9%) | 2 (6%) | 3 (10%) | |
Graduate degree | 1 (1%) | 0 (0%) | 0 (0%) | 1 (3%) | |
Ethnicity | |||||
African American/Black | 94 (99%) | 34 (100%) | 31 (100%) | 29 (97%) | 0.335 |
Other, specify | 1 (1%) | 0 (0%) | 0 (0%) | 1 (3%) | |
Children (not including current pregnancy) | 1.2 ± 1.4 | 1.0 ± 1.3 | 1.5 ± 1.5 | 1.2 ± 1.4 | |
Currently has health insurance | |||||
Yes | 87 (92%) | 31 (91%) | 30 (97%) | 26 (87%) | 0.107 |
Practice | |||||
Urban 1 | 39 (41%) | 14 (41%) | 14 (45%) | 11 (37%) | 0.733 |
Urban 2 | 5 (5%) | 3 (9%) | 1 (3%) | 1 (3%) | |
Suburban 1 | 18 (19%) | 8 (24%) | 4 (13%) | 6 (20%) | |
Suburban 2 | 33 (35%) | 9 (26%) | 12 (39%) | 12 (40%) |
GED General Education Diploma
Response rates were calculated by (number enrolled and followed-up)/(number screened and eligible). Our results indicate that the response range was very close across all 4 sites (78% to 83%); thus, the potential for response bias resulting from variance in clinic population was likely minimal. Among 407 patients approached at Urban 1, 270 (66%) agreed to be screened for study eligibility, and 50 of these (19%) were eligible; 39 enrolled and completed follow-up. Of the 54 patients approached at Urban 2, 49 (91%) agreed to be screened for study eligibility, and 6 of these (12%) were eligible; 5 enrolled and completed follow-up. At Suburban clinic 1, 126 patients were approached, 82 (65%) agreed to be screened for study eligibility, and 23 of these (28%) were eligible; 18 completed follow-up. Among 154 patients approached at Suburban 2, 116 (75%) agreed to be screened for study eligibility, and 41 of these (35%) were eligible; 33 enrolled and completed follow-up.
Overall, the majority of participants (80%, n = 74) considered their OB/GYN physician to be their primary care doctor. Most women (63%, n = 60) reported no receipt of seasonal influenza vaccine in the past 5 y. Only one person received influenza vaccine routinely during the past 5 y with an additional 10% (n = 9) of participants reported getting an influenza vaccine at least 2 of the last 5 y. Of these participants who reported ever receiving an influenza vaccine, they were also asked to report where they last got their shot administered. Responses varied greatly with primary care doctor's office being the most commonly cited place for getting vaccinated for seasonal influenza (19%, n = 7), followed closely by hospital (16%, n = 6) and health clinic (14%, n = 5). Two women (5%) reported that they received influenza vaccination at their OB/GYN practice.
At baseline, there was no significant difference in health behaviors and knowledge by randomization group. On a scale of 0-10 (definitely no - definitely yes), the mean baseline likelihood of getting influenza vaccine during the current pregnancy was only 2.1 (Table 2). Women were moderately hesitant about getting vaccines recommended by a doctor during their pregnancy (4.5/10.0 scale). Women were much more likely to report intention to vaccinate their newborn with all recommended childhood vaccines than themselves (8.2/10.0 scale). Notably, a majority of women felt that they were knowledgeable about the infant and childhood immunizations (63%, n = 59).
Table 2.
Overall (n = 95) | Arm 1 Comparison Group (n = 34) | Arm 2 (Pregnant Pause movie) (n = 31) | Arm 3 (Vaccines for a Healthy Pregnancy) (n = 30) | p-valuea | |
---|---|---|---|---|---|
Considers OB/GYN to be primary care doctorb | |||||
Yes | 74 (80%) | 27 (79%) | 25 (83%) | 22 (76%) | 0.736 |
No | 19 (20%) | 7 (21%) | 5 (17%) | 7 (24%) | |
Number of times been treated for an illness or condition by a health care provider in past year | |||||
0 | 38 (40%) | 12 (35%) | 14 (45%) | 12 (40%) | 0.708 |
1-4 | 49 (52%) | 20 (59%) | 15 (48%) | 14 (47%) | |
5-9 | 2 (2%) | 0 (0%) | 1 (3%) | 1 (3%) | |
10 times or more | 4 (4%) | 1 (3%) | 1 (3%) | 2 (7%) | |
Don't know | 2 (2%) | 1 (3%) | 0 (0%) | 1 (3%) | |
How many seasonal influenza vaccines received in past 5 years | |||||
5 (every year) | 1 (1%) | 0 (0%) | 0 (0%) | 1 (3%) | 0.135 |
2-4 | 9 (9%) | 4 (12%) | 5 (16%) | 0 (0%) | |
1 | 14 (15%) | 6 (18%) | 6 (19%) | 2 (7%) | |
0 | 60 (63%) | 21 (62%) | 16 (52%) | 23 (77%) | |
Don't know | 11 (12%) | 3 (9%) | 4 (13%) | 4 (13%) | |
Respondents who have ever gotten an influenza vaccine: Where did you get your last flu shot? | |||||
Primary care doctor's office | 7 (19%) | 2 (17%) | 2 (12%) | 3 (38%) | 0.721 |
Ob/Gyn doctor's office | 2 (5%) | 0 (0%) | 2 (12%) | 0 (0%) | |
Community/public health clinic | 5 (14%) | 2 (17%) | 2 (12%) | 1 (13%) | |
Storefront clinic | 2 (5%) | 0 (0%) | 2 (12%) | 0 (0%) | |
Hospital | 6 (16%) | 3 (25%) | 2 (12%) | 1 (13%) | |
School health clinic | 3 (8%) | 1 (8%) | 2 (12%) | 0 (0%) | |
Worksite health clinic | 2 (5%) | 1 (8%) | 1 (6%) | 0 (0%) | |
Other | 1 (3%) | 1 (8%) | 0 (0%) | 0 (0%) | |
Don't know | 9 (24%) | 2 (17%) | 4 (24%) | 3 (38%) | |
Baseline likelihood of getting influenza vaccine during current pregnancy (range 0-10) | 2.1 ± 2.8 | 1.8 ± 2.8 | 2.6 ± 2.9 | 1.9 ± 2.9 | 0.877 |
Baseline hesitancy about getting recommended vaccines (range 0-10) | 4.5 ± 3.1 | 4.8 ± 3.2 | 4.7 ± 3.1 | 3.8 ± 3.1 | 0.215 |
I feel knowledgeable about the vaccines my new baby will begin getting after (s)he is born | |||||
Strongly agree | 27 (29%) | 9 (26%) | 8 (26%) | 10 (34%) | 0.653 |
Agree | 32 (34%) | 11 (32%) | 11 (35%) | 10 (34%) | |
Not sure | 23 (24%) | 8 (24%) | 8 (26%) | 7 (24%) | |
Disagree | 7 (7%) | 4 (12%) | 1 (3%) | 2 (7%) | |
Strongly disagree | 5 (5%) | 2 (6%) | 3 (10%) | 0 (0%) |
In relation to comparison group
Vaccine education intervention and influenza vaccine practices and attitudes
At 30 d postpartum, women reported very low acceptance of influenza vaccines during their pregnancy (≤13%) (Table 3). Neither intervention format (Arm 2 or Arm 3) resulted in significant influenza immunization increases during pregnancy as measured at 30-days postpartum. Thus, no effect was observed after a single exposure to either Arm 2 affective messaging (RR = 1.10; 95% CI: 0.30-4.01) or Arm 3 cognitive messaging interventions (RR = 0.57; 95% CI: 0.11-2.88). Additionally, the log-binomial regression models showed that there was no association in intention to receive the influenza vaccine during future pregnancies based on any arm exposure condition.
Table 3.
Arm 1 Comparison Group | Arm 2 (Pregnant Pause movie)a |
Arm 3 (Vaccines for a Healthy Pregnancy ibook)a |
|||||
---|---|---|---|---|---|---|---|
Outcome | No. (%) | No. (%) | Risk Ratio (95% CI) | P-value | No. (%) | Risk Ratio (95% CI) | P-value |
Influenza vaccine administered during pregnancy | 4 (12%) | 4 (13%) | 1.10 (0.30-4.01) | 0.889 | 2 (7%) | 0.57 (0.11-2.88) | 0.493 |
Mother's intention to be vaccinated with influenza vaccine in future pregnancies (scale 0-10) | |||||||
Low likelihood (0-3) | 13 (38%) | 12 (39%) | Ref | 8 (27%) | Ref | ||
Medium likelihood (4-6) | 9 (26%) | 7 (23%) | 0.90 (0.42-1.95) | 0.791 | 12 (40%) | 1.47 (0.79-2.72) | 0.224 |
High likelihood (7-10) | 12 (35%) | 12 (39%) | 1.04 (0.59-1.84) | 0.889 | 10 (33%) | 1.16 (0.65-2.07) | 0.622 |
Referent is comparison group.
Table 4 presents risk ratios of reasons for not getting vaccinated with the influenza vaccine during their pregnancy between study groups. Regardless of study group, women most commonly reported that the main reason for not receiving the influenza vaccine was due to vaccine safety concerns (47%, n = 40), followed by low perceived risk of influenza virus infection (31%, n = 26). No significant associations between vaccine education interventions and reasons for not getting the influenza vaccine during their pregnancy were observed.
Table 4.
Arm 1 Comparison Group | Arm 2 (Pregnant Pause movie)a |
Arm 3 (Vaccines for a Healthy Pregnancy ibook)a |
||||||
---|---|---|---|---|---|---|---|---|
Overall No. (%) | No. (%) | No. (%) | Risk Ratio (95% CI) | P-value | No. (%) | Risk Ratio (95% CI) | P-value | |
I was worried the vaccine would cause me or my baby harm | 40 (47%) | 12 (40%) | 12 (44%) | 1.11 (0.60–2.04) | 0.734 | 16 (57%) | 1.43 (0.83–2.46) | 0.198 |
I didn't think I was at risk for influenza | 26 (31%) | 11 (37%) | 5 (19%) | 0.51 (0.20–1.27) | 0.146 | 10 (36%) | 0.97 (0.49–1.93) | 0.940 |
I don't take vaccines | 20 (24%) | 6 (20%) | 5 (19%) | 0.93 (0.32–2.69) | 0.888 | 9 (32%) | 1.61 (0.66–3.94) | 0.299 |
The vaccine was not recommended to me by my doctor | 15 (18%) | 7 (23%) | 2 (7%) | 0.32 (0.07–1.40) | 0.129 | 6 (21%) | 0.92 (0.35–2.40) | 0.862 |
I don't think the vaccine works or works well | 13 (15%) | 3 (10%) | 4 (15%) | 1.48 (0.36–6.03) | 0.583 | 6 (21%) | 2.14 (0.59–7.76) | 0.246 |
I didn't think influenza was that dangerous for me | 7 (8%) | 3 (10%) | 1 (4%) | 0.37 (0.04–3.35) | 0.377 | 3 (11%) | 1.07 (0.24–4.88) | 0.929 |
I am afraid of needles | 6 (7%) | 3 (10%) | 3 (11%) | 1.11 (0.24–5.05) | 0.892 | 0 (0%) | NA | NA |
I was concerned that the vaccine would weaken my immune system | 5 (6%) | 2 (7%) | 3 (11%) | 1.67 (0.30–9.23) | 0.559 | 0 (0%) | NA | NA |
Referent is comparison group.
Discussion
Although maternal influenza immunization has the dual effect of protecting mothers and infants during the first 3 months of life,30 vaccine uptake has remained suboptimal among pregnant black/African American women.22 In recent years, CDC, ACOG, and ACIP have made directed considerable attention and resources toward the promotion of maternal influenza immunization to address vaccine-preventable morbidity and mortality.31-35 Despite these efforts, the results from this study underscore findings from a body of scientific literature that points toward considerable influenza vaccine refusal and hesitancy among pregnant women.36-40
As this study was informed by ELM, our overall messaging strategies were likely ineffective in a single-dose exposure as they did not invoke cognitive appraisal resulting in immunization as an outcome.41,42 Yet, it is important to recognize that ELM is a persuasive model which argues for a temporal orientation toward its effects; in other words, for behavioral change to take effect especially when negative or neutral attitudes have previously formed, repeated messaging is warranted over time.43,44 Thus, even “higher involvement” cognitive strategies utilized in this study such as interactive “Q&A” formatting of vaccine concerns (which theoretically should invoke active information processing), a null effect on behavior is highly likely in the short term especially in light of social-normative beliefs.22,45
Indeed, this study presents findings that suggest deeply held beliefs in the community about influenza vaccine pose considerable communication challenges not likely surmounted with any single type of vaccine promotion message exposure.22 The fact that ≤13% of the women in our cohort were vaccinated during pregnancy, and that ≤39% of our sample reported that they intended to be vaccinated with influenza vaccine in future pregnancies is reflective of an ingrained (anti)immunization continuum.46,47 These findings are mirrored in other studies that have examined challenges with vaccine uptake among racially and ethnically diverse minority communities.48,49 Our findings reinforce the notion that maternal immunization is not likely to shift without effective, repeated messaging that normalizes vaccination as a women's and infant health protection issue.50
With 80% of our sample expressing that they consider their OB/GYN to be their primary care physician, yet only 5% of them ever having received a vaccine from their OB/GYN, there is a unique opportunity presented to shift the targeted technologically driven messages delivered by our intervention toward more tailored practice-based messaging strategies in the future.51 This is especially relevant as merely 18% of our sample indicated “vaccine was not recommended to me by my doctor” which suggests that OB/GYN physicians in particular may also lack necessary communication skills to address vaccine reluctance as it has not been a component of their formal or continuing education training.52-54 Thus, with provision of CME/CEU training for OB/GYNs and midlevel nursing staff on vaccine concerns cited by this population (i.e., potential vaccine-related harm, low perceived influenza risk, and overall adult vaccine refusal), practices and providers may be better equipped to address an immunization service gap in women's healthcare, deliver more persuasive vaccine messages, and therefore normalize vaccination in the context of routine clinical care.55-57 In addition, successful promotion of maternal immunization is linked to availability of vaccine within the clinic.58 Thus, our findings highlight the need for maintenance of maternal immunization supply and onsite vaccination for patients to act upon the messages and recommendations they may be receiving prior to and within clinical encounters.
The findings from this study will inform the development of future integrated interventions. Specifically, this study points to the need for physician/provider training in vaccine communication and factors contributing to pregnant women's varying immunization decisions. By understanding the informational needs and concerns of pregnant women, in addition to their previous vaccination history, more effective messages may be developed and targeted to each group's unique needs. Such an approach to tailored messaging, combined with provider recommendation and ease of access, may ultimately lead to greater acceptance and uptake of immunization during pregnancy.
Limitations
We recognize the limitations associated with the self-report nature of the data, as our protocol did not allow for us to verify stated vaccine histories with medical records or vaccine registry data. Any recall bias, which may have been introduced, is assumed to have been non-differential with respect to characteristics likely to be associated with intention to receive antenatal influenza vaccine. We acknowledge an important limitation of including a practice that did not offer onsite vaccination to its patients. By including a practice that did not offer influenza vaccine, we may have missed an important opportunity to assess our intervention among certain minorities or women of lower socioeconomic status for whom immunization access may have served as a key barrier.59-61 Additionally, among those practices serving women who do not typically obtain influenza vaccine, providers may also be less inclined to stock vaccine as vaccine purchase prices may not fully offset actual provider reimbursement.59,62 In addition, the peak of the 2012-2013 influenza season in the US was in late December; thus, we may have missed opportunity to capture many women who were vaccine acceptors before this event occurred. The study timing was also suboptimal as data was collected after the peak influenza season, which was around late December for the 2012-2013 flu season.63
Methods
Study design and data collection
We conducted a prospective randomized controlled trial with baseline and follow-up measurement of message framing effects collected ≥ 30-days postpartum, allowing for up to 60 d thereafter to qualify as within the window for follow-up. We recruited women from January through April 2013, a period that corresponded with active seasonal influenza patterns observed on surveillance reports.64 We obtained permission from 4 antenatal practices located in urban and suburban Atlanta, Georgia to recruit participants in waiting room areas at designated times convenient for the office. This strategy was most conducive for recruitment as our consent process, time to view or work with the interventions, and completion of baseline measures occurred within 30-minute blocks per participant. We selected the clinics for this study as they served racially and socioeconomically diverse pregnant populations representative of the metro Atlanta area. As we had previous study experiences recruiting pregnant women at some practices, we had established relationships with some practices included in this study. In addition, we added those who agreed to allow us to recruit in their waiting areas.
We documented the general vaccine guidelines for each clinic to capture the fact that practices followed these recommendations. Thus, we did not think it was necessary to have personal communication with each provider to know if/when they were recommending the vaccines. We considered clinic recommendations when analyzing participants' responses to how likely they were to follow their provider's advice in the questionnaire at baseline and follow-up.
Even though some women were seen by the clinician following consent, they were able to complete the study procedures prior to leaving the office. In addition, only one woman signed the consent and received the vaccine during the visit, prior to completing the baseline procedures, and thus was withdrawn from the study to ensure results were not affected. Thus, our participant data collection strategy did not impose any disruption to the clinical flow.
Participants
We screened and enrolled black/African American women, between the ages of 18 and 50 years, who confirmed that they were pregnant at the time of enrollment with an expected delivery date no later than July 2013. Women were excluded from the study if they had already received the 2012-2013 seasonal influenza vaccine during their current pregnancy or were under the age of 18 y. All women who agreed to participate assented to be randomized to one of 3 conditions, and complete in-person baseline and 30-day postpartum telephone follow-up assessments.
Study procedures
Research staff recruited potential participants as they entered the antenatal clinics by following a recruitment script and completing a screening checklist. Written informed consent was obtained from all eligible women prior to baseline assessment and randomization. Following consent, participants were asked to complete a baseline, paper-based questionnaire comprised of 24 items to assess their vaccination attitudes, knowledge, normative influences, and beliefs. This assessment took approximately 15 minutes to complete.
Randomization to interventional formats
Following questionnaire completion, participants were then randomly assigned to one of the 2 vaccine education interventions or the comparison condition (2012-2013 influenza VIS). Those assigned to the VIS arm were given the material to read in the presence of a study team member. Following review of the material presented based on arm assignment, all participants were provided with a $35 gift card for completion of the baseline questionnaire and review of the material at this session.
Women assigned to the first intervention, a short film entitled “Pregnant Pause,” were instructed to watch the 9-minute film viewed on a study iPad. This story centered on a black/African American pregnant woman's dilemma to get an influenza vaccine at 2 of her routine obstetrical visits. With normative and persuasive influences featured in the storyline, the film depicted physician-actors giving the woman their recommendation to obtain the influenza immunization while acknowledging and discussing her concerns, including those of her mother whose anti-vaccination beliefs ran counter to the recommendation (i.e., cognitive dissonance). Thus, the film utilized affective ELM cueing techniques (e.g., reliance on physician credibility for vaccine decision-making and addressing normative beliefs).
The second intervention was also delivered on a study iPad entitled “Vaccines for a Healthy Pregnancy.” This format encouraged women to watch short videos of actual physicians providing detailed, question-and-answer information on influenza vaccines. This information-dense format contained short modules covering topics such as the importance of these vaccines for both the mother and child, the severity of the diseases, how the vaccines work to protect pregnant women and their newborns, vaccine safety information, and information on the current ACIP recommendations. Thus, this interactive educational tutorial enabled women to choose the topic(s) that they were most interested in and enabled them to complete each tutorial separately. Such a strategy is consistent with ELM “central route” processing that promotes issue-relevant thinking, evaluation of argument strength, and emphasizes the personal relevance of the topic.
Randomization was done at the patient level for each practice across all clinics on all days in the field. There was no concern regarding cross-contamination as the waiting rooms were typically very busy and large. We assigned headphones to each participant to listen to the material delivered via iPads, thus reducing potential for interaction among participants and/or others nearby. In addition, we assigned a team member to observe waiting room conditions to evaluate any potential for contamination of which none was recorded. We also had the participants complete the intervention in a quiet area of the waiting room whenever possible. There were also not enough eligible participants, relative to the number screened each day, for there to be a concern regarding discussions between participants randomized to each arm.
At 30-days postpartum, participants were contacted by study team staff by phone or email for a single vaccination outcome-oriented follow-up questionnaire. Participants were contacted per our study protocol up to 3 times before we determined that they were unreachable. Subsequently, questionnaires were conducted by telephone during which participants were asked to describe general health of the mother and newborn child(ren), influenza immunization status during pregnancy, future vaccination intentions, and attitudes and beliefs regarding vaccination. Participants were compensated with a mailed grocery store gift card ($50 value) after completion of their follow-up questionnaire.
Measurement and statistical analysis
The primary outcome for this study was uptake of influenza vaccine during pregnancy. Three of the 4 practices offered influenza vaccination as a clinical service. Secondary outcomes included mother's intention to be vaccinated with influenza vaccine in a future pregnancy. Participants who reported not getting vaccinated with influenza vaccine were also asked to report reasons for not receiving the vaccine during pregnancy.
Study population demographic data were compared among intervention groups and control using descriptive analysis. We assessed the success of randomization with respect to maternal age, education, gravidity, health insurance, health seeking behavior, pregnancy complications, and recommendation of influenza vaccine by Ob/Gyn. Chi-square tests and t-tests were used to test for differences in proportions and means between the intervention groups. Risk ratios (RRs) were calculated for the study outcomes with the use of log-binomial regression models (i.e., binomial generalized linear models using the log link function). All analyses were based on intention-to-treat.
Based on power calculations made before the study, we planned to enroll 162 women, or 54 women in each study arm, in order to have 80% power to detect a 20 percentage point increase in influenza vaccine coverage in each of the intervention arms compared to the control arm. However, 106 women were ultimately enrolled and completed baseline assessments. Of the 106 enrolled, we were able to complete 95 follow-up assessments at 30-days postpartum to evaluate vaccination outcomes reported herein. Thus, our retention rate was 90% for this cohort. All analyses were conducted using SAS version 9.4 (SAS Institute, Inc., Cary, NC).
Conclusion
The findings reflect the limitations associated with single exposure to maternal influenza immunization persuasive messaging approaches on vaccine behavior. Given the low historical acceptance of influenza vaccination among black/African Americans resulting in potential cognitive dissonance for this type of vaccine behavior, repeated influenza immunization exposures may be warranted with alterations in message format, content, and relevance for coverage improvement.
Disclosure of potential conflicts of interest
The authors report no conflict of interest.
Acknowledgments
We wish to thank all of our participants for their involvement in this study.
Funding
This study was supported by a grant from the Centers for Disease Control and Prevention (CDC), grant # 5P01TP000300, to the Emory Preparedness and Emergency Response Research Center, Emory University, Atlanta, GA.
References
- [1].Beigi RH, Wiringa AE, Bailey RR, Assi TM, Lee BY. Economic value of seasonal and pandemic influenza vaccination during pregnancy. Clin Infect Dis 2009; 49(12):1784-92; PMID:19911967; http://dx.doi.org/ 10.1086/649013 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [2].Moro PL, Tepper NK, Grohskopf LA, Vellozzi C, Broder K. Safety of seasonal influenza and influenza A (H1N1) 2009 monovalent vaccines in pregnancy. Expert Rev Vaccines 2012; 11(8):911-21; PMID:23002972; http://dx.doi.org/ 10.1586/erv.12.72 [DOI] [PubMed] [Google Scholar]
- [3].Centers for Disease Control and Prevention , Maternal and Infant Outcomes Among Severely Ill Pregnant and Postpartum Women with 2009 Pandemic Influenza A (H1N1) — United States, April 2009–August 2010. MMWR Morb Mortal Wkly Rep 2011; 60(35):1193-6; PMID:21900872 [PubMed] [Google Scholar]
- [4].Georgia Department of Health Annual Vaccine Preventable Diseases Surveillance Report - Georgia, 2010. 2010 October 4; Available from: http://health.state.ga.us/pdfs/epi/vpd/2010%20VPD%20Report.pdf.
- [5].Louie JK, Acosta M, Jamieson DJ, Honein MA; California Pandemic (H1N1) Working Group . Severe 2009 H1N1 influenza in pregnant and postpartum women in California. N Engl J Med 2010; 362(1):27-35; PMID:20032319; http://dx.doi.org/ 10.1056/NEJMoa0910444 [DOI] [PubMed] [Google Scholar]
- [6].Ahluwalia IB, Singleton JA, Jamieson DJ, Rasmussen SA, Harrison L. Seasonal Influenza Vaccine Coverage Among Pregnant Women: Pregnancy Risk Assessment Monitoring System. J Women's Health 2011; 20(5):649-51; PMID:21438700; http://dx.doi.org/ 10.1089/jwh.2011.2794 [DOI] [PubMed] [Google Scholar]
- [7].Fiscella K, Franks P, Doescher MP, Saver BG. Disparities in health care by race, ethnicity, and language among the insured: Findings from a national sample. Medical Care 2002; 40(1):52-9; PMID:11748426; http://dx.doi.org/ 10.1097/00005650-200201000-00007 [DOI] [PubMed] [Google Scholar]
- [8].Neuzil KM, Reed GW, Mitchel EF, Simonsen L, Griffin MR. Impact of influenza on acute cardiopulmonary hospitalizations in pregnant women. Am J Epidemiol 1998; 148(11):1094-102; PMID:9850132; http://dx.doi.org/ 10.1093/oxfordjournals.aje.a009587 [DOI] [PubMed] [Google Scholar]
- [9].Read JS, Riley L. Progress in overcoming barriers to influenza immunization of pregnant women. Am J Obstet Gynecol 2012; 207(3 Suppl):S1-2; PMID:22920052; http://dx.doi.org/ 10.1016/j.ajog.2012.06.067 [DOI] [PubMed] [Google Scholar]
- [10].Flowers L. Racial and ethnic disparities in influenza and pneumococcal immunization rates among Medicare beneficiaries. Issue Brief (Public Policy Inst (Am Assoc Retired Pers)), 2007(IB83):1-6; PMID:AMBIGUOUS [PubMed] [Google Scholar]
- [11].Logan JL. Disparities in influenza immunization among US adults. J Natl Med Assoc 2009; 101(2):161-6; PMID:19378634; http://dx.doi.org/ 10.1016/S0027-9684(15)30830-0 [DOI] [PubMed] [Google Scholar]
- [12].Ahluwalia IB, Singleton JA, Jamieson DJ, Rasmussen SA, Harrison L. Seasonal influenza vaccine coverage among pregnant women: pregnancy risk assessment monitoring system. J Womens Health (Larchmt) 2011; 20(5):649-51; PMID:21438700; http://dx.doi.org/ 10.1089/jwh.2011.2794 [DOI] [PubMed] [Google Scholar]
- [13].Control, C.f.D. and Prevention . Influenza vaccination coverage among pregnant women—United States, 2010-11 influenza season. MMWR. Morb Mortal Wkly Rep 2011; 60(32):1078; PMID:21849964 [PubMed] [Google Scholar]
- [14].Ahluwalia IB, Jamieson DJ, Rasmussen SA, D'Angelo D, Goodman D, Kim H. Correlates of seasonal influenza vaccine coverage among pregnant women in Georgia and Rhode Island. Obstet Gynecol 2010; 116(4):949-55; PMID:20859160; http://dx.doi.org/ 10.1097/AOG.0b013e3181f1039f [DOI] [PubMed] [Google Scholar]
- [15].Centers for Disease Control and Prevention (CDC) . . Influenza vaccination coverage among pregnant women - 2011-12 influenza season, United States. MMWR Morb Mortal Wkly Rep 2012; 61:758-63; PMID:23013721 [PubMed] [Google Scholar]
- [16].Frew PM, Painter JE, Hixson B, Kulb C, Moore K, del Rio C, Esteves-Jaramillo A, Omer SB.., Factors mediating seasonal and influenza A (H1N1) vaccine acceptance among ethnically diverse populations in the urban south. Vaccine 2012; 30(28):4200-8; PMID:22537991; http://dx.doi.org/ 10.1016/j.vaccine.2012.04.053 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [17].Frew PM, Hixson B, del Rio C, Esteves-Jaramillo A, Omer SB.., Acceptance of pandemic 2009 influenza A (H1N1) vaccine in a minority population: determinants and potential points of intervention. Pediatrics 2011; 127(Suppl 1):S113-9; PMID:21502254; http://dx.doi.org/ 10.1542/peds.2010-1722Q [DOI] [PubMed] [Google Scholar]
- [18].Langlie JK. Social networks, health beliefs, and preventive health behavior. J Health Soc Behav 1977; 18(3):244-60; PMID:903596; http://dx.doi.org/ 10.2307/2136352 [DOI] [PubMed] [Google Scholar]
- [19].Shui I, Kennedy A, Wooten K, Schwartz B, Gust D. Factors influencing African-American mothers' concerns about immunization safety: a summary of focus group findings. J Natl Med Assoc 2005; 97(5):657-66; PMID:15926642 [PMC free article] [PubMed] [Google Scholar]
- [20].Ferguson E, Gallagher L. Message framing with respect to decisions about vaccination: the roles of frame valence, frame method and perceived risk. Br J Psychol 2007; 98(Pt 4):667-80; PMID:17535469; http://dx.doi.org/ 10.1348/000712607X190692 [DOI] [PubMed] [Google Scholar]
- [21].Bartels RD, Kelly KM, Rothman AJ. Moving beyond the function of the health behaviour: the effect of message frame on behavioural decision-making. Psychol Health 2010; 25(7):821-38; PMID:20204967; http://dx.doi.org/ 10.1080/08870440902893708 [DOI] [PubMed] [Google Scholar]
- [22].Frew PM, Owens LE, Saint-Victor DS, Benedict S, Zhang S, Omer SB.. Factors associated with maternal influenza immunization decision-making. Evidence of immunization history and message framing effects. Hum Vaccin Immunother 2014; 10(9):2576-83; PMID:25483468; http://dx.doi.org/ 10.4161/hv.32248 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [23].O'Keefe DJ. Persuasion: Theory and Research. 2002, Thousand Oaks, CA: Sage; 363. [Google Scholar]
- [24].Flynn BS, Worden JK, Bunn JY, Connolly SW, Dorwaldt AL. Evaluation of smoking prevention television messages based on the elaboration likelihood model. Health Educ Res 2011; 26(6):976-87; PMID:21885672; http://dx.doi.org/ 10.1093/her/cyr082 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [25].Withers GF, Wertheim EH. Applying the elaboration likelihood model of persuasion to a videotape-based eating disorders primary prevention program for adolescent girls. Eat Disord 2004; 12(2):103-24; PMID:16864311; http://dx.doi.org/ 10.1080/10640260490444628 [DOI] [PubMed] [Google Scholar]
- [26].Curbow B, Fogarty LA, McDonnell KA, Chill J, Scott LB. The role of physician characteristics in clinical trial acceptance: testing pathways of influence. J Health Commun 2006; 11(2):199-218; PMID:16537288; http://dx.doi.org/ 10.1080/10810730500526703 [DOI] [PubMed] [Google Scholar]
- [27].Petty R, Cacioppo JT Communication and Persuasion: Central and Peripheral Routes to Attitude Change. 1986, New York, NY: Springer-Verlag. [Google Scholar]
- [28].Campbell RG, Babrow AS. The role of empathy in responses to persuasive risk communication: overcoming resistance to HIV prevention messages. Health Commun 2004; 16(2):159-82; PMID:15090283; http://dx.doi.org/ 10.1207/S15327027HC1602_2 [DOI] [PubMed] [Google Scholar]
- [29].Igartua JJ, Cheng L, Lopes O. To think or not to think: two pathways towards persuasion by short films on AIDS prevention. J Health Commun 2003; 8(6):513-28; PMID:14690887; http://dx.doi.org/ 10.1080/716100420 [DOI] [PubMed] [Google Scholar]
- [30].Steinhoff MC, Omer SB. A review of fetal and infant protection associated with antenatal influenza immunization. Am J Obstet Gynecol 2012; 207(3, Supplement):S21-7; PMID:22920054; http://dx.doi.org/ 10.1016/j.ajog.2012.06.071 [DOI] [PubMed] [Google Scholar]
- [31].ACOG Physician Script Concerning Tdap Vaccination. 2012. [Google Scholar]
- [32].ACOG Physician Script on Influenza Immunization During Pregnancy. 2012. [Google Scholar]
- [33].US Dept. of Health and Human Services Who's at Risk: Pregnant Women. 2013. [cited 2013 October 8]; Available from: http://www.flu.gov/at-risk/pregnant/index.html# [Google Scholar]
- [34].Centers for Disease Control and Prevention, National Center for Immunization and Respiratory Diseases Pregnancy and Whooping Cough. 2013. [cited 2013 October 8]; Available from: http://www.cdc.gov/vaccines/adults/rec-vac/pregnant/whooping-cough/get-vaccinated.html [Google Scholar]
- [35].Duff P. Influenza Vaccine: A Safe Bet for Mother and Baby. Obstet Gynecol 2013; 121(3):503-4; PMID:23635609; http://dx.doi.org/ 10.1097/AOG.0b013e318285cf61 [DOI] [PubMed] [Google Scholar]
- [36].Goldfarb I, Panda B, Wylie B, Riley L. Uptake of influenza vaccine in pregnant women during the 2009 H1N1 influenza pandemic. Am J Obstet Gynecol 2011; 204(6, Supplement):S112-5; PMID:21345408; http://dx.doi.org/ 10.1016/j.ajog.2011.01.007 [DOI] [PubMed] [Google Scholar]
- [37].Fisher BM, Scott J, Hart J, Winn VD, Gibbs RS, Lynch AM. Behaviors and perceptions regarding seasonal and H1N1 influenza vaccination during pregnancy. Am J Obstet Gynecol 2011; 204(6, Supplement):S107-11; PMID:21419386; http://dx.doi.org/ 10.1016/j.ajog.2011.02.041 [DOI] [PubMed] [Google Scholar]
- [38].Lu AB, Halim AA, Dendle C, Kotsanas D, Giles ML, Wallace EM, Buttery JP, Stuart RL. Influenza vaccination uptake amongst pregnant women and maternal care providers is suboptimal. Vaccine 2012; 30(27):4055-9; PMID:22521842; http://dx.doi.org/ 10.1016/j.vaccine.2012.04.012 [DOI] [PubMed] [Google Scholar]
- [39].Shavell VI, Moniz MH, Gonik B, Beigi RH.., Influenza immunization in pregnancy: overcoming patient and health care provider barriers. Am J Obstet Gynecol 2012; 207(3, Supplement):S67-74; PMID:22920063; http://dx.doi.org/ 10.1016/j.ajog.2012.06.077 [DOI] [PubMed] [Google Scholar]
- [40].Yudin M, Salaripour M, Sgro M. Pregnant women's knowledge of influenza and the use and safety of the influenza vaccine during pregnancy. J Obstet Gynaecol Can 2009; 31(2):120-5; PMID:19327210; http://dx.doi.org/ 10.1016/S1701-2163(16)34095-6 [DOI] [PubMed] [Google Scholar]
- [41].Witte K, Allen M. When do scare tactics work? A meta-analysis of fear appeals. Health Educ Behav 2000; 27:608-32; http://dx.doi.org/ 10.1177/109019810002700506 [DOI] [PubMed] [Google Scholar]
- [42].Witte K. Putting the fear back into fear appeals: The extended parallel process model (EPPM). Commun Monogr 1994; 61:113-34; http://dx.doi.org/ 10.1080/03637759409376328 [DOI] [Google Scholar]
- [43].Petty RE, et al., To think or not to think: Exploring two routes to persuasion, in Pursuasion: Psychological insights and perspectives, Shavitt S, Brock TC, Editors. 1994, Allyn and Bacon: Boston: p. 113-147. [Google Scholar]
- [44].Petty RE, Cacioppo JT. Central and peripheral routes to persuasion: Application to advertising, in Advertising and Consumer Psychology, Woodside LPAA, Editor. 1983, Lexington Books: Lexington, MA: p. 3-23. [Google Scholar]
- [45].Frew PM, Saint-Victor DS, Owens LE, Omer SB. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine 2014; 32(15):1736-44; PMID:24486366; http://dx.doi.org/ 10.1016/j.vaccine.2014.01.030 [DOI] [PubMed] [Google Scholar]
- [46].Masnick M, Leekha S. Frequency and predictors of seasonal influenza vaccination and reasons for refusal among patients at a large tertiary referral hospital. Infect Control Hosp Epidemiol 2015; 36(7):841-3; PMID:25773676; http://dx.doi.org/ 10.1017/ice.2015.56 [DOI] [PubMed] [Google Scholar]
- [47].Ojha RP, Stallings-Smith S, Flynn PM, Adderson EE, Offutt-Powell TN, Gaur AH.., The impact of vaccine concerns on racial/ethnic Disparities in influenza vaccine uptake among health care workers. Am J Public Health, 2015. 105(9): p. e35-41; PMID:26180953; http://dx.doi.org/ 10.2105/AJPH.2015.302736 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [48].Linn ST, Guralnik JM, Patel KV. Disparities in influenza vaccine coverage in the United States, 2008. J Am Geriatr Soc 2010; 58(7):1333-40; PMID:20533970; http://dx.doi.org/ 10.1111/j.1532-5415.2010.02904.x [DOI] [PMC free article] [PubMed] [Google Scholar]
- [49].Sabnis SS, Pomeranz AJ, Amateau MM. The effect of education, feedback, and provider prompts on the rate of missed vaccine opportunities in a community health center. Clin Pediatr (Phila) 2003; 42(2):147-51; PMID:12659388; http://dx.doi.org/ 10.1177/000992280304200208 [DOI] [PubMed] [Google Scholar]
- [50].Stockwell MS, Hofstetter AM, DuRivage N, Barrett A, Fernandez N, Vargas CY, Camargo S. Text message reminders for second dose of influenza vaccine: a randomized controlled trial. Pediatrics 2015; 135(1):e83-91; PMID:25548329; http://dx.doi.org/ 10.1542/peds.2014-2475 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [51].Chamberlain AT, Seib K, Ault KA, Rosenberg ES, Frew PM, Cortés M, Whitney EA, Berkelman RL, Orenstein WA, Omer SB.., Improving influenza and Tdap vaccination during pregnancy: A cluster-randomized trial of a multi-component antenatal vaccine promotion package in late influenza season. Vaccine 2015; 33(30):3571-9; PMID:26044495; http://dx.doi.org/ 10.1016/j.vaccine.2015.05.048 [DOI] [PubMed] [Google Scholar]
- [52].Kissin DM, Power ML, Kahn EB, Williams JL, Jamieson DJ, MacFarlane K, Schulkin J, Zhang Y, Callaghan WM. Attitudes and practices of obstetrician-gynecologists regarding influenza vaccination in pregnancy. Obstet Gynecol 2011; 118(5):1074-80; PMID:22015875; http://dx.doi.org/ 10.1097/AOG.0b013e3182329681 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [53].Murtough KL, Power ML, Schulkin J. Knowledge, attitudes, and practices of obstetrician-gynecologists regarding influenza prevention and treatment following the 2009 H1N1 pandemic. J Womens Health (Larchmt) 2015; 24(10):849-54; PMID:26154997; http://dx.doi.org/ 10.1089/jwh.2014.5178 [DOI] [PMC free article] [PubMed] [Google Scholar]
- [54].Power ML, Leddy MA, Anderson BL, Gall SA, Gonik B, Schulkin J. Obstetrician-gynecologists' practices and perceived knowledge regarding immunization. Am J Prev Med 2009; 37(3):231-4; PMID:19596538; http://dx.doi.org/ 10.1016/j.amepre.2009.05.019 [DOI] [PubMed] [Google Scholar]
- [55].Lewis B, Halm EA, Marcus SM, Korenstein D, Federman AD. Preventive services use among women seen by gynecologists, general medical physicians, or both. Obstet Gynecol 2008; 111(4):945-52; PMID:18378755; http://dx.doi.org/ 10.1097/AOG.0b013e318169ce3e [DOI] [PubMed] [Google Scholar]
- [56].Scholle SH, Chang JC, Harman J, McNeil M. Trends in women's health services by type of physician seen: data from the 1985 and 1997–98 NAMCS. Women's Health Issues 2002; 12(4):165-77; PMID:12093581; http://dx.doi.org/ 10.1016/S1049-3867(02)00139-1 [DOI] [PubMed] [Google Scholar]
- [57].Withers GF, Twigg K, Wertheim EH, Paxton SJ.., A controlled evaluation of an eating disorders primary prevention videotape using the Elaboration Likelihood Model of Persuasion. J Psychosom Res 2002; 53(5):1021-7; PMID:12445591; http://dx.doi.org/ 10.1016/S0022-3999(02)00493-2 [DOI] [PubMed] [Google Scholar]
- [58].Wiley KE, Massey PD, Cooper SC, Wood NJ, Ho J, Quinn HE, Leask J. Uptake of influenza vaccine by pregnant women: a cross-sectional survey. Med J Aust 2013; 198(7):373-5; PMID:23581957; http://dx.doi.org/ 10.5694/mja12.11849 [DOI] [PubMed] [Google Scholar]
- [59].Shavell VI, Moniz MH, Gonik B, Beigi RH. Influenza immunization in pregnancy: overcoming patient and health care provider barriers. Am J Obstet Gynecol 2012; 207(3):S67-74; PMID:22920063; http://dx.doi.org/ 10.1016/j.ajog.2012.06.077 [DOI] [PubMed] [Google Scholar]
- [60].Ahluwalia IB, Jamieson DJ, Rasmussen SA, D'Angelo D, Goodman D, Kim H. Correlates of seasonal influenza vaccine coverage among pregnant women in Georgia and Rhode Island. Obstet Gynecol 2010; 116(4):949-55; PMID:20859160; http://dx.doi.org/ 10.1097/AOG.0b013e3181f1039f [DOI] [PubMed] [Google Scholar]
- [61].Meharry PM, Colson ER, Grizas AP, Stiller R, Vázquez M. Reasons why women accept or reject the trivalent inactivated influenza vaccine (TIV) during pregnancy. Maternal Child Health J 2013; 17(1):156-64; PMID:22367067; http://dx.doi.org/ 10.1007/s10995-012-0957-3 [DOI] [PubMed] [Google Scholar]
- [62].Freed GL, Cowan AE, Gregory S, Clark SJ. Variation in provider vaccine purchase prices and payer reimbursement. Pediatrics 2008; 122(6):1325-31; PMID:19047253; http://dx.doi.org/ 10.1542/peds.2008-2038 [DOI] [PubMed] [Google Scholar]
- [63].CDC , Influenza activity–United States, 2012-13 season and composition of the 2013-14 influenza vaccine. MMWR. Morb Mortal Wkly Rep 2013; 62(23):473; PMID:23760189 [PMC free article] [PubMed] [Google Scholar]
- [64].CDC , Update: influenza activity-United States, 2011-12 season and composition of the 2012-13 influenza vaccine. MMWR. Morb Mortal Wkly Rep 2012; 61(22):414; PMID:22672977 [PubMed] [Google Scholar]