Skip to main content
JMIR Research Protocols logoLink to JMIR Research Protocols
. 2024 Sep 10;13:e55613. doi: 10.2196/55613

Digital Gamification Tool (Let’s Control Flu) to Increase Vaccination Coverage Rates: Proposal for Algorithm Development

Henrique Lopes 1,, Ricardo Baptista-Leite 1,2, Catarina Hermenegildo 1, Rifat Atun 3
Editor: Simone Ma
Reviewed by: Alison McCallum, Byron Bunt
PMCID: PMC11422745  PMID: 39255031

Abstract

Background

Influenza represents a critical public health challenge, disproportionately affecting at-risk populations, including older adults and those with chronic conditions, often compounded by socioeconomic factors. Innovative strategies, such as gamification, are essential for augmenting risk communication and community engagement efforts to address this threat.

Objective

This study aims to introduce the “Let’s Control Flu” (LCF) tool, a gamified, interactive platform aimed at simulating the impact of various public health policies (PHPs) on influenza vaccination coverage rates and health outcomes. The tool aligns with the World Health Organization’s goal of achieving a 75% influenza vaccination rate by 2030, facilitating strategic decision-making to enhance vaccination uptake.

Methods

The LCF tool integrates a selection of 13 PHPs from an initial set proposed in another study, targeting specific population groups to evaluate 7 key health outcomes. A prioritization mechanism accounts for societal resistance and the synergistic effects of PHPs, projecting the potential policy impacts from 2022 to 2031. This methodology enables users to assess how PHPs could influence public health strategies within distinct target groups.

Results

The LCF project began in February 2021 and is scheduled to end in December 2024. The model creation phase and its application to the pilot country, Sweden, took place between May 2021 and May 2023, with subsequent application to other European countries. The pilot phase demonstrated the tool’s potential, indicating a promising increase in the national influenza vaccination coverage rate, with uniform improvements across all targeted demographic groups. These initial findings highlight the tool’s capacity to model the effects of PHPs on improving vaccination rates and mitigating the health impact of influenza.

Conclusions

By incorporating gamification into the analysis of PHPs, the LCF tool offers an innovative and accessible approach to supporting health decision makers and patient advocacy groups. It enhances the comprehension of policy impacts, promoting more effective influenza prevention and control strategies. This paper underscores the critical need for adaptable and engaging tools in PHP planning and implementation.

International Registered Report Identifier (IRRID)

RR1-10.2196/55613

Keywords: influenza, gamification, public health policies, vaccination coverage rates, health promotion

Introduction

Influenza Epidemiology and Public Health Impact

Influenza is an infectious respiratory disease caused by an airborne virus. There are 4 identified types of influenza viruses, with types A and B being responsible for most of the seasonal influenza epidemics that occur annually [1,2]. The influenza virus can cause mild to severe disease, with risk groups (older people, pregnant women, young children, and individuals with chronic health conditions and autoimmune diseases) being more susceptible to severe forms of the disease [1].

The World Health Organization (WHO) estimates that annual influenza epidemics result in approximately 1 billion infections, 3 to 5 million cases of severe illness, and between 290 and 650,000 deaths [3]. The severity of influenza depends on multiple factors, including the virulence of the virus strain and the level of preexisting immunity in the population [1]. Influenza is also responsible for the worsening of previous health conditions in the individual and has consequences on different domains of individual health [4], such as cardiovascular [5], neurological, renal, respiratory, and diabetic complications.

However, despite the large number of respiratory infections worldwide, it is difficult to estimate the proportion of hospitalizations attributable to influenza across countries or over time [6]. During influenza outbreaks, health systems experience increased demand for services due to an influx of patients seeking medical care. This surge in patient demand can strain health care resources, including hospital beds, medical staff, and supplies [7]. As a result, the pressure on health systems during influenza outbreaks has an impact on access to care for other patients who require medical attention for non–influenza-related conditions, especially those at risk for complications [8].

Another study, published in 2023, which carried out a meta-analysis to improve understanding of the estimates of hospitalizations associated with influenza, concluded that seasonal influenza epidemics result in 3.2 million hospitalizations per year globally [9]. A study that evaluated 10 influenza seasons (between 2008 and 2018) in Portugal to estimate the clinical and economic costs of influenza reported that, on average, hospitalizations due to influenza were 11.6 cases per 100,000 inhabitants [10].

Vaccination for Influenza Prevention

Vaccination against influenza began in the early 1940s, marking a considerable advancement in public health with the introduction of trivalent vaccines [11]. This approach evolved, and in 2012, quadrivalent vaccines were introduced [11], offering broader protection against the influenza virus. The WHO is currently deliberating on the possibility of returning to trivalent vaccines [12], showcasing the ongoing evolution and reassessment of strategies to combat influenza. The effectiveness of the influenza vaccine, which varies between 40% and 60% in the general population, depends on various factors, including patient characteristics such as age and underlying health conditions, as well as the match between the circulating influenza viruses and the seasonal influenza vaccination administered [13].

Recognizing influenza as a considerable global public health challenge, the WHO has advocated for annual influenza vaccination as the most effective measure to combat the influenza. Priority is notably given to older population groups, who face an increased risk of severe influenza disease. However, the effectiveness of influenza vaccinations in these groups is compromised by immune senescence, leading to diminished antibody responses. In response, higher-dose influenza antigen vaccines have been developed, enhancing the immune response and proving to be more effective in preventing influenza infections [14], hospitalizations, and reducing mortality rates [15] compared with standard-dose vaccines.

This targeted approach to vaccination aligns with the WHO’s Global Influenza Strategy 2019 to 2030 [16], which recommends a goal of increasing vaccination coverage rates (VCRs) for influenza to 75% by 2030, a goal also echoed by the European Union (EU) in a 2009 Council Recommendation [17]. This 75% target applies especially to older adults, extending as well to other high-risk groups, including persons with chronic conditions and health workers, advocating for comprehensive coverage to mitigate the impact of influenza. Despite concerted efforts, reaching this target has been challenging; as of 2018, influenza vaccination coverage among people aged ≥65 years was <50% in most EU countries, averaging only 39% across these nations and indicating that no country had yet met the 75% coverage target [18].

VCRs are crucially impacted by social inequalities, including financial, cultural, and linguistic barriers [19,20]. Evidence from a broad range of studies highlights this correlation, pointing out a concerning lack of data on VCRs among specific susceptible groups in various countries. The situation is further complicated by the interaction between multimorbidity and social exclusion, creating a vicious cycle where social inequality exacerbates health disparities, thereby deepening social vulnerabilities [21-23]. This interconnection between social determinants and health outcomes underscores the necessity of addressing these challenges holistically to enhance VCRs and strengthen the global response to influenza.

In this context, health management strategies implemented by health and governance authorities, alongside other health decision makers, are pivotal. Public health policies (PHPs) play a key role in managing potential risks by preempting and mitigating their impacts. Vaccination-related PHPs exemplify this approach effectively; by fostering immunity within the community, they not only reduce the likelihood of disease transmission but also ensure that any infections are less severe. This diminishes the demand for hospitalization and decreases mortality risk. Such policies, therefore, are not merely preventive measures but also crucial interventions that address the root causes of health inequities, aiming to break the cycle of multimorbidity and social exclusion by ensuring equitable access to vaccination and health care services.

Gamification Strategies in Public Health

In the realm of scenario planning and policy development, traditional methodologies have steadily evolved to incorporate advanced technological capabilities, facilitating a more integrated and dynamic approach to learning and assessment. The advent of gamification, defined as the integration of game design elements in nongaming contexts to bolster engagement [24], represents a substantial leap forward in this evolution.

At its core, gamification uses game design elements in nongaming scenarios to augment engagement levels. As delineated in the study by Brangier and Marache-Francisco [25], the gamification design process is anchored in the principles of human-computer interaction, underscoring the importance of user-centric design and interaction. This approach to gamification has gained traction across various sectors, including education, health care, marketing, and human resources, evidencing its versatility and widespread applicability.

However, a substantial fraction of gamification initiatives stumble, primarily due to flawed design strategies. This underscores the criticality of a well-articulated design process, attuned to the nuances of user engagement and interaction dynamics. Moreover, the aspect of measurement emerges as a pivotal consideration in gamification, advocating for a dynamic approach toward redesigning gamified experiences through real-time feedback and user data analytics. However, the adoption of metrics as a quantification tool remains inconsistently applied across gamification frameworks, highlighting an area ripe for further exploration and standardization [24].

The application of gamification in educational contexts, particularly for fostering sustainable behaviors, stands out as a promising approach. Despite existing knowledge gaps, empirical evidence attests to the efficacy of gamification in elevating motivation, engagement, and satisfaction among learners. This enhanced learning environment, in turn, cultivates a fertile ground for the dissemination of sustainability principles and other educational content, demonstrating the transformative potential of gamification as a methodological tool in learning scenarios [26].

These advancements have rendered the simultaneous quantitative and qualitative modeling of policies affecting various facets of the health system and wider society not only feasible but also widely accessible. This confluence of technology and methodology paves the way for an enriched understanding and assessment of policies through sophisticated simulations that blend numerical data with narrative contexts, thereby facilitating a holistic view of potential outcomes and impacts.

Despite this growing interest in the integration of game-like elements into learning scenarios, especially within the health sector, focused design frameworks for health education through gamification remain underdeveloped. This area presents a unique opportunity for pioneering health-specific frameworks that emphasize prototyping, experimentation, measurement, and continuous iteration. Such frameworks are crucial for refining gamification strategies to ensure their effectiveness and relevance in the use of gamification in the health sector [27].

Adopting gamification in PHP decision-making introduces a complex landscape of ethical implications that warrant careful consideration. Despite its potential to enhance public health initiatives by promoting behavior change and increasing engagement being considerable, it also raises concerns regarding data privacy, and informed consent.

Data privacy emerges as a critical concern, as gamification strategies often rely on collecting and analyzing personal health information to personalize interventions and track progress. The ethical management of this data is paramount. According to the study by Mittelstadt et al [28], ensuring data protection and privacy in digital health interventions requires robust encryption methods and transparent data handling policies. Without stringent safeguards, there is a risk of unauthorized access to sensitive information, potentially leading to misuse.

Informed consent is another cornerstone of ethical considerations in gamification. Participants must be fully aware of how their data will be used, the nature of the gamified intervention, and its potential risks and benefits. As Thaler and Sunstein [29] argue in “Nudge,” while gamification can guide behavior in beneficial ways, it must not manipulate or coerce participants. Ensuring that consent is informed and voluntary preserves autonomy and respects individual decision-making.

Gamification can oversimplify complex policy issues if interpreted verbatim without critical thinking. Especially if used as a game of health policy–related challenges and not a way of rehearsing ideas, there is a risk of reducing nuanced issues to overly simplistic solutions. This oversimplification can lead to misinterpretations and misapplications of policy measures, potentially undermining the effectiveness of interventions and disregarding the intricacies of health outcomes. In addition, given that gamification strategies often use rewards, incentives, and competition to drive behavior, its use in health-related contexts may impact individuals’ autonomy and decision-making if it is not framed in critical thinking. Therefore, in the development of this tool, under no circumstances does the individual receive any form of retribution for use or performance.

The “Let’s Control Flu” Tool

In the intricate balance between ethical considerations and the exploratory potential of gamification, the “Let’s Control Flu” (LCF) tool emerges as a digital, interactive tool designed to support policy decision-making specific to influenza. The LCF tool aims to help enhance VCRs and fulfill the objectives outlined in the WHO’s Global Influenza Strategy 2019 to 2030. Rooted in the qualitative framework suggested in the study by Kassianos et al [30], this project seeks to align VCR achievements with the benchmarks established by the WHO and the Council of Europe. The LCF tool demystifies the creation of epidemiological scenarios, eliminating the need for users to possess in-depth knowledge of epidemiological modeling techniques or to engage with complex data sets, such as extensive statistical series. This user-friendly approach facilitates a more accessible and informed decision-making process for policy makers striving to combat influenza through increased vaccination uptake.

The LCF tool innovatively applies gamification principles to assist stakeholders in understanding the nuances of different PHPs regarding influenza vaccination. It achieves this by providing a simulated environment where users can experiment with various policy scenarios, thus offering insights into the potential impact on VCRs before their implementation. This simulation enables stakeholders to grasp the intricacies, trade-offs, and consequences of their policy decisions, fostering a deeper understanding and facilitating more informed choices about the PHPs to be adopted and executed. The engaging and interactive presentation of information within the LCF tool simplifies the comprehension of policy impacts, encouraging decisions backed by data-driven insights.

The limitations sector of this paper acknowledges the constraints and challenges faced by the LCF tool. Despite its innovative approach and initial success, the tool’s effectiveness and applicability are subject to ongoing evaluation and refinement. Originally piloted in Sweden, the LCF tool’s application has proven successful, marking an important first step in its practical use. Following this initial implementation, efforts are underway to broaden the tool’s application across 3 additional European countries. This expansion is aimed at enhancing the tool’s robustness and increasing its relevance across different geographic contexts, thereby contributing valuable insights to the global effort to improve influenza vaccination coverage through informed policy making.

Methods

Overview

The development of the tool was underpinned by an integrated epidemiological model, encapsulating the burden of influenza disease alongside the predictive impacts of selected PHPs on targeted populations. Initial steps in tool development involved a critical reduction in the number of policies under consideration: on the basis of the foundational work by Kassianos et al [30], the scope was narrowed from 42 to 13 policies, spanning across the 5 pillars identified in their research (Multimedia Appendix 1). This refinement was necessitated by the current state of knowledge, which does not allow for a discrete modeling of the effects attributable to each of the 42 PHPs initially proposed. Consequently, a strategy was used to merge closely related PHPs into coherent bundles, maintaining the original pillar-based categorization to ensure methodological orthogonality.

To ascertain the robustness and reliability of the model, we used a rigorous selection criterion for the scientific literature included in our analysis. Detailed in Textboxes 1 and 2, the inclusion and exclusion criteria were designed to encompass only the most pertinent and high-quality studies. In adherence to the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines, we executed a systematic and comprehensive literature review. The PRISMA flowchart (Figure 1) delineates our methodical approach to the selection of publications, underscoring the scrutiny at each phase of article identification, screening, and inclusion. It is pertinent to note the exclusion of data from 2021 and 2022 to mitigate the confounding effects of the COVID-19 pandemic on the influenza landscape [31].

Inclusion criteria for scientific works included in the model.

Inclusion criteria

  • Only pre-post intervention or controlled studies were included, enabling the effects of the policy to be effectively assessed independently of any background (and potentially not described) policies already in place.

  • Studies were included whenever they contained data on one or more of the populations of interest for the model (children, health professionals; pregnant women; older adults, including adults aged ≥65 years and adults aged between 50 and 64 years; and high-risk patients).

  • Studies reporting seasonal vaccination uptake were included, as opposed to pandemic influenza vaccination. This restriction was placed to ensure comparability of studies used to inform the model (ie, avoid pooling data for seasonal and pandemic influenza, as the coverage may not be comparable).

Exclusion criteria for scientific works included in the model.

Exclusion criteria

  • Reviews were not included.

  • Articles in any other language than English.

Figure 1.

Figure 1

PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) flowchart of systematic literature review process. TLR: targeted literature review.

The interventions delineated in the included studies were meticulously aligned with the PHP categories identified in the study by Kassianos et al [30]. To ensure the validity and accuracy of the model construction, a National Advisory Board (NAB) comprising 4 eminent epidemiologists and public health experts from the Swedish health system was constituted. The board’s formation was predicated on their prior contributions to scientific literature and health authority reports over the last decade, ensuring their expertise was both relevant and current. The NAB was instrumental in the validation process, meticulously verifying the model-generated values and endorsing the results. This process was crucial, particularly in instances where the scientific literature did not provide ecologically valid data to substantiate the selection of proxies necessary for the tool’s development.

Public Health Policies

The set of 13 PHPs incorporated into the LCF model maintained the original categorization into 5 pillars proposed by Kassianos et al [30], each targeting different aspects of public health to enhance vaccination rates and mitigate the health impacts of influenza.

Pillar 1: Health Authority Accountability and Strengthening the Influenza Program

VCRs targets set at national and regional levels for recommended population: To boost influenza vaccination rates [32], policies set targets at national and regional levels for specific population groups [33]. In Sweden, eg, this policy was implemented nationwide. Strategies programs [34-36] include educating individuals about vaccine benefits, improving vaccine accessibility, and offering incentives for vaccination, all aimed at increasing vaccine uptake.

Funding of influenza vaccinations for all recommended groups: To enhance influenza vaccine access, reduce the burden of disease, and prevent influenza-related deaths, immunization programs [37-41], intervention campaigns, and strategies [32,42-50] can be created. In addition, funds may be allocated to cover the cost of influenza shots for vulnerable groups, such as older adults, children, health care workers, and individuals with underlying health conditions. By doing so, public health officials improve vaccine accessibility and safeguard those with a higher risk of flu complications.

Nationwide regular monitoring of patient VCR at vaccination site and at health care professional (HCP) level by health authorities: Regular tracking of vaccine uptake in designated health facilities such as clinics, hospitals, and pharmacies [51,52] allows for monitoring immunization program effectiveness and identifying areas of improvement. By monitoring immunization coverage rates, public health authorities can use data to enhance programs and achieve desired health outcomes for the population.

HCP VCR as part of performance criteria in hospitals: Boosting vaccine uptake among health care workers and minimizing disease transmission through vaccination. This policy mandates that health worker immunization coverage rates be used as a performance criterion in health care facilities, including hospitals and primary care settings [53]. It encourages health care workers to get vaccinated, prioritizing their well-being and minimizing disease spread among patients, thereby fostering a safer and healthier environment for all.

Sustainable procurement system to ensure appropriate vaccine supply: Ensuring consistent and reliable availability of necessary vaccines for all individuals in need [54], irrespective of their location or financial circumstances. This policy aims to establish a procurement system that effectively manages vaccine acquisition, storage, and distribution to health units, considering cost, quality, and sustainability factors.

Pillar 2: Facilitated Access to Vaccination

Access to multiple vaccination settings: Enhancing vaccine access and reducing barriers to vaccination ensures that individuals can receive vaccines in various locations, including hospitals [48,53,55-57], clinics [36,58], pharmacies [39,59-62], schools [43,52,63-70], and other settings [46,71]. By doing this, public health authorities increase convenience and improve the chances of individuals getting vaccinated.

Call-to-action communications to target groups by multiple stakeholders: This policy targets influenza-related stakeholders, including public health agencies, health professionals, schools, and community organizations. Various methods such as email [69,70,72-74], SMS text messages [75-81], phone calls, health apps, and others [49,82] are used to remind target groups about the importance of vaccination. The objective is to boost vaccine uptake by reminding individuals in target groups of vaccination’s significance and encouraging them to get vaccinated [83-86].

HCP pop-up notification or SMS text message to population to vaccinate eligible patients: Health care providers use pop-up notifications or SMS text messages to remind eligible patients of the importance of vaccination and encourage them to get vaccinated [84,85,87-89], thus increasing vaccine uptake.

Pillar 3: HCP Accountability and Engagement

Regular HCP education and training: This policy ensures HCPs, including doctors, nurses, and other professionals, receive ongoing education and updates on new technologies, medical advancements, and changes in vaccination practices [33,34,48,65,77,87-94]. Its objective is to equip HCPs with the necessary knowledge and skills to deliver safe, effective, and high-quality care to patients.

Fair and specific HCP compensation per vaccination: Establishing a system where health professionals receive fair compensation for administering vaccines [95]. This aims to incentivize HCPs to administer vaccines and ensure they are adequately rewarded for their time and efforts. Fair compensation not only supports HCPs but also encourages their dedication to protecting public health.

Mandatory HCP vaccination: Mandating or strongly recommending that health care workers receive specific vaccines as part of their job [35,36,53,96-106]. This policy aims to safeguard public health by minimizing the transmission of communicable diseases in health care settings such as clinics or hospitals, particularly to patients with weakened immune systems. By requiring or strongly recommending vaccination for HCPs, the policy aims to prevent them from being carriers of diseases that could be transmitted to their patients.

Pillar 4: Awareness of the Burden and Severity of the Disease

Coordinated multistakeholder awareness and communication campaigns: This policy promotes immunization through collaboration and coordination among various stakeholders, including government agencies, hospitals and other health organizations [33,34,46,47,52,57,68-71,77,83,86-89,91,97,105, 107-110], health professionals [32,41,42,58,65,72,111,112], community organizations, schools, and universities [43,113], as well as the media [105,114]. Its goal is to deliver a cohesive message about the importance of immunization, reaching a wide audience with information on the benefits of immunization and how to access it. By addressing concerns, dispelling misinformation, and creating a supportive environment [115,116], the policy aims to enhance vaccine uptake.

Pillar 5: Belief in Influenza Vaccination Benefits

Positive media coverage of vaccines: The policy promotes a positive approach to vaccine promotion, highlighting the benefits of vaccination and countering negative or misleading information. It aims to foster a vaccine-friendly environment by showcasing the safety, efficacy, and importance of vaccines through various media channels, such as news articles, public service announcements, and other media content [41]. The policy’s purpose is to boost vaccine uptake by offering accurate information, debunking myths, and empowering the public to make informed decisions about vaccination.

Model Design

The model categorizes the population into 6 age groups—12 to 14, 15 to 34, 35 to 49, 50 to 64, and >65 years—and identifies 5 key target groups: children (aged 0-14 years), older adults (aged >65 years), health professionals, pregnant women, and high-risk patients (aged 15-64 years with ≥1 chronic condition). This segmentation acknowledges the critical challenge of chronic undervaccination in high-risk patients, which poses substantial barriers to achieving optimal health outcomes and protection against influenza and its complications [117].

To assess the impact of PHPs on these target groups, the model simulates 7 health outcomes over a 10-year horizon (2022-2031), including influenza infections averted, hospitalizations averted, influenza-related general practitioner visits averted, workdays lost (productivity impact), influenza-related deaths averted, hospitalizations averted due to cardiovascular complications, and deaths averted due to cardiovascular complications. These outcomes are evaluated both across the total population and within each target group, providing a comprehensive overview of PHP effectiveness in mitigating influenza-related morbidity and mortality.

In the development of the epidemiological model, weights were assigned to each policy across different target groups and specified time frames using a multifaceted approach. This methodology enabled a rigorous, evidence-based evaluation of PHPs’ impact on VCRs, accounting for the variability and complexity of policy effects across different demographic and risk groups. It encompassed the following:

  1. Policy effects derived from the literature: weights were calculated as weighted averages for each policy and target group based on a comprehensive review of the existing literature. This approach ensures that the model’s parameters are grounded in empirical evidence, reflecting the documented effects of PHPs on VCRs.

  2. Imputation from similar policies or different target groups: in instances of incomplete data for a specific policy within a target group, weights were imputed based on the relative effects of the most analogous policies available. Alternatively, effects documented for the same policy in different target groups were adjusted and applied, facilitating a coherent extrapolation of policy impacts.

  3. Projected increases for subsequent years: for policy effects lacking data beyond the first year, a conservative projection was applied, assuming a 10% increase in the second year and a 20% increase for the third year onward. This assumption is based on the initial year’s effect, providing a structured approach to model the temporal dynamics of policy impacts.

  4. Integration of expert opinions: insights and recommendations were solicited from the NAB to inform the weighting process, particularly in areas where empirical data were sparse or ambiguous. This inclusion of expert judgment ensures that the model remains adaptable and relevant to current public health contexts, incorporating the nuanced understanding of seasoned professionals in the field.

When policy effects were extrapolated from the literature, the inherent challenges associated with integrating qualitative findings directly into quantitative models led to the necessity of generating temporary proxies to bridge the gap between qualitative insights and the quantitative demands of the model. This process was initiated with comprehensive discussions within the scientific coordination team of the project, after which the proposed proxies underwent a rigorous phase of deliberation and validation by the NAB, ensuring that the proxies accurately reflect the intended policy effects. The final step in this process involved the validation of the proxies by the project’s external scientific adviser, who evaluated their suitability and alignment with the model’s objectives and the underlying empirical evidence. This layered approach to proxy generation and validation ensured the model’s integrity and the reliability of its projections, accommodating instances where direct quantitative data had been lacking.

In scenarios where explicit data concerning the uncertainty of parameters was unavailable, our approach entailed the adjustment of these parameters through the application of suitable statistical distributions, premised on an SE estimated at 10% of the base-case value. This procedure was designed to embed a quantifiable measure of uncertainty into the model, thereby ensuring a broader and more realistic spectrum of potential outcomes.

The model was also designed with a flexible, modular structure, making it easy to update with new scientific findings without having to change its core algorithm. This flexibility is crucial for continually improving the model, allowing regular updates to its parameters and data. The modular design also supports replacing preliminary estimates with actual, up-to-date information, which improves the model’s accuracy and relevance as new research becomes available.

Figure 2 showcases the compartmental model designed to elucidate the dynamics among vaccination strategies, influenza transmission, and consequent health outcomes. This model delineates the population into distinct compartments, primarily focusing on the age-stratified cohort of noninfected individuals who are initially unvaccinated. Upon the application of vaccination policies, a transition of these individuals into the vaccinated cohort is anticipated, contingent upon their noninfection status, which predicates the absence of health complications or influenza-induced mortality, thereby facilitating a cyclic annual assessment. In the event of influenza infection, the model accounts for resultant health implications, including hospital admissions, general practitioner consultations, loss in work productivity, and cardiovascular complications, using a formulaic approach that integrates vaccine efficacy and age-specific infection rates. Identical principles extend to the unvaccinated population who contract the virus, after which the model delineates 3 potential pathways postinfection: mortality attributable to influenza, mortality from alternate causes, or recovery. The recovery probabilities are quantified through a formula that encapsulates influenza-associated mortality rates across different age groups.

Figure 2.

Figure 2

Graphic representation of the model adopted to estimate the effect of the 13 elected public health policies. VCR: vaccination coverage rate.

The Operational Functionality of the Tool

The design of this tool prioritized accessibility and user-friendliness, targeting a wide audience that spans HCPs, the public, and patient advocacy groups. By facilitating an interactive platform, it enables users to easily simulate the impact of selecting from the 13 distinct PHPs on various health outcomes within specific target groups, for any year between 2022 and 2031.

Upon the selection of policies, a prioritization mechanism is applied where the weight of each subsequent policy decreases fractionally to reflect its comparative impact on the overall scenario. This methodology underscores the varying significance of individual policies and their synergistic effects when combined. This system also incorporates a realistic element of societal resistance to change, adjusting the cumulative weight of selected PHPs to reflect this factor.

Furthermore, the tool bases its analysis on existing PHPs within a country, recognizing prior efforts and their varying degrees of success. The simulation outcomes represent the scenario of maximum policy efficacy, acknowledging that complete population compliance is an ideal rather than a constant reality due to people’s inherent resistance to change. The possibility of achieving perfect policy implementation is speculated for future contexts, suggesting that even in such ideal conditions, there is potential for further enhancement. This could be achieved through the adoption of new communication and educational strategies leveraging emerging technologies, adapting to changing societal contexts, and more effectively engaging target populations.

Ethical Considerations

The LCF project was initiated at the Catholic University of Portugal; was subject to the code of ethics NR/R/1419/2015 at the time; and was later transferred, together with the team, to the NOVA-IMS Faculty of the Universidade Nova de Lisboa, where it was subject to the supervision of its ethics committee, in accordance with the Universidade Nova de Lisboa code of ethics (approval 15464/2014) published on December 19, 2014. Access to data was only granted to published and public material, and there was no access to personal data or any other data that could be used to identify someone.

Democratizing Access and Combating Misinformation

The development of this tool democratizes access to complex epidemiological scenario modeling, allowing users without advanced technical knowledge of PHPs and health impact modeling to explore the potential effects of different health policy scenarios. This capability not only streamlines the decision-making process for health policy but also upholds the principle of technological transparency, ensuring that the underlying mechanisms and assumptions of the tool are clear and understandable.

The dedicated website [118] hosting the LCF tool serves as an educational resource, offering scientifically accurate information about influenza and vaccination in accessible terms. This approach is instrumental in combating misinformation and reducing vaccine hesitancy, thereby supporting global efforts to lessen the impact of seasonal and pandemic influenza [119]. In this context, it is also relevant to acknowledge the differences between vaccine resistance and vaccine hesitancy [120,121], where vaccine resistance often stems from deeply rooted ideological, religious, or philosophical beliefs and, in contrast, vaccine hesitancy is typically driven by fear and doubts, frequently fueled by misinformation or distorted news. Recognizing these differences is crucial for tailoring intervention strategies effectively, as in contexts where vaccine resistance is prevalent due to entrenched beliefs, efforts may need to focus on long-term engagement and education; conversely, in areas where hesitancy predominates, addressing misinformation and building trust through transparent communication may prove more effective. Understanding these nuances is essential for optimizing the impact of our approach across diverse populations, as applying this tool in different legal and cultural contexts may face increased inertia from the public.

Results

The LCF project, initiated in February 2021, is projected to conclude in December 2024. The phase focused on model creation and its implementation in the pilot country, Sweden, occurred from May 2021 to May 2023.

The pilot phase of the project was concluded successfully and revealed positive outcomes on the Swedish population. For example, the use of the tool to simulate the comprehensive application of all 13 PHPs across various target populations for the year 2025 provided insightful projections, as the results demonstrate a substantial potential increase in the national influenza VCR, from 18.6% (1,940,964/1,042,283,400) to 28.4% (2,962,903/1,042,294,300). This comprehensive approach revealed increases in VCRs across all specified target populations: older adults experienced a substantial increase to 75% (1,636,707/218,227,600) increase, as well as in high-risk patients who also achieved 75% (825,076/110,010,100), pregnant women’s VCR went up to 57.3% (61,894/10,804,700), and health workers saw an increase to 53.1% (276,466/52,085,500). Children VCR went up to 0.8% (15,907/179,057,900) rise, representing an increase of 50% from the baseline value, knowing that high-risk children are vaccinated. Moreover, the anticipated health benefits from this full-scale policy implementation are considerable, including the avoidance of 21,935 influenza infections and 277 hospitalizations. In addition, there would be 5871 fewer physician visits, a reduction of 19,829 workdays lost due to influenza, 38 lives saved from influenza-related deaths, 62 hospitalizations prevented due to cardiovascular complications, and ultimately, 8 fewer deaths from cardiovascular issues related to influenza.

Discussion

Principal Findings

Gamification is an innovative approach that can play a considerable role in improving PHP decision-making. By using gaming mechanics and design, gamification can make complex information and issues more accessible and engaging, leading to a greater understanding of public health challenges, namely for health policy makers who come from outside the professional health sphere and need support tools for their decision-making that provide them with a decision that is best supported by science. Gamification can also create opportunities for active participation and collaboration, allowing individuals to actively shape PHPs and decisions. In addition, gamification can facilitate the collection of real-time data and feedback, providing valuable insights into the impact of PHPs and informing decision-making processes.

By combining play with the need for informed policy decisions, gamification has the potential to positively impact public health and help ensure that policies are both effective and evidence based and also helps to address social determinants of health by engaging disadvantaged communities and increasing their access to health information and resources. Through interactive experiences, gamification can help to break down barriers and increase health literacy, which can lead to better health outcomes. Furthermore, gamification can foster a sense of community and collaboration among individuals, which can help to build a shared understanding of the importance of public health and create a culture of health.

Limitations

In this paper, we delineate several principal limitations inherent to the use of gamification strategies within the realm of predictive modeling. First, we must acknowledge the ethical and methodological implications posed by gamification: these methodologies do not offer precise forecasts of future events but rather serve as heuristic guides. They project potential futures predicated on historical data, presuming all other variables remain constant (ceteris paribus). This deterministic nature inherently restricts the model’s ability to predict future impacts with absolute certainty.

Second, the foundation of such modeling lies in data analysis, which encounters substantial challenges regarding the availability and quality of data. This is particularly pronounced at the local level, where the procurement and qualification of data sources, often designed for disparate purposes within complex ecosystems, necessitate the generation of proxy measures. Despite the rigorous and meticulous process of producing and validating these proxies, they introduce inherent risks and uncertainties into the modeling efforts.

Third, we must consider the impact of abrupt contextual shifts that can fundamentally disrupt the health care management landscape, thereby breaching the fundamental principles of modeling. The COVID-19 pandemic serves as a striking example, illustrating how populations initially compliant with national vaccination strategies may suddenly exhibit resistance due to widespread disinformation campaigns. This phenomenon has led to a decline in VCRs for numerous vaccines, culminating in the resurgence of diseases such as polio in locations such as London and New York, a scenario deemed inconceivable a decade ago.

In addition, our model does not account for the influence of other policies that may directly or indirectly affect health outcomes. These include frameworks for occupational health, such as specific recommendations and obligations within various work contexts, as well as the management of health issues within institutions focused on older adult care. Furthermore, the model does not incorporate the integration of health issues into broader economic and policy areas, commonly referred to as Health in All Policies. Despite being endorsed by the EU since 2011, Health in All Policies has seen limited practical implementation. Such policy integration could have a considerable impact on vaccination rates, not only for influenza but also for other vaccines administered throughout an individual’s life. Consequently, our model does not capture this dynamic aspect of health management that extends beyond the specific scope of influenza vaccination.

Given these limitations, we advocate for the periodic reassessment of the modeling framework, recommending an annual (or, ideally, biannual) review. This process is intended to incorporate the latest bibliographic resources and replace proxy measures with evidence-based values. Such a practice not only ensures the model’s ongoing refinement but also contributes to the accumulation of evidence necessary for evaluating health impacts in the context of vaccination policy development or modification.

Conclusions

The field of work on increasing VCRs lends itself well to gamification because (1) general trust in vaccines has been deeply shaken by misinformation and fake news during the COVID-19 pandemic, and it is possible to demonstrate the immense advantages that good vaccine coverage provides; (2) in particular, influenza is one of the diseases with the highest pandemic potential, and only through vaccination against the disease will it be possible to mitigate its potential effects; and (3) the entire community, from policy makers, often disconnected from health issues, to the most susceptible citizen, can understand how and where the benefits of influenza vaccination work.

The journey toward improving VCRs globally is not solely a medical challenge but a multifaceted endeavor that requires addressing the underlying social determinants of health. The intertwined relationship between social inequalities and multimorbidity highlights a critical area for intervention. As evidenced, these disparities in social, financial, cultural, and linguistic domains not only hinder equitable access to vaccination but also exacerbate the vulnerability of marginalized communities, thereby impeding the overall effectiveness of influenza vaccination efforts. Therefore, it is imperative that strategies to enhance VCRs also focus on increasing literacy, especially in health-related matters. Empowering individuals with knowledge and understanding of the importance of vaccination can drive more informed decisions, leading to higher uptake rates. In addition, concerted efforts to combat social inequalities are paramount. By creating more inclusive health systems and policies that actively address the barriers faced by disadvantaged groups, a way can be paved for a more equitable distribution of health resources, including vaccines. Ultimately, enhancing health literacy and addressing social inequalities stand as potential catalysts for boosting VCRs, thereby strengthening the global response to influenza and enhancing public health outcomes for all communities.

The design and implementation of the LCF tool have shown promising results in facilitating a broad and user-friendly approach to evaluating PHPs impacts on influenza VCRs and health outcomes. Its capacity to simulate the effects of various PHPs, considering both individual significance and collective synergy, highlights the tool’s utility in strategic health planning. Furthermore, the tool’s acknowledgment of societal resistance and its foundation on existing PHPs underscore the complexity of health policy efficacy. By offering a platform for dynamic scenario testing, the tool not only assesses current strategies but also identifies opportunities for enhancement, reinforcing the importance of continual innovation and adaptability in public health initiatives. This approach underscores the evolving nature of health strategies and the critical need for responsive, technology-driven solutions to meet public health challenges effectively.

In our interpretation, we see potential for developing the tool in several directions: (1) through its application in other legal and cultural contexts; (2) giving it new capabilities, namely the possibility of cost assessment; (3) adapting the tool to other human vaccination contexts, namely those with low or very low VCRs, as is generally the case with adult vaccination; and (4) developing the gamification capacity used in this context for other public health situations, namely in the prevention of chronic diseases.

Acknowledgments

The authors would like to thank Hans Winberg, Matti Sällberg, Toomas Timpka, and Armin Spreco for their work and contributions to the National Advisory Board for Sweden.

The “Let’s Control Flu” project received funding from Sanofi; however, the research was conducted independently of the sponsoring company.

Abbreviations

EU

European Union

HCP

health care professional

LCF

Let’s Control Flu

NAB

National Advisory Board

PHP

public health policy

PRISMA

Preferred Reporting Items for Systematic Reviews and Meta-Analyses

VCR

vaccination coverage rate

WHO

World Health Organization

Multimedia Appendix 1

Public health policies of the “Let’s Control Flu” model, organized by Pillar, based on the study by Kassianos et al.

Footnotes

Authors' Contributions: HL and RBL contributed to the conceptualization. HL and CH contributed to data curation, formal analysis, investigation, resources, and software. RBL contributed to funding acquisition. HL contributed to methodology, project administration, and validation. HL and RA contributed to supervision. CH contributed to the visualization. HL, CH, RBL, and RA contributed to writing—original draft. HL, CH, RBL, and RA contributed to writing—review and editing.

Conflicts of Interest: None declared.

References

  • 1.Krammer F, Smith GJ, Fouchier RA, Peiris M, Kedzierska K, Doherty PC, Palese P, Shaw ML, Treanor J, Webster RG, García-Sastre A. Influenza. Nat Rev Dis Primers. 2018 Jun 28;4(1):4. doi: 10.1038/s41572-018-0006-7.10.1038/s41572-018-0006-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Seasonal influenza - annual epidemiological report for 2022/2023. European Centre for Disease Prevention and Control. [2024-12-08]. https://www.ecdc.europa.eu/en/publications-data/seasonal-influenza-annual-epidemiological-report-20222023 .
  • 3.WHO launches new global influenza strategy. World Health Organization. [2024-01-08]. https://www.who.int/news/item/11-03-2019-who-launches-new-global-influenza-strategy .
  • 4.Macias AE, McElhaney JE, Chaves SS, Nealon J, Nunes MC, Samson SI, Seet BT, Weinke T, Yu H. The disease burden of influenza beyond respiratory illness. Vaccine. 2021 Mar 15;39 Suppl 1:A6–14. doi: 10.1016/j.vaccine.2020.09.048. https://linkinghub.elsevier.com/retrieve/pii/S0264-410X(20)31209-3 .S0264-410X(20)31209-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Omidi F, Zangiabadian M, Shahidi Bonjar AH, Nasiri MJ, Sarmastzadeh T. Influenza vaccination and major cardiovascular risk: a systematic review and meta-analysis of clinical trials studies. Sci Rep. 2023 Nov 19;13(1):20235. doi: 10.1038/s41598-023-47690-9. doi: 10.1038/s41598-023-47690-9.10.1038/s41598-023-47690-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Johnson EK, Sylte D, Chaves SS, Li Y, Mahe C, Nair H, Paget J, van Pomeren T, Shi T, Viboud C, James SL. Hospital utilization rates for influenza and RSV: a novel approach and critical assessment. Popul Health Metr. 2021 Jun 14;19(1):31. doi: 10.1186/s12963-021-00252-5. https://pophealthmetrics.biomedcentral.com/articles/10.1186/s12963-021-00252-5 .10.1186/s12963-021-00252-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.2023-2024 preliminary in-season burden estimates. Centers for Disease Control and Prevention. [2024-12-08]. https://www.cdc.gov/flu/about/burden/preliminary-in-season-estimates.htm .
  • 8.Fleming DM, Elliot AJ. The impact of influenza on the health and health care utilisation of elderly people. Vaccine. 2005 Jul 08;23 Suppl 1:S1–9. doi: 10.1016/j.vaccine.2005.04.018.S0264-410X(05)00458-5 [DOI] [PubMed] [Google Scholar]
  • 9.Paget J, Staadegaard L, Wang X, Li Y, van Pomeren T, van Summeren J, Dückers M, Chaves SS, Johnson EK, Mahé C, Nair H, Viboud C, Spreeuwenberg P. Global and national influenza-associated hospitalisation rates: estimates for 40 countries and administrative regions. J Glob Health. 2023 Jan 27;13:04003. doi: 10.7189/jogh.13.04003. https://europepmc.org/abstract/MED/36701368 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Froes F, Carmo M, Lopes H, Bizouard G, Gomes C, Martins M, Bricout H, de Courville C, de Sousa JC, Rabaçal C, Raposo JF, Cordeiro CR. Excess hospitalizations and mortality associated with seasonal influenza in Portugal, 2008-2018. BMC Infect Dis. 2022 Sep 07;22(1):726. doi: 10.1186/s12879-022-07713-8. https://bmcinfectdis.biomedcentral.com/articles/10.1186/s12879-022-07713-8 .10.1186/s12879-022-07713-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 11.Barberis I, Myles P, Ault SK, Bragazzi NL, Martini M. History and evolution of influenza control through vaccination: from the first monovalent vaccine to universal vaccines. J Prev Med Hyg. 2016 Sep;57(3):E115–20. https://europepmc.org/abstract/MED/27980374 . [PMC free article] [PubMed] [Google Scholar]
  • 12.WHO trivalent recommendations expected to reshape global influenza vaccine market. Clinical Trials Arena. [2024-12-08]. https://www.clinicaltrialsarena.com/analyst-comment/who-trivalent-recommendations-expected-to-reshape-global-influenza-vaccine-market/
  • 13.Vaccine effectiveness: how well flu vaccines work. Centers for Disease Control and Prevention. [2024-01-08]. https://www.cdc.gov/flu/vaccines-work/vaccineeffect.htm .
  • 14.Wilkinson K, Wei Y, Szwajcer A, Rabbani R, Zarychanski R, Abou-Setta AM, Mahmud SM. Efficacy and safety of high-dose influenza vaccine in elderly adults: a systematic review and meta-analysis. Vaccine. 2017 May 15;35(21):2775–80. doi: 10.1016/j.vaccine.2017.03.092.S0264-410X(17)30444-9 [DOI] [PubMed] [Google Scholar]
  • 15.Lee JK, Lam GK, Shin T, Samson SI, Greenberg DP, Chit A. Efficacy and effectiveness of high-dose influenza vaccine in older adults by circulating strain and antigenic match: an updated systematic review and meta-analysis. Vaccine. 2021 Mar 15;39 Suppl 1:A24–35. doi: 10.1016/j.vaccine.2020.09.004. https://linkinghub.elsevier.com/retrieve/pii/S0264-410X(20)31146-4 .S0264-410X(20)31146-4 [DOI] [PubMed] [Google Scholar]
  • 16.Global influenza strategy 2019-2030. World Health Organization. 2019. [2024-04-29]. https://iris.who.int/handle/10665/311184 .
  • 17.Council recommendation. Official Journal of the European Union. [2024-04-29]. https://eur-lex.europa.eu/LexUriServ/LexUriServ.do?uri=OJ:L:2009:348:0071:0072:EN:PDF .
  • 18.Vaccination against influenza among people aged 65 and over. OECD/European Union. 2020. [2024-03-08]. https://www.oecd-ilibrary.org/sites/804e5c3b-en/index.html?itemId=/content/component/804e5c3b-en .
  • 19.Spetz M, Lundberg L, Nwaru C, Li H, Santosa A, Leach S, Gisslén M, Hammar N, Rosvall M, Nyberg F. The social patterning of COVID-19 vaccine uptake in older adults: a register-based cross-sectional study in Sweden. Lancet Reg Health Eur. 2022 Apr;15:100331. doi: 10.1016/j.lanepe.2022.100331. https://linkinghub.elsevier.com/retrieve/pii/S2666-7762(22)00024-2 .S2666-7762(22)00024-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 20.Reid JA, Mabhala MA. Correction to: ethnic and minority group differences in engagement with COVID-19 vaccination programmes - at Pandemic Pace; when vaccine confidence in mass rollout meets local vaccine hesitancy. Isr J Health Policy Res. 2021 Oct 28;10(1):60. doi: 10.1186/s13584-021-00470-0. https://ijhpr.biomedcentral.com/articles/10.1186/s13584-021-00470-0 .10.1186/s13584-021-00470-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Barnett K, Mercer SW, Norbury M, Watt G, Wyke S, Guthrie B. Epidemiology of multimorbidity and implications for health care, research, and medical education: a cross-sectional study. Lancet. 2012 Jul 07;380(9836):37–43. doi: 10.1016/S0140-6736(12)60240-2. https://linkinghub.elsevier.com/retrieve/pii/S0140-6736(12)60240-2 .S0140-6736(12)60240-2 [DOI] [PubMed] [Google Scholar]
  • 22.Multiple long-term conditions (multimorbidity) and inequality- addressing the challenge: insights from research. National Institute for Health and Care Research (NIHR) [2024-04-29]. https://evidence.nihr.ac.uk/collection/multiple-long-term-conditions-multimorbidity-and-inequality-addressing-the-challenge-insights-from-research/
  • 23.Katikireddi SV, Niedzwiedz CL, Dundas R, Kondo N, Leyland AH, Rostila M. Inequalities in all-cause and cause-specific mortality across the life course by wealth and income in Sweden: a register-based cohort study. Int J Epidemiol. 2020 Jun 01;49(3):917–25. doi: 10.1093/ije/dyaa053. https://europepmc.org/abstract/MED/32380544 .5831977 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Mora A, Riera D, Gonzalez C, Arnedo-Moreno J. A literature review of gamification design frameworks. Proceedings of the 7th International Conference on Games and Virtual Worlds for Serious Applications; VS-Games '15; September 16-18, 2015; Skovde, Sweden. 2015. pp. 1–8. https://ieeexplore.ieee.org/document/7295760 . [DOI] [Google Scholar]
  • 25.Brangier E, Marache-Francisco C. Process of gamification. From the consideration of gamification to its practical implementation. Proceedings of the 6th International Conference on Advances in Human oriented and Personalized Mechanisms, Technologies, and Services; CENTRIC '13; October 27-November 1, 2013; Venice, Italy. 2013. p. 2013. https://www.researchgate.net/publication/255708104_Process_of_Gamification_From_The_Consideration_of_Gamification_To_Its_Practical_Implementation . [Google Scholar]
  • 26.Oliveira RP, de Souza CG, Reis A, de Souza WM. Gamification in e-learning and sustainability: a theoretical framework. Sustainability. 2021 Oct 28;13(21):11945. doi: 10.3390/su132111945. [DOI] [Google Scholar]
  • 27.Mora A, Riera D, González C, Arnedo-Moreno J. Gamification: a systematic review of design frameworks. J Comput High Educ. 2017 May 23;29(3):516–48. doi: 10.1007/s12528-017-9150-4. [DOI] [Google Scholar]
  • 28.Mittelstadt BD, Allo P, Taddeo M, Wachter S, Floridi L. The ethics of algorithms: mapping the debate. Big Data Soc. 2016 Dec 01;3(2):205395171667967. doi: 10.1177/2053951716679679. [DOI] [Google Scholar]
  • 29.Thaler RH, Sunstein CR. Nudge: The Final Edition. Yale, MI: Yale University Press; 2021. [Google Scholar]
  • 30.Kassianos G, Banerjee A, Baron-Papillon F, Hampson AW, McElhaney JE, McGeer A, Rigoine de Fougerolles T, Rothholz M, Seale H, Tan LJ, Thomson A, Vitoux O. Key policy and programmatic factors to improve influenza vaccination rates based on the experience from four high-performing countries. Drugs Context. 2021 Jan 05;10:1–13. doi: 10.7573/dic.2020-9-5. https://europepmc.org/abstract/MED/33456480 .dic-2020-9-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Mondal P, Sinharoy A, Gope S. The influence of COVID-19 on influenza and respiratory syncytial virus activities. Infect Dis Rep. 2022 Feb 14;14(1):134–41. doi: 10.3390/idr14010017. https://www.mdpi.com/resolver?pii=idr14010017 .idr14010017 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Friedl A, Aegerter C, Saner E, Meier D, Beer JH. An intensive 5-year-long influenza vaccination campaign is effective among doctors but not nurses. Infection. 2012 Feb 29;40(1):57–62. doi: 10.1007/s15010-011-0193-6. [DOI] [PubMed] [Google Scholar]
  • 33.McGinnis JM, Jones R, Hillis C, Kokus H, Thomas H, Thomas J, Alyafi M, Bernard L, Eiriksson LR, Elit LM, Hirte H, Jimenez W, Reade CJ, Kumar Tyagi N, Helpman L. A pneumococcal pneumonia and influenza vaccination quality improvement program for women receiving chemotherapy for gynecologic cancers at a major tertiary cancer Centre. Gynecol Oncol. 2021 Apr;161(1):236–43. doi: 10.1016/j.ygyno.2021.01.014.S0090-8258(21)00061-5 [DOI] [PubMed] [Google Scholar]
  • 34.Ofstead CL, Amelang MR, Wetzler HP, Tan L. Moving the needle on nursing staff influenza vaccination in long-term care: results of an evidence-based intervention. Vaccine. 2017 Apr 25;35(18):2390–5. doi: 10.1016/j.vaccine.2017.03.041.S0264-410X(17)30357-2 [DOI] [PubMed] [Google Scholar]
  • 35.Perlin JB, Septimus EJ, Cormier SB, Moody JA, Hickok JD, Bracken RM. Developing a program to increase seasonal influenza vaccination of healthcare workers: lessons from a system of community hospitals. J Healthc Qual. 2013;35(6):5–15. doi: 10.1111/jhq.12005. [DOI] [PubMed] [Google Scholar]
  • 36.Podczervinski S, Stednick Z, Helbert L, Davies J, Jagels B, Gooley T, Casper C, Pergam SA. Employee influenza vaccination in a large cancer center with high baseline compliance rates: comparison of carrot versus stick approaches. Am J Infect Control. 2015 Mar 01;43(3):228–33. doi: 10.1016/j.ajic.2014.11.025. https://europepmc.org/abstract/MED/25728148 .S0196-6553(14)01368-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 37.Badmus D, Menzies R. Using general practice data to monitor influenza vaccination coverage in the medically at risk: a data linkage study. BMJ Open. 2019 Sep 17;9(9):e031802. doi: 10.1136/bmjopen-2019-031802. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=31530622 .bmjopen-2019-031802 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Frawley JE, McManus K, McIntyre E, Seale H, Sullivan E. Uptake of funded influenza vaccines in young Australian children in 2018; parental characteristics, information seeking and attitudes. Vaccine. 2020 Jan 10;38(2):180–6. doi: 10.1016/j.vaccine.2019.10.033.S0264-410X(19)31406-9 [DOI] [PubMed] [Google Scholar]
  • 39.Isenor JE, O'Reilly BA, Bowles SK. Evaluation of the impact of immunization policies, including the addition of pharmacists as immunizers, on influenza vaccination coverage in Nova Scotia, Canada: 2006 to 2016. BMC Public Health. 2018 Jun 26;18(1):787. doi: 10.1186/s12889-018-5697-x. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-018-5697-x .10.1186/s12889-018-5697-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Rajaram S, Steffey A, Blak B, Hickman M, Christensen H, Caspard H. Uptake of childhood influenza vaccine from 2012-2013 to 2014-2015 in the UK and the implications for high-risk children: a retrospective observational cohort study. BMJ Open. 2016 Aug 01;6(8):e010625. doi: 10.1136/bmjopen-2015-010625. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=27481618 .bmjopen-2015-010625 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 41.Baxter D. Approaches to the vaccination of pregnant women: experience from Stockport, UK, with prenatal influenza. Hum Vaccin Immunother. 2013 Jun 03;9(6):1360–3. doi: 10.4161/hv.25525. https://europepmc.org/abstract/MED/23857270 .25525 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 42.Borgey F, Henry L, Lebeltel J, Lescure P, Le Coutour X, Vabret A, Verdon R, Thibon P. Effectiveness of an intervention campaign on influenza vaccination of professionals in nursing homes: a cluster-randomized controlled trial. Vaccine. 2019 Feb 28;37(10):1260–5. doi: 10.1016/j.vaccine.2019.01.066.S0264-410X(19)30151-3 [DOI] [PubMed] [Google Scholar]
  • 43.Gargano LM, Pazol K, Sales JM, Painter JE, Morfaw C, Jones LM, Weiss P, Buehler JW, Murray DL, Wingood GM, Orenstein WA, DiClemente RJ, Hughes JM. Multicomponent interventions to enhance influenza vaccine delivery to adolescents. Pediatrics. 2011 Nov;128(5):e1092–9. doi: 10.1542/peds.2011-0453. https://europepmc.org/abstract/MED/21987709 .peds.2011-0453 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Jiménez-García R, Rodríguez-Rieiro C, Hernández-Barrera V, Lopez de Andres A, Rivero Cuadrado A, Rodriguez Laso A, Carrasco-Garrido P. Effectiveness of age-based strategies to increase influenza vaccination coverage among high risk subjects in Madrid (Spain) Vaccine. 2011 Apr 05;29(16):2840–5. doi: 10.1016/j.vaccine.2011.02.004.S0264-410X(11)00205-2 [DOI] [PubMed] [Google Scholar]
  • 45.Jiménez-García R, Herńndez-Barrera V, Rodríguez-Rieiro C, de Andrés AL, Miguel-Diez JD, Trujillo IJ, Carrasco-Garrido P. Are age-based strategies effective in increasing influenza vaccination coverage?: the Spanish experience. Hum Vaccin Immunother. 2012 Feb 27;8(2):228–33. doi: 10.4161/hv.18433.18433 [DOI] [PubMed] [Google Scholar]
  • 46.Lin CJ, Nowalk MP, Zimmerman RK. Estimated costs associated with improving influenza vaccination for health care personnel in a multihospital health system. Jt Comm J Qual Patient Saf. 2012 Feb;38(2):67–72. doi: 10.1016/s1553-7250(12)38009-4.S1553-7250(12)38009-4 [DOI] [PubMed] [Google Scholar]
  • 47.Llupià A, Mena G, Olivé V, Quesada S, Aldea M, Sequera VG, Ríos J, García-Basteiro AL, Varela P, Bayas JM, Trilla A. Evaluating influenza vaccination campaigns beyond coverage: a before-after study among health care workers. Am J Infect Control. 2013 Aug;41(8):674–8. doi: 10.1016/j.ajic.2013.04.006.S0196-6553(13)00847-X [DOI] [PubMed] [Google Scholar]
  • 48.Mustafa M, Al-Khal A, Al Maslamani M, Al Soub H. Improving influenza vaccination rates of healthcare workers: a multipronged approach in Qatar. East Mediterr Health J. 2017 Jun 14;23(4):303–10. doi: 10.26719/2017.23.4.303. http://applications.emro.who.int/EMHJ/v23/04/EMHJ_2017_23_04_303_310.pdf . [DOI] [PubMed] [Google Scholar]
  • 49.Honda H, Sato Y, Yamazaki A, Padival S, Kumagai A, Babcock H. A successful strategy for increasing the influenza vaccination rate of healthcare workers without a mandatory policy outside of the United States: a multifaceted intervention in a Japanese tertiary care center. Infect Control Hosp Epidemiol. 2013 Nov 02;34(11):1194–200. doi: 10.1086/673452.S0195941700034226 [DOI] [PubMed] [Google Scholar]
  • 50.Lin CJ, Nowalk MP, Raymund M, Sweeney PM, Zimmerman RK. Association of state laws and healthcare workers' influenza vaccination rates. J Natl Med Assoc. 2016 Feb;108(1):99–102. doi: 10.1016/j.jnma.2015.12.013.S0027-9684(15)00014-0 [DOI] [PubMed] [Google Scholar]
  • 51.McAuliffe K, Peddecord KM, Wang W, Ralston K, Deguire M, Waters-Montijo K, Sawyer MH. Influenza vaccination and its association with clinic use of evidence-based practices and individual patient characteristics, San Diego County, 2009. J Public Health Manag Pract. 2013;19(2):178–86. doi: 10.1097/PHH.0b013e318259e735.00124784-201303000-00011 [DOI] [PubMed] [Google Scholar]
  • 52.Tielsch Goddard A, Borkowski V, Konesky A, Bennhoff A. Taking action on asthma: increasing influenza vaccination rates in pediatric asthma through quality improvement. J Pediatr Health Care. 2019 Nov;33(6):653–62. doi: 10.1016/j.pedhc.2019.04.016.S0891-5245(19)30061-6 [DOI] [PubMed] [Google Scholar]
  • 53.Drees M, Wroten K, Smedley M, Mase T, Schwartz JS. Carrots and sticks: achieving high healthcare personnel influenza vaccination rates without a mandate. Infect Control Hosp Epidemiol. 2015 Jun 27;36(6):717–24. doi: 10.1017/ice.2015.47.S0899823X15000471 [DOI] [PubMed] [Google Scholar]
  • 54.Wilsdon T, Lawlor R, Li L, Rafila A, García Rojas A. The impact of vaccine procurement methods on public health in selected European countries. Expert Rev Vaccines. 2020 Feb 28;19(2):123–32. doi: 10.1080/14760584.2020.1717952. [DOI] [PubMed] [Google Scholar]
  • 55.Maffeo M, Luconi E, Castrofino A, Campagnoli EM, Cinnirella A, Fornaro F, Gallana C, Perrone PM, Shishmintseva V, Pariani E, Castaldi S. 2019 Influenza vaccination campaign in an Italian research and teaching hospital: analysis of the reasons for its failure. Int J Environ Res Public Health. 2020 May 30;17(11):3881. doi: 10.3390/ijerph17113881. https://air.unimi.it/handle/2434/750097 .ijerph17113881 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Oguz MM. Improving influenza vaccination uptake among healthcare workers by on-site influenza vaccination campaign in a tertiary children hospital. Hum Vaccin Immunother. 2019 Mar 19;15(5):1060–5. doi: 10.1080/21645515.2019.1575164. https://europepmc.org/abstract/MED/30735439 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 57.Vimercati L, Bianchi FP, Mansi F, Ranieri B, Stefanizzi P, de Nitto S, Tafuri S. Influenza vaccination in health-care workers: an evaluation of an on-site vaccination strategy to increase vaccination uptake in HCWs of a South Italy Hospital. Hum Vaccin Immunother. 2019 Jul 25;15(12):2927–32. doi: 10.1080/21645515.2019.1625645. https://europepmc.org/abstract/MED/31157586 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Huth K, Benchimol EI, Aglipay M, Mack DR. Strategies to improve influenza vaccination in pediatric inflammatory bowel disease through education and access. Inflamm Bowel Dis. 2015 Aug;21(8):1761–8. doi: 10.1097/MIB.0000000000000425.00054725-201508000-00005 [DOI] [PubMed] [Google Scholar]
  • 59.Atkins K, van Hoek AJ, Watson C, Baguelin M, Choga L, Patel A, Raj T, Jit M, Griffiths U. Seasonal influenza vaccination delivery through community pharmacists in England: evaluation of the London pilot. BMJ Open. 2016 Feb 16;6(2):e009739. doi: 10.1136/bmjopen-2015-009739. https://bmjopen.bmj.com/lookup/pmidlookup?view=long&pmid=26883237 .bmjopen-2015-009739 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Buchan SA, Rosella LC, Finkelstein M, Juurlink D, Isenor J, Marra F, Patel A, Russell ML, Quach S, Waite N, Kwong JC, Public Health Agency of Canada/Canadian Institutes of Health Research Influenza Research Network (PCIRN) Program DeliveryEvaluation Group Impact of pharmacist administration of influenza vaccines on uptake in Canada. CMAJ. 2017 Jan 30;189(4):E146–52. doi: 10.1503/cmaj.151027. http://www.cmaj.ca/cgi/pmidlookup?view=long&pmid=27503864 .cmaj.151027 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Drozd EM, Miller L, Johnsrud M. Impact of pharmacist immunization authority on seasonal influenza immunization rates across states. Clin Ther. 2017 Aug;39(8):1563–80.e17. doi: 10.1016/j.clinthera.2017.07.004. https://linkinghub.elsevier.com/retrieve/pii/S0149-2918(17)30771-3 .S0149-2918(17)30771-3 [DOI] [PubMed] [Google Scholar]
  • 62.Isenor JE, Alia TA, Killen JL, Billard BA, Halperin BA, Slayter KL, McNeil SA, MacDougall D, Bowles SK. Impact of pharmacists as immunizers on influenza vaccination coverage in Nova Scotia, Canada. Hum Vaccin Immunother. 2016 May 03;12(5):1225–8. doi: 10.1080/21645515.2015.1127490. https://europepmc.org/abstract/MED/26863888 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 63.Benjamin-Chung J, Arnold BF, Kennedy CJ, Mishra K, Pokpongkiat N, Nguyen A, Jilek W, Holbrook K, Pan E, Kirley PD, Libby T, Hubbard AE, Reingold A, Colford JM. Evaluation of a city-wide school-located influenza vaccination program in Oakland, California, with respect to vaccination coverage, school absences, and laboratory-confirmed influenza: a matched cohort study. PLoS Med. 2020 Aug 18;17(8):e1003238. doi: 10.1371/journal.pmed.1003238. https://dx.plos.org/10.1371/journal.pmed.1003238 .PMEDICINE-D-19-04321 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Calder K, Bidwell S, Brunton C, Pink R. Evaluation of the Canterbury under-18 seasonal influenza vaccination programme. N Z Med J. 2014 Jul 18;127(1398):19–27. [PubMed] [Google Scholar]
  • 65.Frisina PG, Ingraffia ST, Brown TR, Munene EN, Pletcher JR, Kolligian J. Increasing influenza immunization rates among healthcare providers in an ambulatory-based, university healthcare setting☆. Int J Qual Health Care. 2019 Nov 30;31(9):698–703. doi: 10.1093/intqhc/mzy247.5281151 [DOI] [PubMed] [Google Scholar]
  • 66.Kawai S, Nanri S, Ban E, Inokuchi M, Tanaka T, Tokumura M, Kimura K, Sugaya N. Influenza vaccination of schoolchildren and influenza outbreaks in a school. Clin Infect Dis. 2011 Jul 15;53(2):130–6. doi: 10.1093/cid/cir336.cir336 [DOI] [PubMed] [Google Scholar]
  • 67.Pannaraj PS, Wang HL, Rivas H, Wiryawan H, Smit M, Green N, Aldrovandi GM, El Amin AN, Mascola L. School-located influenza vaccination decreases laboratory-confirmed influenza and improves school attendance. Clin Infect Dis. 2014 Aug 01;59(3):325–32. doi: 10.1093/cid/ciu340. https://europepmc.org/abstract/MED/24829215 .cid/ciu340 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 68.Squeri R, Riso R, Facciolà A, Genovese C, Palamara MA, Ceccio C, La Fauci V. Management of two influenza vaccination campaign in health care workers of a university hospital in the South Italy. Ann Ig. 2017;29(3):223–31. doi: 10.7416/ai.2017.2150. http://www.seu-roma.it/riviste/annali_igiene/open_access/articoli/8cbc09015573e65c9ffbe6b95b081027.pdf . [DOI] [PubMed] [Google Scholar]
  • 69.Szilagyi PG, Schaffer S, Rand CM, Goldstein NP, Vincelli P, Hightower AD, Younge M, Eagan A, Blumkin A, Albertin CS, DiBitetto K, Yoo B, Humiston SG. School-located influenza vaccinations for adolescents: a randomized controlled trial. J Adolesc Health. 2018 Feb;62(2):157–63. doi: 10.1016/j.jadohealth.2017.09.021.S1054-139X(17)30488-3 [DOI] [PubMed] [Google Scholar]
  • 70.Szilagyi PG, Schaffer S, Rand CM, Goldstein NP, Hightower AD, Younge M, Eagan A, Blumkin A, Albertin CS, DiBitetto K, Concannon C, Vincelli P, Yoo B, Humiston SG. Impact of elementary school-located influenza vaccinations: a stepped wedge trial across a community. Vaccine. 2018 May 11;36(20):2861–9. doi: 10.1016/j.vaccine.2018.03.047.S0264-410X(18)30403-1 [DOI] [PubMed] [Google Scholar]
  • 71.Heinrich-Morrison K, McLellan S, McGinnes U, Carroll B, Watson K, Bass P, Worth LJ, Cheng AC. An effective strategy for influenza vaccination of healthcare workers in Australia: experience at a large health service without a mandatory policy. BMC Infect Dis. 2015 Feb 06;15(1):42. doi: 10.1186/s12879-015-0765-7. https://bmcinfectdis.biomedcentral.com/articles/10.1186/s12879-015-0765-7 .s12879-015-0765-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Barbara A, Mariani M, de Waure C, Anzelmo V, Piccoli B, Cambieri A, Damiani G, Ricciardi W, Laurenti P. A campaign aimed at increasing seasonal influenza vaccination coverage among post graduate medical residents in an Italian teaching hospital. Hum Vaccin Immunother. 2019 Jan 16;15(4):967–72. doi: 10.1080/21645515.2018.1556076. https://europepmc.org/abstract/MED/30543134 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Lehmann BA, Chapman GB, Franssen FM, Kok G, Ruiter RA. Changing the default to promote influenza vaccination among health care workers. Vaccine. 2016 Mar 08;34(11):1389–92. doi: 10.1016/j.vaccine.2016.01.046. https://linkinghub.elsevier.com/retrieve/pii/S0264-410X(16)00098-0 .S0264-410X(16)00098-0 [DOI] [PubMed] [Google Scholar]
  • 74.Nehme EK, Delphia M, Cha EM, Thomas M, Lakey D. Promoting influenza vaccination among an ACA health plan subscriber population: a randomized trial. Am J Health Promot. 2019 Jul;33(6):916–20. doi: 10.1177/0890117118823157. [DOI] [PubMed] [Google Scholar]
  • 75.Bianchi FP, Rizzo LA, de Nitto S, Stefanizzi P, Tafuri S. Influenza vaccination coverage among splenectomized patients: an Italian study on the role of active recall in the vaccination compliance. Hum Vaccin Immunother. 2019 May 07;15(11):2644–9. doi: 10.1080/21645515.2019.1599678. https://europepmc.org/abstract/MED/31063019 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 76.Hofstetter AM, Vargas CY, Camargo S, Holleran S, Vawdrey DK, Kharbanda EO, Stockwell MS. Impacting delayed pediatric influenza vaccination: a randomized controlled trial of text message reminders. Am J Prev Med. 2015 Apr;48(4):392–401. doi: 10.1016/j.amepre.2014.10.023.S0749-3797(14)00628-X [DOI] [PubMed] [Google Scholar]
  • 77.Kaufman J, Attwell K, Tuckerman J, O'Sullivan J, Omer SB, Leask J, Regan A, Marshall H, Lee KJ, Snelling T, Perrett K, Wiley K, Giles ML, Danchin M. Feasibility and acceptability of the multi-component P3-MumBubVax antenatal intervention to promote maternal and childhood vaccination: a pilot study. Vaccine. 2020 May 19;38(24):4024–31. doi: 10.1016/j.vaccine.2020.04.010.S0264-410X(20)30469-2 [DOI] [PubMed] [Google Scholar]
  • 78.Regan AK, Bloomfield L, Peters I, Effler PV. Randomized controlled trial of text message reminders for increasing influenza vaccination. Ann Fam Med. 2017 Nov;15(6):507–14. doi: 10.1370/afm.2120. http://www.annfammed.org/cgi/pmidlookup?view=long&pmid=29133488 .15/6/507 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Stockwell MS, Kharbanda EO, Martinez RA, Vargas CY, Vawdrey DK, Camargo S. Effect of a text messaging intervention on influenza vaccination in an urban, low-income pediatric and adolescent population: a randomized controlled trial. JAMA. 2012 Apr 25;307(16):1702–8. doi: 10.1001/jama.2012.502.307/16/1702 [DOI] [PubMed] [Google Scholar]
  • 80.Yeung KH, Tarrant M, Chan KC, Tam WH, Nelson EA. Increasing influenza vaccine uptake in children: a randomised controlled trial. Vaccine. 2018 Sep 05;36(37):5524–35. doi: 10.1016/j.vaccine.2018.07.066. https://linkinghub.elsevier.com/retrieve/pii/S0264-410X(18)31075-2 .S0264-410X(18)31075-2 [DOI] [PubMed] [Google Scholar]
  • 81.Yudin MH, Mistry N, de Souza LR, Besel K, Patel V, Blanco Mejia S, Bernick R, Ryan V, Urquia M, Beigi RH, Moniz MH, Sgro M. Text messages for influenza vaccination among pregnant women: a randomized controlled trial. Vaccine. 2017 Feb 01;35(5):842–8. doi: 10.1016/j.vaccine.2016.12.002.S0264-410X(16)31195-1 [DOI] [PubMed] [Google Scholar]
  • 82.Schmidtke KA, Nightingale PG, Reeves K, Gallier S, Vlaev I, Watson SI, Lilford RJ. Randomised controlled trial of a theory-based intervention to prompt front-line staff to take up the seasonal influenza vaccine. BMJ Qual Saf. 2020 Mar 05;29(3):189–97. doi: 10.1136/bmjqs-2019-009775. http://qualitysafety.bmj.com/lookup/pmidlookup?view=long&pmid=31383723 .bmjqs-2019-009775 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 83.Gattis S, Yildirim I, Shane AL, Serluco S, McCracken C, Liverman R. Impact of pharmacy-initiated interventions on influenza vaccination rates in pediatric solid organ transplant recipients. J Pediatric Infect Dis Soc. 2019 Dec 27;8(6):525–30. doi: 10.1093/jpids/piy095.5126776 [DOI] [PubMed] [Google Scholar]
  • 84.Humiston SG, Bennett NM, Long C, Eberly S, Arvelo L, Stankaitis J, Szilagyi PG. Increasing inner-city adult influenza vaccination rates: a randomized controlled trial. Public Health Rep. 2011 Jul 01;126 Suppl 2(Suppl 2):39–47. doi: 10.1177/00333549111260S206. https://europepmc.org/abstract/MED/21812168 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 85.Hurley LP, Beaty B, Lockhart S, Gurfinkel D, Breslin K, Dickinson M, Whittington MD, Roth H, Kempe A. RCT of centralized vaccine reminder/recall for adults. Am J Prev Med. 2018 Aug;55(2):231–9. doi: 10.1016/j.amepre.2018.04.022.S0749-3797(18)31705-7 [DOI] [PubMed] [Google Scholar]
  • 86.Kamali T, Foo C, OYong K, Terashita D. Influenza vaccination coverage of health care personnel in Los Angeles County Hospitals, 2016–2017. Am J Public Health. 2020 May;110(5):693–5. doi: 10.2105/ajph.2019.305555. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 87.Nowalk MP, Lin CJ, Hannibal K, Reis EC, Gallik G, Moehling KK, Huang H, Allred NJ, Wolfson DH, Zimmerman RK. Increasing childhood influenza vaccination: a cluster randomized trial. Am J Prev Med. 2014 Oct;47(4):435–43. doi: 10.1016/j.amepre.2014.07.003. https://europepmc.org/abstract/MED/25113138 .S0749-3797(14)00329-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 88.Nowalk MP, Moehling KK, Zhang S, Raviotta JM, Zimmerman RK, Lin CJ. Using the 4 Pillars to increase vaccination among high-risk adults: who benefits? Am J Manag Care. 2017 Nov;23(11):651–5. https://www.ajmc.com/pubMed.php?pii=87314 .87314 [PMC free article] [PubMed] [Google Scholar]
  • 89.Zimmerman RK, Nowalk MP, Lin CJ, Hannibal K, Moehling KK, Huang H, Matambanadzo A, Troy J, Allred NJ, Gallik G, Reis EC. Cluster randomized trial of a toolkit and early vaccine delivery to improve childhood influenza vaccination rates in primary care. Vaccine. 2014 Jun 17;32(29):3656–63. doi: 10.1016/j.vaccine.2014.04.057. https://europepmc.org/abstract/MED/24793941 .S0264-410X(14)00595-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 90.Costantino C, Restivo V, Gaglio V, Lanza GL, Marotta C, Maida CM, Mazzucco W, Casuccio A, Torregrossa MV, Vitale F. Effectiveness of an educational intervention on seasonal influenza vaccination campaign adherence among healthcare workers of the Palermo University Hospital, Italy. Ann Ig. 2019;31(1):35–44. doi: 10.7416/ai.2019.2256. http://www.seu-roma.it/riviste/annali_igiene/open_access/articoli/31-01-04-Costantino.pdf . [DOI] [PubMed] [Google Scholar]
  • 91.Lin CJ, Nowalk MP, Zimmerman RK, Moehling KK, Conti T, Allred NJ, Reis EC. Reducing racial disparities in influenza vaccination among children with asthma. J Pediatr Health Care. 2016 May;30(3):208–15. doi: 10.1016/j.pedhc.2015.06.006. https://europepmc.org/abstract/MED/26254743 .S0891-5245(15)00221-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 92.O'Leary ST, Pyrzanowski J, Brewer SE, Sevick C, Miriam Dickinson L, Dempsey AF. Effectiveness of a multimodal intervention to increase vaccination in obstetrics/gynecology settings. Vaccine. 2019 Jun 06;37(26):3409–18. doi: 10.1016/j.vaccine.2019.05.034.S0264-410X(19)30658-9 [DOI] [PubMed] [Google Scholar]
  • 93.Riphagen-Dalhuisen J, Burgerhof JG, Frijstein G, van der Geest-Blankert AD, Danhof-Pont MB, de Jager HJ, Bos AA, Smeets EE, de Vries MJ, Gallee PM, Hak E. Hospital-based cluster randomised controlled trial to assess effects of a multi-faceted programme on influenza vaccine coverage among hospital healthcare workers and nosocomial influenza in the Netherlands, 2009 to 2011. Euro Surveill. 2013 Jun 27;18(26):20512. doi: 10.2807/1560-7917.es2013.18.26.20512. http://www.eurosurveillance.org/ViewArticle.aspx?ArticleId=20512 .20512 [DOI] [PubMed] [Google Scholar]
  • 94.Guanche Gacell H, Villanueva Arias A, Guilarte García E, Rubiera Jiménez R, Nonato Alfonso R. A successful strategy for improving the influenza immunization rates of health care workers without a mandatory policy. Int J Occup Environ Med. 2015 Jul 01;6(3):184–6. doi: 10.15171/ijoem.2015.595. https://europepmc.org/abstract/MED/26174995 .595 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 95.Norbury M, Fawkes N, Guthrie B. Impact of the GP contract on inequalities associated with influenza immunisation: a retrospective population-database analysis. Br J Gen Pract. 2011 Jul 01;61(588):e379–85. doi: 10.3399/bjgp11x583146. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 96.Edwards F, Masick KD, Armellino D. Impact of the flu mask regulation on health care personnel influenza vaccine acceptance rates. Am J Infect Control. 2016 Oct 01;44(10):1154–7. doi: 10.1016/j.ajic.2016.03.006.S0196-6553(16)00230-3 [DOI] [PubMed] [Google Scholar]
  • 97.Huynh S, Poduska P, Mallozzi T, Culler F. Mandatory influenza vaccination of health care workers: a first-year success implementation by a community health care system. Am J Infect Control. 2012 Oct;40(8):771–3. doi: 10.1016/j.ajic.2011.10.011.S0196-6553(11)01265-X [DOI] [PubMed] [Google Scholar]
  • 98.Kim H, Lindley MC, Dube D, Kalayil EJ, Paiva KA, Raymond P. Evaluation of the impact of the 2012 Rhode Island health care worker influenza vaccination regulations: implementation process and vaccination coverage. J Public Health Manag Pract. 2015;21(3):E1–9. doi: 10.1097/PHH.0000000000000128. https://europepmc.org/abstract/MED/25105280 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 99.Ksienski DS. Mandatory seasonal influenza vaccination or masking of British Columbia health care workers: year 1. Can J Public Health. 2014 Jul 11;105(4):e312–6. doi: 10.17269/cjph.105.4346. https://europepmc.org/abstract/MED/25166135 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 100.LaVela SL, Hill JN, Smith BM, Evans CT, Goldstein B, Martinello R. Healthcare worker influenza declination form program. Am J Infect Control. 2015 Jun;43(6):624–8. doi: 10.1016/j.ajic.2015.02.013.S0196-6553(15)00109-1 [DOI] [PubMed] [Google Scholar]
  • 101.Leibu R, Maslow J. Effectiveness and acceptance of a health care-based mandatory vaccination program. J Occup Environ Med. 2015 Jan;57(1):58–61. doi: 10.1097/JOM.0000000000000294.00043764-201501000-00008 [DOI] [PubMed] [Google Scholar]
  • 102.Miller BL, Ahmed F, Lindley MC, Wortley PM. Increases in vaccination coverage of healthcare personnel following institutional requirements for influenza vaccination: a national survey of U.S. hospitals. Vaccine. 2011 Nov 21;29(50):9398–403. doi: 10.1016/j.vaccine.2011.09.047.S0264-410X(11)01453-8 [DOI] [PubMed] [Google Scholar]
  • 103.Hämäläinen A, Patovirta RL, Mauranen E, Hämäläinen S, Koivula I. Support among healthcare workers for the new mandatory seasonal influenza vaccination policy and its effects on vaccination coverage. Ann Med. 2021 Dec 22;53(1):384–90. doi: 10.1080/07853890.2021.1889022. https://www.tandfonline.com/doi/full/10.1080/07853890.2021.1889022 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 104.Kitt E, Burt S, Price SM, Satchell L, Offit PA, Sammons JS, Coffin SE. Implementation of a mandatory influenza vaccine policy: a 10-year experience. Clin Infect Dis. 2021 Jul 15;73(2):e290–6. doi: 10.1093/cid/ciaa782.5858929 [DOI] [PubMed] [Google Scholar]
  • 105.Costantino C, Restivo V, Tramuto F, Casuccio A, Vitale F. Influenza vaccination of healthcare workers in Italy: could mandatory vaccination be a solution to protect patients? Future Microbiol. 2019 Jun;14:45–9. doi: 10.2217/fmb-2018-0238. [DOI] [PubMed] [Google Scholar]
  • 106.Harris KM, Uscher-Pines L, Han B, Lindley MC, Lorick SA. The impact of influenza vaccination requirements for hospital personnel in California: knowledge, attitudes, and vaccine uptake. Am J Infect Control. 2014 Mar;42(3):288–93. doi: 10.1016/j.ajic.2013.09.030.S0196-6553(13)01315-1 [DOI] [PubMed] [Google Scholar]
  • 107.Ho HJ, Tan Y, Cook AR, Koh G, Tham TY, Anwar E, Hui Chiang GS, Lwin MO, Chen MI. Increasing influenza and pneumococcal vaccination uptake in seniors using point-of-care informational interventions in primary care in Singapore: a pragmatic, cluster-randomized crossover trial. Am J Public Health. 2019 Dec;109(12):1776–83. doi: 10.2105/AJPH.2019.305328. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 108.Lanoix JP, El Samad Y, Schmit JL, Legrain A, Joseph C, Smail A, Douadi C, Adjidé C, Merlin-Brochart J, Couvreur V. Effect of motivational team on influenza vaccination coverage among health care workers. Infect Dis (Lond) 2019 Apr 24;51(4):302–4. doi: 10.1080/23744235.2018.1548774. [DOI] [PubMed] [Google Scholar]
  • 109.Roca B, Herrero E, Resino E, Torres V, Penades M, Andreu C. Impact of education program on influenza vaccination rates in Spain. Am J Manag Care. 2012 Dec 01;18(12):e446–52. https://www.ajmc.com/pubMed.php?pii=88990 .88990 [PubMed] [Google Scholar]
  • 110.Wong VW, Fong DY, Lok KY, Wong JY, Sing C, Choi AY, Yuen CY, Tarrant M. Brief education to promote maternal influenza vaccine uptake: a randomized controlled trial. Vaccine. 2016 Oct 17;34(44):5243–50. doi: 10.1016/j.vaccine.2016.09.019.S0264-410X(16)30832-5 [DOI] [PubMed] [Google Scholar]
  • 111.Conte A, Quattrin R, Filiputti E, Cocconi R, Arnoldo L, Tricarico P, Delendi M, Brusaferro S. Promotion of flu vaccination among healthcare workers in an Italian academic hospital: an experience with tailored web tools. Hum Vaccin Immunother. 2016 Oct 02;12(10):2628–33. doi: 10.1080/21645515.2016.1186319. https://europepmc.org/abstract/MED/27245587 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 112.Cozza V, Alfonsi V, Rota MC, Paolini V, Ciofi degli Atti ML. Promotion of influenza vaccination among health care workers: findings from a tertiary care children's hospital in Italy. BMC Public Health. 2015 Jul 24;15(1):697. doi: 10.1186/s12889-015-2067-9. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-015-2067-9 .10.1186/s12889-015-2067-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Li A, Chan YH, Liew MF, Pandey R, Phua J. Improving influenza vaccination coverage among patients with COPD: a pilot project. Int J Chron Obstruct Pulmon Dis. 2019;14:2527–33. doi: 10.2147/COPD.S222524. https://europepmc.org/abstract/MED/31814718 .222524 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 114.Venci DP, Slain D, Elswick BM, Sarwari AR, Ross AL, Smithmyer A, Hare JT, Briggs F. Inclusion of social media-based strategies in a health care worker influenza immunization campaign. Am J Infect Control. 2015 Aug;43(8):902–3. doi: 10.1016/j.ajic.2015.04.185.S0196-6553(15)00428-9 [DOI] [PubMed] [Google Scholar]
  • 115.Frew PM, Saint-Victor DS, Owens LE, Omer SB. Socioecological and message framing factors influencing maternal influenza immunization among minority women. Vaccine. 2014 Mar 26;32(15):1736–44. doi: 10.1016/j.vaccine.2014.01.030.S0264-410X(14)00062-0 [DOI] [PubMed] [Google Scholar]
  • 116.Frew PM, Kriss JL, Chamberlain AT, Malik F, Chung Y, Cortés M, Omer SB. A randomized trial of maternal influenza immunization decision-making: a test of persuasive messaging models. Hum Vaccin Immunother. 2016 Aug 02;12(8):1989–96. doi: 10.1080/21645515.2016.1199309. https://europepmc.org/abstract/MED/27322154 . [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 117.Oakley S, Bouchet J, Costello P, Parker J. Influenza vaccine uptake among at-risk adults (aged 16-64 years) in the UK: a retrospective database analysis. BMC Public Health. 2021 Sep 24;21(1):1734. doi: 10.1186/s12889-021-11736-2. https://bmcpublichealth.biomedcentral.com/articles/10.1186/s12889-021-11736-2 .10.1186/s12889-021-11736-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 118.Home page. Let's Control Flu. [2024-03-08]. https://letscontrolflu.com/
  • 119.Schmid P, Rauber D, Betsch C, Lidolt G, Denker ML. Barriers of influenza vaccination intention and behavior - a systematic review of influenza vaccine hesitancy, 2005 - 2016. PLoS One. 2017 Jan 26;12(1):e0170550. doi: 10.1371/journal.pone.0170550. https://dx.plos.org/10.1371/journal.pone.0170550 .PONE-D-16-43780 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 120.Peters MD. Addressing vaccine hesitancy and resistance for COVID-19 vaccines. Int J Nurs Stud. 2022 Jul;131:104241. doi: 10.1016/j.ijnurstu.2022.104241. https://europepmc.org/abstract/MED/35489108 .S0020-7489(22)00070-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 121.Dubé È, Ward JK, Verger P, MacDonald NE. Vaccine hesitancy, acceptance, and anti-vaccination: trends and future prospects for public health. Annu Rev Public Health. 2021 Apr 01;42:175–91. doi: 10.1146/annurev-publhealth-090419-102240. https://www.annualreviews.org/content/journals/10.1146/annurev-publhealth-090419-102240?crawler=true&mimetype=application/pdf . [DOI] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Multimedia Appendix 1

Public health policies of the “Let’s Control Flu” model, organized by Pillar, based on the study by Kassianos et al.


Articles from JMIR Research Protocols are provided here courtesy of JMIR Publications Inc.

RESOURCES