Abstract
Introduction:
The emergence of the COVID-19 pandemic has had significant impact on human lives as well as economic and social stability. The United States has a complicated history with biosecurity as policy making, biodefense activities, and government transparency have historically been in contention. The terror attacks of September 11, 2001 uncovered various weaknesses in the national public health infrastructure that have persisted into the current pandemic.
Methods:
This study explores the biodefense and public health preparedness landscape for trends in federal support and capacity building. It also investigates the applicability of public health emergency management principles to the biodefense structure. A mixed method was utilized in this study to investigate the qualitative and quantitative factors of the research inquiry. Braun and Clarke’s six phase framework for thematic analysis will assist with defining the important information from a review of the literature. The concurrent triangulation design permits that use of qualitative and quantitative data to more accurately define and analyze the relationship among the variables of interest
Results:
The results included the identification of 8 common themes of failure during the COVID-19 response: (1) accountable leadership, (2) statutory authorities and policies, (3) inter-agency coordination, (4) coherent data system for situational awareness, (5) strategic national stockpile and supply chain, (6) testing and surveillance, (7) health care system surge capacity and resilience, and (8) federal funds and the role of public health emergency management in the evolving landscape of biothreats, both intentional and natural.
Discussion:
To counter the increasing biothreats, the United States must invest in revamping the biodefense infrastructure to mimic and support public health emergency preparedness initiatives which will increase our resilience to various biothreats.
Keywords: occupational health, emergency medicine, policy, resilience
“No. Not at all. And we have it totally under control. It’s 1 person coming in from China, and we have it under control. It’s - going to be just fine.” On January 22, 2020, President Trump responded to a question from the press if there was cause to worry about a pandemic following the emergence of SARS-CoV-2 in China. 1 What emerged was a deadly pandemic that had significant impact on human lives as well as economic and social stability. 2 Coronavirus Disease 2019 (COVID-19) emerged in Wuhan, China in late 2019 and spread throughout the world. 3 The interconnectivity of the world and the expansion of borders with international interdependence has led to an increase in easy world travel that made the spread of COVID-19 a global threat. Within 3 weeks, infections had begun to spread throughout Asia, Europe, and North America. 4 A limited diversity of supply chains for personal protective equipment and components to support adequate testing further damaged a successful containment and response to the virus. 5 The world has been at war with the novel coronavirus throughout the year 2020 and into the middle of 2021, with the pandemic continuing to linger. The missteps of top government leaders downplaying or covered up the crisis in the beginning allowed the pandemic to spread easily without any sophisticated mitigation measures. 6 The vulnerabilities of our biodefense structure were highlighted by 2 major failures: (i) the Chinese government not alerting the world on time, and not quickly supplying diagnostic data, infection statistics, and access to the World Health Organization (WHO), and (ii) the United States government not taking timely mitigation action and employing early testing. This led to 34.4 million cases and 610,000 deaths in the United States as of July, 2021. 6
The United States has a complicated history with biosecurity as policymaking, biodefense activities, and government transparency have historically been in contention. 7 The terror attacks of September 11, 2001 uncovered various weaknesses in the national public health infrastructure that have persisted into the current pandemic. The anthrax attacks which soon followed were the first domestic occurrences of bioterrorism and exposed additional deficiencies in the local, state, and federal response capabilities. Since only minor investments were made during the late 1900s into public health preparedness, awareness was only beginning to grow about the threats of emerging and reemerging infectious diseases along with the concerns about the intelligence about an extensive Soviet bioweapons program. 8,9
Common themes in response gaps can be discovered by identifying, analyzing, and comparing the stated objectives, response focus and outcomes of the spread of COVID-19 within the United States. These themes can be compared to the goals and advancements of public health preparedness and the current biodefense structure, and can then be used to highlight the gaps that led to the significant impacts of the COVID-19 pandemic. Comparing the gaps in our preparedness for a novel event such as SARS-CoV-2 to the principles of public health emergency management can provide a platform through which we can discuss how public health emergency management is crucial to biodefense capacity building.
Key terms and concepts
Biodefense is any “action designed to counter biological threats, reduce risks, prepare for, respond to and recover from bioincidents.” 10 These actions include a wide variety of activities such as bio-surveillance, threat monitoring and awareness, biological arms control and nonproliferation, counterterrorism, biosafety, and biosecurity, the development of medical countermeasures, medical planning and preparedness, and response and recovery activities. 9 The coordination of these activities across the federal government is outlined in the National Biodefense Strategy which calls upon the 4 vital national interests from the National Security Strategy, 2017 of “protecting the homeland, the American people and the American way of life, promoting American prosperity, preserving peace through strength, and advancing American influence.” 10
Similarly, biosecurity is the strategic and integrated approach to analyzing and managing relevant risks to human, animal, and plant life and health, and associated risks for the environment. 11 This focuses on the critical link that exists within different sectors, and the potential for hazards to move within and between sectors, with system-wide consequences. The goal is to prevent, control, and manage the risks to life and health in a similar scenario as the biodefense landscape.
Biodefense landscape within the United States
The 1990s brought an increased focus on combating biothreats amid proliferating fears of novel diseases and bioterrorism. The United States’ defense planners began to conceptualize a public health infrastructure that was a bulwark of national security. The established goal to counter bioterrorism required a strategy of public health surveillance, but the traditional policies and methods of countering the proliferation and deterrence of biological weapons became ineffective against the proliferation of nonstate actors and individuals. 12 A surveillance system, meant to operate within the public health infrastructure, was designed to detect outbreaks, coordinate ameliorative responses and geographically locate release points for law enforcement. 12 A dual use strategy was then suggested such that preparations for a biological attack could serve to enhance other public health activities. 12 Syndromic surveillance was the functional apparatus that was turned from a local health department initiative to detect unexpected or unusual outbreaks of diseases into a security strategy. This method involved monitoring non-specific data sources such as emergency calls, pharmaceutical sales, and Emergency Room census, to find any concerning trends. 12
The Department of Homeland Security was created following the terror attacks on September 11 to act “as a focal point regarding natural and manmade crises, and emergency planning.” 13 The anthrax attacks provided additional resources to coordinate and respond to bioterrorism leveraging the Department of Health and Human Services, and the operating divisions of the Centers for Disease Control and Prevention. 14 In 2002, the United States enacted the Public Health Security and Bioterrorism Preparedness and Response Act with nearly $1 billion appropriated annually to support local preparedness and response to address bioterrorism threats. 15–17 While the funding in biodefense is in the order of millions of dollars, disease outbreaks are both lethal and costly. Between 1997 - 2009, the economic losses from 6 major outbreaks averaged $6.7 billion per year with the 2014 - 2016 Ebola epidemic costing around $53 billion. 18
The biothreat and the current biodefense posture was influenced by actions that came long before the September 11 and anthrax attacks. During the first Gulf War, the United States military forces could detect chemical agents and warn its forces of an attack, but they had significant shortfalls in the ability to detect biological threats. 19 Several billions of dollars in funding for biodefense were exclusively the domain of military agencies with the primary focus of protecting troops against biological warfare programs from state actors while engaged in combat. 20 Funding was also placed into biological detection systems, such as Bio-Watch even though these systems “will remain imperfectly reliable, environmentally insensitive, slow, range-limited, and difficult to operate for the foreseeable future.” 21 In contrast to other systems, the United States created 8393 chemical detectors, 171 combined systems, and 453 biological detectors in fiscal year 2009. 22 The following year included 25454 chemical specific detectors, 843 combined chemical, biological, and radiological systems, but only 40 biological detectors. 23 There is an inherent bias towards the military that exists within the biological defense program of the United States that is hindering the development of a more sustainable infrastructure to respond to any type of biological threat. Biological threats were steadily deprioritized in the years after September 11 because of the belief that they were not easily obtained and could not cause widespread impact along with the preference in the United States’ defense structure to focus on chemical, nuclear, radiological, and explosive threats. The emergence of SARS-CoV-2 and the COVID-19 pandemic necessitates a change in this posture to restore funding to protect against biological threats which have proven largescale consequences for health, economics, and social order.
Within the current response structure are 7 core capabilities of detection and diagnosis, attribution, communication, medical countermeasure development, medical countermeasure dispensing, medical management, and environmental cleanup. Each are essential for addressing naturally occurring diseases and man-made outbreaks, but for the United States’ focus on terrorist activities. There is still a lacking stockpile of medical countermeasures that would not be enough to address the needs after large-scale attacks and could not aid in an attack that utilizes resistant or novel pathogens. 24 There is a large mismatch between public health and biodefense funding. Evaluating the resources available to counter both intentional and natural threats show an evidentiary gap between the number of deaths and illnesses from infectious diseases and those caused by bioterrorism in a contrast to the available funding to prepare for each type of event. Biodefense focused on terrorism has increased from less than a billion dollars to over $8 billion following the September 11 attacks even though only 5 people have been killed in bioterror attacks since 1900. 25 This is in direct contrast with the $5 billion for tuberculosis control which killed 1.7 million people in 2009 worldwide and similarly 1.8 million died from AIDS-related illness with the United States support being $10 billion short of what is needed to address the threat. 25
In 2007, the World Health Organization (WHO) released its annual World Health Report titled “A safe future: global public health security in the 21st Century.” Noting the success of public health measures in addressing microbial scourges like cholera and smallpox in the 20th century, the WHO issued a warning about the alarming shift in the delicate balance between humans and microbes. 12 Listing a series of factors including demographic changes, economic development, global travel and commerce and conflict, the WHO suggested a heighted risk of disease outbreaks ranging from infectious diseases to bioterror attacks. 12 The WHO proposed a new framework to address the changing threat landscape. ‘Public health security’ attempted to merge the previously segregated technical and political domains. Specifically, bioterrorism had traditionally been a focus of national security-oriented organizations within the national defense with infectious disease being problems of public health, although, infectious disease throughout history has not be unrelated to conflict and military affairs. 12
Only recently has the military begun to focus more on health security as a general topic, including infectious diseases with the military beginning to play a role in the Global Health Security Agenda. 26 The Global Health Security Agenda places a focus on the all-hazard approach to biodefense with effort to confront antibiotic resistance, epidemics, bioterrorism and disease outbreaks. The COVID-19 pandemic and the multitude of biodefense capabilities failures will likely increase the calls for an evaluation and overhaul of the current system to increase our defense measures for both intentional and natural biological threats.
Public health emergency management
Following the September 11 terror attacks, the federal government worked to reframe the roles and responsibilities of emergency preparedness and response. Initially, focus was placed on biological events after concerns prompted by the Amerithrax Attacks within the United States. The financial mechanisms, however, were not well aligned with the ability to prevent the spread of infectious agents or reduce the impact on public health. 14 A large part of the emergency preparedness and response efforts were left to the local levels which maintain organizations that lack the clear funding mechanisms or well-defined authorities for sustained preparedness activities to be able to deal with a biological threat. Following various national disasters including Hurricane Katrina, the ambiguities in the national guidance for ‘all-hazards,’ emergency preparedness and response, and the fear of the emergence of pandemic influenzas, caused the creation of the Assistant Secretary for Preparedness and Response within the Department of Health and Human Services. The Public Health and Medical Services Annex along with the Biological Index Annex highlight the Department of Health and Human Services as the coordinating agency for preparedness and coordination of public health events. 27
The funding for public health preparedness programs is generally completed through routine congressional appropriations. The appropriations for domestic health security fluctuate from year to year and do not frequently provide the necessary contingency funds to respond to biological incidents. 14 The Public Health Emergency fund was created in 1983, but no appropriations for the fund have been noted since fiscal year 1999 and the account maintained a 0 balance throughout the 2010’s. 28 While focus was immediately placed into building capacity of public health emergency preparedness following the September 11 and Anthrax attacks, due to non-existent capabilities before the attacks, there is still substantial room for improvement. Most federally funded public health emergency preparedness states reported increased capabilities from before September 11 through 2016, with the number of jurisdictions having increased capability functions including countermeasures and mitigation, increasing by nearly 200% by 2014. 29
Public health emergency preparedness has 6 domains and 15 capabilities that are a part of the Centers for Disease Control and Prevention national standards. Each of these domains are crucial links in a chain that provides biosecurity that could help address both intentional and unintentional biological threats. Minimal research has been done to suggest public health emergency preparedness focuses to better improve biodefense capabilities.
While funding was initially allocated to public health emergency preparedness capacity building, beginning in 2003, the funding per capita has steadily declined. 29–31 As the funding started decreasing, states reported challenges in their overall capability functions in the 2010s. There were missing or incomplete plans, difficulties in securing trained personnel, and inadequate funding for recruitment. The gaps also included lack of supporting infrastructure, administrative barriers, and additional actions needed for the active function. 29 The decrease in funding for public health emergency preparedness has left states vulnerable to both intentional and natural biothreats. New York City’s Department of Health and Mental Hygiene reported an inability to offset the continuous decline in Public Health Emergency Preparedness (PHEP) funding. This led to a decrease in their surveillance and response capacity, public health emergency preparedness workforce staffing and development, and number of volunteers from Medical Reserve Corps. There was also a concern that limited resources would have a negative impact on the department’s ability to respond to real emergencies, train and exercise, and participate in regional collaborations. 32 During the COVID-19 pandemic, New York city was 1 of the most impacted locations in the United States. Similar concerns with the lack of funding for public health emergency preparedness were suggested in North Carolina where there were reports of declines in their preparedness capabilities, especially with surveillance which would be crucial to identify any biothreat presence, either intentional or natural. 31 The decrease in funding also impacted their planning and protocols, communication, and incident command which would limit the effectiveness in response to any type of public health threat.
Various examples in recent United States history have suggested the usefulness of preparedness and response capabilities for public health threats including the 2009 H1N1 influenza pandemic, 2014 Ebola virus outbreak, and 2016 Zika virus outbreak. 33–35 The need for these capabilities is highlighted by the life safety considerations as well as the far-reaching political, economic, and social consequences that can result from a public health emergency. 36,37 The progress made since September 11 that developed, built, and started to create sustainable public health preparedness capabilities can serve as the foundation for public health preparedness and response systems that can build resiliency for biothreats, either intentional or natural, creating a truly bio defended nation. 35 There are important synergies between biodefense and public health which need to be leveraged in order to better protect the United States from likely natural diseases threats as well as the increasing likelihood of bioterrorism in the post COVID-19 era.
Statement of purpose
The current biodefense landscape within the United States has seemingly been inadequate to initially prevent the spread of an infectious disease within the United States and to effectively respond to an outbreak with adequate safety measures. There were catastrophic failures at the intersection of science and policy which has led to “disastrous outcomes for public health, the economy, and international collaboration.” 6
This study explores the biodefense and public health preparedness landscape for trends in federal support and capacity building. The study investigates the applicability of public health emergency management principles to the biodefense structure.
Methodology
This study uses thematic analysis and mixed methods, and concurrent triangulation strategy methodologies applied to this quantitative and qualitative study in exploring the landscape of biodefense within the United States to inform the next generation of preparedness for biothreats. The benefits of these methods include the flexibility and accessibility for the researcher, usefulness in key points within large amounts of data, and the ability to illuminate insights for future policy development. 38,39 Many themes can arise from data, but these methods allow for the traceability of the identified themes to the original research questions which support the development of findings and recommendations. 38,40 The failures of the COVID-19 pandemic response will serve as a platform from which to suggest an emerging role for public health in addressing the security threat of infectious diseases.
Process
A mixed method was utilized in this study to investigate the qualitative and quantitative factors of the research inquiry. Academic literature, news reports, and governmental documents were examined for applicable research and data that has contributed to identifying the problems with the current biodefense structure. The research was utilized to offer solutions that will enhance the coordination and utilization of public health emergency management in the face of evolving natural and intentional threats. Thematic analysis is “a method for systematically identifying, organizing, and offering insight into patterns of meaning (themes) across a dataset.” 40 Thematic analysis will allow for the discovery and description of themes within the data. 39 The themes that are identified including concepts, ideas, and patterns will be collated and applied through conceptual tools. 41 Braun and Clarke’s 6-phase framework, briefly described below in Table 1, for thematic analysis will assist with defining the important information from a review of the literature. The process has been suggested as comparable to other qualitative methods. 38,42–44 The analysis will have feedback loops between the literature review steps. 43,44 The concurrent triangulation design permits that use of qualitative and quantitative data to more accurately define and analyze the relationship among the variables of interest (see Figure 1). Both quantitative and qualitative data are collected during the same stage and the design is theoretically driven to initiative social change and advocacy to provide support for various perspectives. 45
Table 1.
Braun & Clarke’s framework
| Phase | Description |
|---|---|
| Familiarization with data | Initial thoughts from reading the data |
| Generation of initial codes | Finding key features of the data to collate in a systematic fashion |
| Search for themes | Collate the codes into themes with all the relevant data |
| Review of themes | Evaluate themes based on codes and the data set to generate an overall map of the analysis |
| Definition and Naming of Themes | Continued refining of themes and analysis with definitions and names generated |
| Production of Analysis | Compilation of findings and scholarly report |
Figure 1.

Mixed methods concurrent triangulation. 45
These methods will provide the flexibility and accessibility of an inquiry into an emerging need in the biodefense infrastructure. The ability to find key points from large volumes of data within the case study is also a benefit of the analysis method which will provide insights for policy development. 38,39
Data collection
The data collected for this research comes from numerous documents that span government, non-governmental organizations, and academia. Due to the complexity of the research, the strategy selected for analysis allowed for smaller samples sizes for the deriving of meaningful material, rather than a generalized approach from large populations as expected of quantitative research. 47 In order to identify important common patterns, a maximum variation sampling strategy was used during analysis. 48 All information was gathered from publicly available documents including reports from the United States Senate.
The open-sourced Global Terrorism Database was also used for evaluation of CBRN attacks from January 1970 to December 2019. The database includes events where there may be uncertainty as to whether an incident meets all the criteria for inclusion as a Global Terrorism Database terrorist incident. All events including those meeting partial criteria were included as well as attacks that were attempted, but not successfully carried out. The data base does not include any acts of state-based terrorism.
Validity and reliability
A major concern with a study of this nature is to determine what is needed to achieve validity and reliability within the context of research design based on the problem and objective. 49 According to Nardi, “validity is about accuracy and whether the operationalization is correctly indicating what it’s supposed to.” 49 The limitation of a heavily quantitative study for thematic analysis is rooted in the historical grounding of the analysis. 39 A surrogate mechanism is therefore needed to overcome these challenges in validity and reliability. 39 The use of a consistent process in this research will serve to address the validity and reliability challenges which is the purpose of the Braun and Clarke’s framework and the mixed methods concurrent triangulation. 39,50
Analysis and results
A total of 8 main failure themes were identified which ultimately relate to the public health preparedness capabilities that could be leveraged to ensure a bio-defended nation. Additional results suggested a decreasing funding posture for the public health preparedness and the security threat posed by infectious diseases.
Analysis
The qualitative and quantitative methods of analysis are employed conjointly to provide an overall evaluation of the research question. The employed integrated methods of data analysis provide more context to a complex infrastructure and a stronger basis for policy improvements. The themes of failures during the COVID-19 pandemic are patterns of meaning that exist across the dataset from both academia, governmental, and news resources. 40 The analysis of the breadth of literature yielded the 8 themes of failure during this pandemic (see Table 2). The thematic interpretations and additional analysis of the literature contributed to the foundational understanding of the current landscape and the areas for applicability of the evaluation of infectious disease as a security threat and the role of public health preparedness in biodefense.
Table 2.
Key failure themes of the COVID-19 pandemic
| Accountable Leadership | • Science was packaged for partisan goals • HHS/ASPR preparedness and response efforts were inadequate • White House’s early denial of the pandemic, active propagation of misinformation about mask-wearing and treatments, and incoherent leadership harmed the United States |
| Statutory Authorities and Policies | • Crimson Contagion After Action Report noted that existing authorities and policies making HHS the lead of the federal government’s response in addition to ASPR’s role were insufficient and unclear • ASPR’s coordination role was ill-defined when the President transitioned authority of the response from the HHS Secretary to the Vice President, • After the national emergency declaration on March 13, 2020, ASPR’s role was subsumed by FEMA. |
| Inter-agency Coordination | • ASPR did not serve as a subject matter expert to FEMA or fully and effectively integrate with FEMA’s national and regional offices and preparedness activities. • ASPR’s limited regional presence and interaction with FEMA and state emergency management and public health authorities contributed to failures in response |
| Coherent Data System for Situational Awareness | • Federal entities could provide a coherent, comprehensive common operating picture with health departments across the federal state, local, tribal and territorial governments. • Trump administration ordered hospitals to stop sending data to the Centers for Disease Control and Prevention, and instead send it to a private data firm under contract with the DHHS, whose secretary reports directly to the White House |
| Strategic National Stockpile and Supply Chain | • SNS and commercial PPE inventory was inadequate needs • Weaknesses in FEMA’s resource request system and allocation processes. • WebEOC, the system FEMA used to process PPE and ventilator resource requests, contained unreliable data to inform allocation decisions and ensure requests were addressed • Officials within the White House coronavirus task force often circumvented FEMA’s decision-making to award contracts for PPE and other equipment to preferred states and companies • U.S. sent masks to China and then had to buy back at a deficit in order to fulfill the demand in country • Project Airbridge placed states against the federal government and the private sector |
| Testing and surveillance | • Inability to create a robust testing infrastructure left the country unable to track the rapidly unfolding outbreak • FDA regulatory hurdles, part of the federal government’s declaration of the public health emergency, stopped both public health and private sector labs from quickly deploying start-up tests of their own • The federal government consistently underestimated the need for urgency around testing for this virus; included strict testing guidelines that only tested based on travel and known positive contacts until end of February, missing community transmission • N3 assay which was designed to evaluate any coronavirus contaminated CDC tests delaying results. Under Emergency Use Authorization, labs were not permitted to remove this part of the assay • German-made, WHO distributed test was not utilized by U.S. and FDA did not approve individual lab made tests • President Trump verbalized the desire to slow down testing |
| Health Care System Surge Capacity and Resilience | • Local, regional, and national health care systems were stressed, lacking adequate bed capacity, sufficient staffing, and limited medical supplies |
| Federal Funds | • HHS Secretary transferred funds to make $52 million available to ASPR for procurement of PPE and BARDA’s initial investments in medical countermeasures • Sufficient funds only became available when Congress passed the first COVID-19 emergency supplemental funding bill (provided $3.1 billion on March 6, 2020 for the ASPR) |
Results
The results of this research are presented in various forms. The thematic analysis evaluating the failures of the COVID-19 pandemic found 8 main themes.
The CDC has provided significant funding for preparedness work by local health departments since 2001. The Public Health Emergency Preparedness cooperative agreement program enables these departments to conduct various necessary health surveillance and response tasks. The program funds the creation and sustainment of information and communication systems, routine surveillance efforts for infectious diseases, community education and risk communication, exercises, and efforts to address vulnerable populations. PHEP funding enabled public health laboratories to quickly address testing needs for the emergence of the Middle East Respiratory Syndrome (see Figure 2).
Figure 2.
Federal pandemic preparedness financial support, 2003 – 2020. Source: Watson et al. 2017. 46
Private health systems get funding through a hospital preparedness program created by Health and Human Services Department and maintained by ASPR (see Figure 3). The program assists coalitions of local hospitals, public health agencies, and emergency managers prepare for sudden health threats. The funding also supports planning for health system surges, trainings, and exercises, and creating additional coalitions to bring together public health and healthcare to coordinate a response. The funding has supported responses to various disasters such as evacuation planning for hurricanes or establishing high-containment isolation units used to treat highly infectious or lethal diseases. The decrease in funding for these health preparedness programs are in direct contrast with the Department of Defense base budget (see Figure 4).
Figure 3.
Federal pandemic preparedness funding, by program, 2002 - 2017. Source: Watson et al. 2017. 46
Figure 4.
Department of Defense base budget, 2003 – 2020. Source: Office of the Under Secretary of Defense (Comptroller)/CFO.
Discussion
Research question (RQ) 1
Is the current biodefense structure providing adequate core capabilities?
The analysis yielded 8 common themes of failure as noted throughout the literature; accountable leadership, statutory authorities and policies, interagency coordination, coherent data system for situational awareness, strategic national stockpile and supply chain, testing and surveillance, health care system surge capacity and resilience and federal funds. The commonalities of these themes from various forms of literature including media reports, academic journals and governmental documents suggest the importance of these failure themes that caused the devastation of the COVID-19 pandemic. While the debate about the true origins will likely never be resolved, the devastation from this virus shows the lack of biodefense capabilities within the United States against natural, accidental, or intentional threats. The failures in response lie within the key themes and state goals in the progress in public health preparedness (see Table 2). These failure themes would be consistent in the presence of either intentional or natural threats, although the United States benefited greatly from the lessened impact of the virus on younger and healthier populations, at least prior to the emergence of different variants. The bioterrorism focus of biodefense still did not provide the core capabilities necessary to combat what would be a weaponized biothreat, a potentially even more complex and dangerous than SARS-CoV-2. It is clear from the on-going response to COVID-19 that the United States has an inadequate biodefense system that lacks the core capabilities necessary to respond to the wide complex of potential biothreats.
Research questions (RQ) 2
Could public health emergency management principles be applied to the structure of biodefense in order to increase capabilities?
The current biodefense structure is inadequate and framing infectious disease as a security threat can improve preparedness efforts. The means by which this can be implemented are through the adoption of public health emergency management principles in the biodefense structure to increase capabilities. The main failures of the current pandemic response as outlined in Table 2 related to the public health preparedness capabilities which are outlined in Table 3. Failures in accountable leadership and interagency coordination can be addressed through the incident management and Emergency Operations Coordination framework. The coherent data systems are a core capability within information management as Emergency Public Information and Warning information sharing that is essential for public health work could improve identification and isolation of threats, either natural or intentional. It would also be an additional improvement to the testing and surveillance framework which falls under bio-surveillance. Increasing the abilities and Public Health Laboratories to test and analyze even novel samples along with the abilities and funding for public health surveillance and epidemiological investigation could additionally reduce the impact of the presence of any biothreat. The failures and limitations in the health care system surge capacity and resilience would be addressed through the support of the surge management, countermeasures and mitigation domains. Mass care, surge management, medical countermeasure dispensing and non-pharmaceutical interventions can not only increase the ability to save lives from biothreats, but in addition can deter the use of bioweapons due to their negated impact, still promoting the bioterror concerns of the current biodefense structure. Similarly addressing the strategic national stockpile and supply chain failures can increase our resilience to any threat, promoting a one health like approach to biodefense. This could address the weaknesses in FEMA’s resource request system and allocation processes and unreliable data which informs allocation decisions and ensures requests are accurately adjudicated.
Table 3.
Public health preparedness capabilities 51
| Domains | Capabilities |
|---|---|
| Incident Management | Emergency Operations Coordination |
| Information Management | Emergency Public Information and Warning Information Sharing |
| Surge Management | Fatality Management Mass Care Medical Surge Volunteer Management |
| Countermeasures and Mitigation | Medical Countermeasure Dispensing Medical Materiel Management and Distribution Non-Pharmaceutical Interventions Responder Safety and Health |
| Community Resilience | Community Preparedness Community Recovery |
| Bio-surveillance | Public Health Laboratory Testing Public Health Surveillance and Epidemiological Investigation |
It is clear that the current biodefense infrastructure was incapable of addressing a biothreat and improvements are necessary to promote improve United States’ defense capabilities. Supporting public health emergency preparedness measures can not only improve our biodefense posture, but can also improve our resilience to a myriad of threats as public health preparedness funding has assisted in responses to SARS, the 2009 H1N1 influenza pandemic, the Ebola cases in the United States, and the Zika virus pandemic along with Hurricanes Katrina and Sandy, the 2011 Joplin, Missouri, tornado, the 2013 Boston Marathon bombing, and the 2014 West Virginia Elk River chemical spill.
Significance and recommendation
The COVID-19 pandemic has had major impact on the United States with consequences lingering for generations. The United States had the tools for success, but the implementation of these tools is a major failure. The 2019 Global Health Security Index which assessed levels of global health security across 195 countries, listed the United States as the number 1 most prepared nation for a pandemic. The United States needs to reinvest in the public health emergency preparedness infrastructure to improve its biodefense capabilities. The efforts to improve public health preparedness (see Table 4) have been inadequate. The biothreats will continue to be present, either in the form of a natural emerging or reemerging infectious disease, or a biological weapon. As suggested by Dr. Anne Schuchat of the CDC, the United States was unprepared for the coronavirus, the response “wasn’t a good performance,” and there’s still ‘a lot of work to do’ to get ready for the next pandemic when it comes. 52 There was a complex, systemwide assault that has highlighted the numerous vulnerabilities that are present in our ability to respond to a wide array of biothreats.
Table 4.
Progress in public health preparedness, 1999 - 2011
| Pre 2002 | 2002-2011 | Stated Goals 2011-2021 |
|---|---|---|
| Prior to 1999, CDC did not fund state public health preparedness | Congress appropriated funding to CDC to assist states in improving preparedness and capabilities | • Define and enhance community resilience and preparedness • Build robust multi-level public health infrastructure with a focus on bio-surveillance • Increase focus on vulnerable populations • Leverage collaborative efforts in crucial infrastructure, including DHS • Improve linkages between domestic health security and global health security • Improve evidence base for preparedness activities |
| Prior to 1999, CDC conducted all tests to detect and confirm presence of biological threats | CDC’s Laboratory Response Network contains over 150 laboratories which can test for biological agents | |
| Prior to 1999, there was no established national stockpile and in 2001 only a few states had protocols for receiving, distributing, and dispensing assets | CDC’s Strategic National Stockpile ensured availability of key supplies with all states having plans for utilization of the stockpile | |
| Prior to 2000, there was no secure system to share information about emerging threats | CDC created Epidemic Information Exchange (Epi-X) to provides a secure, web-based communication system for sharing preliminary health surveillance information | |
| Prior to 2001, multi-level governmental response efforts were coordinated from an ad-hoc CDC EOC | CDC has an advanced EOC that coordinates response activities with state public health departments through defined roles and responsibilities | |
| Prior to 2001, there were few integrated communications and unified command structures for large-scale incident response | Exercises and communications between public health, emergency management, and other stakeholders took place | |
| Prior to 2001, there were no requirements for licensing, registering, or identifying locations with select agents and toxins | Select Agent Regulations were enacted to enhance oversight of safety and security of agents and toxins |
Outbreaks of SARS, Ebola, Zika, influenza, among others, have cost billions in lost productivity around the world. The risk of a catastrophic biological threat was evident prior to the emergence of SARS-CoV-2 due to the increasingly interconnected world and the heightened risk of spillover from animals to human. In this era of increased global travel, infectious disease outbreaks will only increase. As climate change worsens, catastrophic weather-related events will place enormous demands on health agencies to have the capacity to prepare for and mitigate such disasters. Leveraging on the health security components of the Global Health Security Index can help facilitate protection from various biological threats which can ensure a biosecurity strategy that integrates traditional threats with broader public health crises, merging the two governance structures for seamless operations in the face of a biothreat.
The results of this study are concerning due to their parallels to the findings of the 2019 Crimson Contagion Functional Exercise. The exercise was meant to determine the nation’s ability to respond to a large-scale outbreak of a novel avian influenza virus (H7N9) strain, a virus which spreads quickly amongst humans with high rates of morbidity and mortality. The After-Action Report following the 4-day exercise, which included 19 Federal Departments/Agencies, 12 states, 74 local health departments and coalition regions, 15 tribal nations and pueblos, 87 hospitals, over 100 healthcare and public health private sector partners, and the White House National Security Council, yielded stark similarities in failures of response to those identified in the thematic analysis (see Table 5).
Table 5.
Crimson contagion key failure findings and outcomes
| Domains | Specific Findings |
|---|---|
| Statutory Authorities and Policies | • Existing structure tasking HHS to lead response to influenza pandemic are insufficient • Policies were often in conflict and lead to confusion |
| Funding | • Insufficient funding sources designated for the federal government to use in response to an influenza pandemic • Unclear structures for if/how states could repurpose HHS and the Centers for Disease Control and Prevention (CDC) grants, as well as other federal dollars to support the response |
| Planning | • Biological Incident Annex to the Response and Recovery Federal Interagency Operational Plans (January 2017) and the Pandemic Crisis Action Plan Version 2.0 (January 2018) neglect to outline organizational structure for federal response when HHS is the designated lead • Crisis standards of care planning and implementation varied across levels of government |
| Operational Coordination | • Absent clarity on federal interagency partners’ roles and responsibilities • States lacked clarity on which channels they should use to request information from and report information to federal partners throughout the response • HHS’ Operating Divisions and Staff Divisions provided inconsistent and inaccurate response guidance and actions to healthcare and public health private sector partners |
| Situational Assessment | • HHS and FEMA’s use of disparate information management systems hampered ability to establish and maintain a national common operating picture • Lack clarity on CDC’s data sharing policies • Federal partners did not provide state, local, tribal, and territorial public health and medical and emergency management partners with a standard template to report information across community lifelines • HHS’ regional staff lack clear guidance on the distribution of federal information management products • Existing limited mechanisms to share information were insufficient • Inconsistent use of terminology regarding vaccine types and stockpiles |
| Resources | • Medical countermeasure supply chain and production capacity may not meet the demands imposed by countries during a global influenza pandemic • Participants were not clear on the applicability or use of Title I, Priorities and Allocations Authority, of the Defense Production Act to mitigate medical countermeasure and ancillary supply shortages during a response • States experienced multiple challenges requesting resources from the federal government • States indicated that they were unclear on pre-pandemic vaccine and the Strategic National Stockpile asset distribution |
| Public Information and Risk Communications | • Implementation of school closures among some participating states highlighted the many cascading impacts to communities; and the variation in timing of school closures caused confusion among exercise participants |
The summarized recommendations for policy makers to counter the increasing prevalence of biothreats are as follows:
Promote strong, effective leadership and coordination: The United States must commit to a collaborative framework that integrated public health and its preparedness domains into the biodefense infrastructure that is currently heavily focused in law enforcement entities focused on preventing terrorism. Public health emergencies that are a result of an infectious disease outbreak or even a bioweapon, require national coordination since biological agents are not easily isolated. Effective coordination of response by state, local, tribal and territorial authorities are crucial to a successful response and mitigation of devastating impacts. Clear and effective leadership can assist with promoting all-hazard preparedness and operation response coordination during public health emergencies. This coordination must also focus on federal efforts an infectious disease outbreaks and bioweapons have the potential to span the nation. ASPR must integrate with FEMA to ensure coordination through the emergency management cycle, including the pre-incident phases. ASPR has a crucial role in coordinating the important resources of the Department of Health and Human Services along with other federal medical and public health expertise that will be necessary to support local and state departments. Coordination will allow for the adequate distribution of the right care to those in need, a major gap of the COVID-19 pandemic.
Strengthen public-private-government partnerships: Biothreats require a lot of government response in order to be successful. Expanding, strengthening, and sustaining partnerships between government agencies, the private sector, and academia will be critical for preparing and responding to the next threat. Operation Warp Speed and partnerships through the National Emerging Special Pathogen Training and Education Center and Regional Disaster Health Response System were vital to the expansion and mobilization of medical capacities and capabilities needed to address the gaps during the pandemic. Steady state agreements and cooperation can better improve our capabilities, capacities, and resources to prevent, mitigate, and respond to any biothreat no matter the source. These partnerships will help ensure a collaborative approach to response that does not place the federal government, state governments, and private entities in competition for the resources necessary to save lives.
Innovation, capacity, and capability improvements: A valuable lesson learned from the September 11 terror attacks was the lack of imagination of security professionals. The COVID-19 pandemic highlighted the failure of imagination of health and security professionals. It is necessary to support innovation to expand public health and medical preparedness and response capacity and capabilities. This is necessarily completed through the funding and support of public health emergency preparedness which will consequently support biodefense capabilities against all types of biothreats. Innovation to medical countermeasures, the health care system, and public health programs can improve our resilience to threats and deter any intention bioweapon uses.
Limitations
There are 5 significant limitations of this study: (1) focus on health security aspect of biodefense, (2) analysis of documents/artifacts only, (3) the constraints of an on-going pandemic, (4) the political discourse surrounding the topic, and (5) the domestic focus. The first limitation is necessary when utilizing COVID-19 as a case study, however future research would need to address the social and political aspects of global health security and counterproliferation of biological weapons. The second limitation is driven by the need to balance the depth of analysis with available time within a 12-month executive program during which this research was conceptualized and conducted. The third limitation considers the lack of available information and the conclusions that can be drawn as the pandemic continues with likely new information to be learned in the future. The political discourse surrounding the issue, even including the politicization of mask wearing made the analysis a difficult balance between highlighting the failures to recommend policy changes while trying to eliminate the politization of the findings. The final significant limitation is the focus on domestic policy and recommendations. Biodefense includes complex considerations of global health and international cooperation that would be too complex to discuss in this study but could be an important area for future research.
Conclusion
A redesigned biodefense framework is necessary to address the gaps and failures in response to the COVID-19 pandemic. Biothreats will remain an increasingly complex and dangerous threat to the United States and its interests abroad. Biological threats, whether natural occurring, intentional, or accidental have the potential to cause loss of life, sustained economic damage, societal instability, and disruptions to global security. Disruptions to the natural equilibrium of the interlinked systems of the world can lead to system failures that have unpredictable damaging impact. The United States cannot afford to shortchange the critical public health infrastructure the nation needs to be prepared for the next pandemic or public health crisis which include bioterrorism. The current pandemic has cost the United States $16 trillion dollars with no immediate end to the pandemic on the horizon, however the cost of preparedness would only be a tiny fraction of the price of the next disaster. As Congress debated President Biden’s $30 billion plan to prevent pandemics as part of the $3.5 trillion reconciliation bill, attempts were made to immensely cut the funding for pandemic preparedness, even as the pandemic continues to devastate the United States. Bio-preparedness is complex puzzle that requires the flawless integration of public health, security and infrastructure in coordination with a consideration of the sociocultural environments, legislative authorities, communications, and behaviors and agency capabilities that exist within the United States.
To reduce the vulnerabilities within the United States, a multidisciplinary approach must address certain steady state disparities such as the urban-rural healthcare divide, health outcomes based on racial and ethnicity, rising prescription drug prices, and other on-going health epidemics within the country. Strengthening our biodefense and health security is essential to protect the United States from diverse biothreats. It is essential to adopt public health emergency preparedness capability domains to share data, knowledge and resources and collaborate an effective response to any threat through accountability in reducing threats. The recommendations in this study require building upon the current biodefense framework and leveraging biosecurity leadership to address the vulnerabilities by funding public health capacities through bipartisan support to better prepare the United States for future threats. A honest, comprehensive review of the failures of the COVID-19 pandemic is necessary to pool expertise to adequately invest in planning, training, mitigation, response, and recovery capabilities.
The United States certainly does not have biodefense totally under control. Preparing for public health crises will directly increase our capabilities for bioterrorism preparedness and vice versa, necessitating the interlinking of these 2 previously distinct focuses. There are no easy answers, only tough trades offs when investing in the biodefense infrastructure. The pandemic revealed fundamental problems with our biodefense preparedness. The United States will have to deal with more biothreats in the future along with other existential natural threats, all on the account of man-made problems. The solution to these threats lies in the ability to incorporate multidisciplinary perspectives to solve the complex web of problems. The ability to address the gaps and failures will necessitate learning from this pandemic. When we are finally able to remove our masks, we must be ready to fix all that is broken together.
Conflict of interest
The authors certify that they have no affiliations or involvement with any organization or entity with any financial interest or non-financial interest in the subject matter or materials discussed in this manuscript.
References
- 1. CNBC. CNBC transcript: President Donald Trump sits down with CNBC’s Joe Kernen at the world economic forum in Davos, Switzerland. CNBC. Published January 22, 2020. https://www.cnbc.com/2020/01/22/cnbc-transcript-president-donald-trump-sits-down-with-cnbcs-joe-kernen-at-the-world-economic-forum-in-davos-switzerland.html [Google Scholar]
- 2. Ciotti M, Ciccozzi M, Terrinoni A, et al. The COVID-19 pandemic. Crit Rev Clin Lab Sci. 2020;57(6):365-388. doi: 10.1080/10408363.2020.1783198 [DOI] [PubMed] [Google Scholar]
- 3. Hui DS, Azhar E, Madani TA, et al. The continuing 2019-nCoV epidemic threat of novel coronaviruses to global health - the latest 2019 novel coronavirus outbreak in Wuhan, China. Int J Infect Dis. 2020;91:264-266. doi: 10.1016/j.ijid.2020.01.009 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4. Brahma D, Chakraborty S, Menokee A. The early days of a global pandemic: a timeline of COVID-19 spread and government interventions. Published April 2, 2020. Brookings. https://www.brookings.edu/2020/04/02/the-early-days-of-a-global-pandemic-a-timeline-of-covid-19-spread-and-government-interventions/
- 5. Ranney ML, Griffeth V, Jha AK. Critical supply shortages - the need for ventilators and personal protective equipment during the Covid-19 pandemic. N Engl J Med. 2020;382(18):e41. doi: 10.1056/NEJMp2006141 [DOI] [PubMed] [Google Scholar]
- 6. Colglazier EW. (2020, April 9). Response to the COVID-19 pandemic: catastrophic failures of the science-policy interface. INGSA. Published April 9, 2020 https://www.ingsa.org/covidtag/covid-19-featured/colglazier-scidip/.
- 7. Vogel K. Biodefense. In Lakoff A & Collier S (Ed.). Biosecurity Interv: 227-256. Columbia University Press. 10.7312/lako14606-009 [DOI] [Google Scholar]
- 8. Lederberg J. Infectious disease--a threat to global health and security. JAMA. 1996;276(5):417-419. doi: 10.1001/jama.1996.03540050077028 [DOI] [PubMed] [Google Scholar]
- 9. Alibek K, Handelman S. BioHazard: the chilling true story of the largest covert biological weapons program in the world - told from inside by the man who ran it. Dell Publishing, 1999. [Google Scholar]
- 10. Phe.gov. Frequently asked questions: National biodefense strategy. Phe.gov. Published March 11, 2021. https://www.phe.gov/Preparedness/biodefense-strategy/Pages/faqs.aspx.
- 11. International Food Safety Authorities Network (INFOSAN). Biosecurity: an integrated approach to manage risk to human, animal and plant life and health. Published March 3, 2010.
- 12. Fearnley L. Redesigning syndromic surveillance FOR biosecurity. Biosecurity Interv. 2018:61-88. 10.7312/lako14606-003 [DOI] [Google Scholar]
- 13. Homeland Security. Homeland Security Act. 116 Stat 2135: 2002.
- 14. Katz R, Attal-Juncqua A, Fischer JE. Funding public health emergency preparedness in the United States. Am J Public Health. 2017;107(S2):S148-S152. doi: 10.2105/AJPH.2017.303956 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15. Heinrich J. Bioterrorism: the Centers for Disease Control and Prevention’s role in public health protection. US General Accounting Office. 2002. http://www.gao.gov/assets/90/81756.html.
- 16. Public health security and bioterrorism preparedness and response act of 2002. Pub L 107–188, 116 Stat 594. Published June 12, 2002. https://www.congress.gov/107/plaws/publ188/PLAW-107publ188.pd
- 17. Centers for Disease Control and Prevention. 2013–2014. national snapshot of public health preparedness. https://www.cdc.gov/phpr/pubs-links/2013/documents/2013_preparedness_report_background.pdf.
- 18. Huber C, Finelli L, Stevens W. The economic and social burden of the 2014 Ebola outbreak in West Africa. J Infect Dis. 2018;218(suppl_5):S698-S704. doi: 10.1093/infdis/jiy213 [DOI] [PubMed] [Google Scholar]
- 19. United States General Accounting Office. Chemical and biological defense; US forces are not adequately equipped to detect all threats. US Government Printing Office; 1993. [Google Scholar]
- 20. Enemark C. United States biodefense, international law, and the problem of intent. Politics Life Sci. 2005;24(1–2):32-42. doi: 10.2990/1471-5457(2005)24[32:USBILA]2.0.CO;2 [DOI] [PubMed] [Google Scholar]
- 21. Gregory Koblentz. Biological terrorism: understanding the threat and America’s response. In countering terrorism: dimensions of preparedness, by Howitt Arnold and Pangi Robyn. 2003:97-137. Cambridge: MIT Press. [Google Scholar]
- 22. Department of Defense Chemical and Biological Defense Program. 2010 Portfolio. Aberdeen, MD. 2010.
- 23. Webber, Andrew . 2011 Department of Defense annual report to congress on chemical and biological warfare defense. 2011.
- 24. England C. The United States medical countermeasure enterprise: a broken link in US biopreparedness. J Homel Secur Emerg Manag. 2014;0(0):1-14, ISSN (Online) 1547-7355; ISSN (Print) 2194-6361. doi: 10.1515/jhsem-2013-0043 [DOI] [Google Scholar]
- 25. Hunger I, Radosavljević V, Belojevic G, et al. Biopreparedness and public health: exploring synergies. 2013. doi: 10.1007/978-94-007-5273-3 [DOI]
- 26. Webster PC. Using military resources to fight disease. CMAJ. 2014;186(9):660. doi: 10.1503/cmaj.109-4780 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27. Department of Homeland Security. Emergency support function #8. Public Health and Medical Services annex. Published 2016. https://www.fema.gov/media-library-data/1470149644671-642ccad05d19449d2d13b1b0952328ed/ESF_8_Public_Health_Medical_20160705_508.pdf.
- 28. Department of Health and Human Services. FY2016 public health and social services emergency fund: justification of estimates for appropriations committees. Published 2016. https://www.hhs.gov/sites/default/files/budget/fy2016/fy2016-public-health-social-services-emergency-budget-justification.pdf
- 29. Murthy BP, Molinari NM, LeBlanc TT, et al. Progress in public health emergency preparedness-United States, 2001-2016. Am J Public Health. 2017;107(S2):S180-S185. doi: 10.2105/AJPH.2017.304038 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30. Himmelstein DU, Woolhandler S. Public health’s falling share of US health spending. Am J Public Health. 2016;106(1):56-57. doi: 10.2105/AJPH.2015.302908 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31. Davis MV, Bevc CA, Schenck AP. Declining trends in local health department preparedness capacities. Am J Public Health. 2014;104(11):2233-2238. doi: 10.2105/AJPH.2014.302159 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32. Marquez M, Patel P, Raphael M, et al. The danger of declining funds: public health preparedness in NYC. Biosecur Bioterror. 2009;7(3):337-345. doi: 10.1089/bsp.2009.0048 [DOI] [PubMed] [Google Scholar]
- 33. Oussayef NL, Pillai SK, Honein MA, et al. Zika Virus -10 public health achievements in 2016 and future priorities. MMWR Morb Mortal Wkly Rep. 2017;65(52):1482-1488. Published January 6, 2017. doi: 10.15585/mmwr.mm6552e1 [DOI] [PubMed] [Google Scholar]
- 34. Uzun Jacobson E, Inglesby T, Khan AS, et al. Design of the national health security preparedness index. Biosecur Bioterror. 2014;12(3):122-131. doi: 10.1089/bsp.2014.0024. [DOI] [PubMed] [Google Scholar]
- 35. Redd SC, Frieden TR. cdc’s evolving approach to emergency response. Health Secur. 2017;15(1):41-52. doi: 10.1089/hs.2017.0006 [DOI] [PubMed] [Google Scholar]
- 36. Heymann DL, Chen L, Takemi K, et al. Global health security: the wider lessons from the West African Ebola virus disease epidemic. Lancet. 2015;385(9980):1884-1901. doi: 10.1016/S0140-6736(15)60858-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37. Patel MS, Phillips CB. Health security and political and economic determinants of Ebola. Lancet. 2015;386(9995):737-738. doi: 10.1016/S0140-6736(15)61533-1. [DOI] [PubMed] [Google Scholar]
- 38. Braun V, Clarke V. Using thematic analysis in psychology. Qual Res Psychol. 2006;3(2):77-101. doi: 10.1191/1478088706qp063oa [DOI] [Google Scholar]
- 39. Guest G, MacQueen KM, Namey EE. Applied thematic analysis. SAGE Publications, Inc; 2012. doi: 10.4135/9781483384436 [DOI] [Google Scholar]
- 40. Braun V, Clarke V. Conceptual and design thinking for thematic analysis. Qual Psychol. 2021;9(1):3-26. doi: 10.1037/qup0000196 [DOI] [Google Scholar]
- 41. Nisbett M. Protection, survival and growth: an analysis of international policy documents. Int J Cult Policy. 2013;19(1):84-102. doi: 10.1080/10286632.2011.605450 [DOI] [Google Scholar]
- 42. Corbin J, Strauss A. Basics of qualitative research (3rd ed.). Thousand Oaks: Sage; 2014. [Google Scholar]
- 43. Javadi M, Zarea K. Understanding thematic analysis and its pitfall. J Client Care. 2016;1. doi: 10.15412/J.JCC.02010107 [DOI] [Google Scholar]
- 44. Maguire M, Delahunt B. Doing a thematic analysis: a practical, step-by-step guide for learning and teaching scholars. AISHE-J. 2017;9:3351. http://ojs.aishe.org/index.php/aishe-j/article/view/3354 [Google Scholar]
- 45. Creswell JW, Plano Clark VL, Gutmann ML, et al. Advances in mixed methods research designs. In: Tashakkori A, Teddlie C, editors. Handbook of mixed methods in social and behavioral research. Sci. Res. J. 2003:209-240
- 46. Watson CR, Watson M, Sell TK. Public health preparedness funding: key programs and trends from 2001 to 2017. Am J Public Health. 2017;107(S2):S165-S167. doi: 10.2105/AJPH.2017.303963 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47. Dworkin S. Sample size policy for qualitative studies using in-depth interviews. Arch Sex Behav. 2012;41. doi: 10.1007/s10508-012-0016-6 [DOI] [PubMed] [Google Scholar]
- 48. Creswell JW. Five Qualitative approaches to inquiry. In: Creswell JW, ed. Qualitative Inquiry Research Design: Choosing among Five Approaches, (2nd ed.). Thousands Oaks: Sage Publications; 2007: 53-84. [Google Scholar]
- 49. Nardi PM. Doing survey research: A guide to quantitative methods (4th ed.). New York: Routledge; 2018. doi: 10.4324/9781315172231 [DOI] [Google Scholar]
- 50. Tobin GA, Begley CM. Methodological rigour within a qualitative framework. J Adv Nurs. 2004;48:388-396. doi: 10.1111/j.1365-2648.2004.03207.x [DOI] [PubMed] [Google Scholar]
- 51. Centers for Disease Control and Prevention, Office of Public Health Preparedness and Response. Public health preparedness capabilities: national standards for state and local planning. Published 2011. https://www.cdc.gov/phpr/readiness/00_docs/DSLR_capabilities_July.pdf
- 52. The CDC’s No. 2 Official Says The U.S. Isn’t Ready For Another Pandemic by Steve Inskeep and Avie Schneider. June 4, 2021. https://www.npr.org/2021/06/04/1003172065/anne-schuchat-discusses-her-time-as-the-cdcs-principal-deputy-director



