Skip to main content
Wiley Open Access Collection logoLink to Wiley Open Access Collection
. 2022 Mar 31;32(4):e2568. doi: 10.1002/eap.2568

Accounting for animal movement improves vaccination strategies against wildlife disease in heterogeneous landscapes

Katherine M McClure 1,2,7, Guillaume Bastille‐Rousseau 1,3, Amy J Davis 1, Carolyn A Stengel 4, Kathleen M Nelson 5, Richard B Chipman 5, George Wittemyer 6, Zaid Abdo 2, Amy T Gilbert 1, Kim M Pepin 1,
PMCID: PMC9285612  PMID: 35138667

Abstract

Oral baiting is used to deliver vaccines to wildlife to prevent, control, and eliminate infectious diseases. A central challenge is how to spatially distribute baits to maximize encounters by target animal populations, particularly in urban and suburban areas where wildlife such as raccoons (Procyon lotor) are abundant and baits are delivered along roads. Methods from movement ecology that quantify movement and habitat selection could help to optimize baiting strategies by more effectively targeting wildlife populations across space. We developed a spatially explicit, individual‐based model of raccoon movement and oral rabies vaccine seroconversion to examine whether and when baiting strategies that match raccoon movement patterns perform better than currently used baiting strategies in an oral rabies vaccination zone in greater Burlington, Vermont, USA. Habitat selection patterns estimated from locally radio‐collared raccoons were used to parameterize movement simulations. We then used our simulations to estimate raccoon population rabies seroprevalence under currently used baiting strategies (actual baiting) relative to habitat selection‐based baiting strategies (habitat baiting). We conducted simulations on the Burlington landscape and artificial landscapes that varied in heterogeneity relative to Burlington in the proportion and patch size of preferred habitats. We found that the benefits of habitat baiting strongly depended on the magnitude and variability of raccoon habitat selection and the degree of landscape heterogeneity within the baiting area. Habitat baiting improved seroprevalence over actual baiting for raccoons characterized as habitat specialists but not for raccoons that displayed weak habitat selection similar to radiocollared individuals, except when baits were delivered off roads where preferred habitat coverage and complexity was more pronounced. In contrast, in artificial landscapes with either more strongly juxtaposed favored habitats and/or higher proportions of favored habitats, habitat baiting performed better than actual baiting, even when raccoons displayed weak habitat preferences and where baiting was constrained to roads. Our results suggest that habitat selection‐based baiting could increase raccoon population seroprevalence in urban–suburban areas, where practical, given the heterogeneity and availability of preferred habitat types in those areas. Our novel simulation approach provides a flexible framework to test alternative baiting strategies in multiclass landscapes to optimize bait‐distribution strategies.

Keywords: bait uptake, habitat selection analysis, hand baiting, individual‐based model, movement ecology, oral rabies vaccination (ORV), rabies virus, raccoons, resource selection function (RSF), wildlife baiting

INTRODUCTION

Oral baiting is commonly used in invasive species and infectious disease management to deliver toxicants, biologics or pharmaceuticals to wildlife across landscape‐level scales (Howald et al., 2007; Savarie et al., 2001; Slate et al., 2009). For instance, vaccine‐laden baits targeting disease reservoir populations are typically deployed at large spatial scales as part of disease management efforts to control or eliminate pathogens such as rabies virus, bovine tuberculosis, and sylvatic plague (Mencher et al., 2004; Müller et al., 2015; Nugent et al., 2016). Vaccine baiting has also been used both experimentally and operationally to protect endangered animal populations threatened by infectious disease, including Allegheny woodrats at risk from raccoon roundworm and Ethiopian wolf populations threatened by rabies virus (Haydon et al., 2006; Sillero‐Zubiri et al., 2016; Smyser et al., 2013). In invasive species management, baited lethal toxicants and fertility control vaccines have been deployed over large spatial scales to reduce vertebrate pest populations such as brushtail possums (Tompkins & Ramsey, 2007). Across diverse management objectives, a central challenge in wildlife baiting is how to deliver and distribute baits to maximize bait encounter and consumption by free‐ranging target animal populations, particularly across heterogeneous, multiclass landscapes.

Bait consumption by wildlife requires placing baits in areas where animals will find and consume them within hours to days. One strategy to improve encounter rates (i.e., rates of exposure to baits by wildlife, given bait availability) is to draw from methods in movement ecology to examine how target populations use the landscape and incorporate animal–habitat association patterns into the spatial design of baiting programs (Beasley et al., 2015). This baiting strategy could benefit from recent advancements in wildlife tracking and biotelemetry technologies that have led to a significant increase in the availability of wildlife movement data, along with the concurrent development of analytical frameworks to quantify animal movement and habitat selection across gradients of land use and habitat complexity (Kays et al., 2015; Long & Nelson, 2013; Nathan et al., 2008; Tomkiewicz et al., 2010). For instance, habitat selection analyses are a set of statistical approaches that link individuals to their environment to identify habitat selection patterns, including avoidance and preferential use of a resource or habitat type. One common approach uses resource selection functions (RSF; Boyce et al., 2002) to estimate habitat selection using land cover or environmental conditions coupled with Global Positioning System (GPS) location data, and can be used to predict the relative probability of occurrence of animals on the landscape (Johnson, 1980). These methods could help to improve wildlife baiting effectiveness by incorporating movement behavior and space use patterns into stratified baiting designs to increase bait encounter and uptake rates among target populations. There is a growing appreciation that habitat selection analyses can be used to improve bait encounter rates by better understanding where animals are most likely to optimally forage (e.g., Berentsen et al., 2013; Schneider et al., 2019). Yet habitat selection patterns have been rarely explicitly included in invasive species and disease management and planning (Beasley et al., 2015; Boyer et al., 2011).

Raccoon rabies virus variant (RRV) is a wildlife zoonosis in North America that has been managed using oral vaccine baiting (Slate et al., 2020). Rabies virus (RV) is a single‐stranded RNA virus in the genus Lyssavirus that is transmitted between animals by direct contact, and can lead to a central nervous system infection that is invariably fatal across mammals (Rupprecht et al., 2002; Wunner, 2007). In North America, at least eight distinct rabies variants are maintained in wild carnivore reservoir species, including RRV (Gilbert, 2018), which accounts for the majority of RV exposures to humans and spillover infections among animals in the United States (Pieracci et al., 2019; Wallace et al., 2014). Along the eastern US seaboard, RRV is enzootic in raccoons (Procyon lotor), an urban‐adapted meso‐carnivore that is ubiquitous in both rural and developed landscapes (Hadidian et al., 2010). Coordinated RRV management in the United States, led by the US Department of Agriculture Animal and Plant Health Inspection Service National Rabies Management Program (USDA‐APHIS NRMP), utilizes oral rabies vaccination (ORV) as the primary strategy to reduce the susceptible fraction of individuals in target raccoon populations and contain the westward spread of RRV from the eastern United States (Slate et al., 2009). Oral rabies vaccines used in the United States are enclosed in plastic sachets or blister packs coated in fishmeal or sweet vanilla attractant that induce immunity when ingested by raccoons and other target wildlife (Blanton et al., 2018; Gilbert, Johnson, Nelson, et al., 2018; Moore et al., 2017; Slate et al., 2009). Sustained annual ORV led to the successful elimination of canine RV variant from coyotes in the United States and red fox RV variant throughout most of the European Union (Muller & Freuling, 2018; Sidwa et al., 2005). Achieving sufficient population‐level vaccination coverage in North American raccoon populations has been challenging, however, particularly in urban areas where raccoons reach high densities and bait delivery is typically accomplished by hand baiting from vehicles (Gilbert & Chipman, 2020; Riley et al., 1998).

Components of baiting strategies that can be manipulated to improve bait consumption within budgetary, personnel, and logistic constraints include bait density (baits/km2) and the spatial arrangement of baits applied to the landscape (where baits are placed, e.g., along roads or targeting specific land cover classes) (Gilbert & Chipman, 2020; WHO, 2018). The objective of this study was to investigate conditions of raccoon habitat selection in heterogeneous landscapes that could increase the consumption of oral rabies vaccine baits and population‐level antibody seroconversion. Specifically, we evaluated raccoon habitat selection and avoidance conditions that could improve the effectiveness of ORV baiting strategies in urban–suburban landscapes. To address these questions, we first characterized raccoon habitat preferences using RSF estimated from GPS location data from raccoons captured within an ORV zone in Burlington, Vermont, USA. Next, we developed a spatially explicit, individual‐based model (IBM) of raccoon movement and bait consumption to predict population‐level rabies antibody seroconversion, or seroprevalence, under different spatial baiting designs and habitat selection patterns (e.g., data‐based vs. more specialist or generalist). We applied our simulation framework to an 81 km2 gridded landscape in Burlington as well as artificial landscapes that varied in landscape composition (i.e., the identity and proportion of land cover types) and patch size of landcover types. We hypothesized that using data‐based movement and habitat selection patterns of raccoons to inform the spatial distribution of baits would increase vaccine bait encounters and seroconversion for raccoons relative to standard baiting conditions. Our novel simulation framework provides insight into how habitat selection behavior could guide wildlife or disease management strategies using oral baiting and could be readily extended to model diverse movement behaviors across a variety of heterogeneous landscapes to determine optimal bait‐distribution strategies.

METHODS

Study area and data collection

Study area

Our study area is located within a 222 km2 ORV management zone in the greater Burlington, Vermont area designed to control RRV in target populations of raccoons, striped skunk (Mephitis mephitis), gray and red foxes (Urocyon cinereoargenteus and Vulpes vulpes, respectively), bobcats (Lynx rufus), and coyotes (Canis latrans) (Figure 1a). The area is characterized by suburban and urban land‐use types embedded within a matrix composed of undeveloped land and open space, deciduous forests, and farmland. The meso‐carnivore species composition in this area includes several species that can act as bait competitors such as the domestic cat (Felis catus) and Virginia opossum (Didelphis virginianus) (Slate et al., 2020).

FIGURE 1.

FIGURE 1

Actual and artificial landscapes used in movement and bait seroconversion simulations. (a) The 81‐km2 study area within a current ORV zone in Burlington, Vermont, USA used in simulations (with regional area map shown, bottom left), comprising nine landcover types at a 30‐m spatial resolution. In a separate analysis, four types of multiclass, artificial landscapes of similar area and spatial resolution were used in simulations, each consisting of two parameters: Patch size (P) and landscape composition (C). Relative to Burlington, simulated landscapes had: (b) similar patch sizes and amount of preferred habitat; (c) smaller patch sizes; (d) more preferred habitat; or (e) smaller patch sizes and more preferred habitat

Actual ORV baiting

During 2016–2017, ORV bait distribution was planned and executed within the Burlington ORV zone by the NRMP. The ORV baits were distributed along roads and deployed by hand and vehicle within habitat defined operationally as baitable using the following procedure. The Burlington ORV zone was divided into six planning subunits, each averaging 37 km2. Each subunit was baited at a target density of 150 baits/km2 across landcover types characterized by the Multiresolution Land Characteristics Consortium's National Land Cover Data 2011 (NLCD; Homer et al., 2015). The number of baits required to meet density targets at the subunit level were calculated using a habitat‐based algorithm, defined operationally as an off‐time calculator, that was based on expert opinion of raccoon ecology by the ORV team at the USDA‐APHIS NRMP. The algorithm reduces bait distribution in some land cover types while the remaining land cover types are baited at a target density of 150 baits/km2 for the subunit. Specifically, no baits are placed in open water (NLCD land cover category = 11) or barren (NLCD = 31) land cover types. In low, medium, and high intensity development and pasture/hay land cover types (NLCD = 22–24, 81; respectively), baits are placed at lower target densities (97.5, 52.5, 15, and 75 baits/km2, respectively). During bait delivery operations in August 2016 and 2017, point location data were collected for each bait deployed across the Burlington ORV zone using Point of Interest GPS technology (“NRMP baiting” from this point forward; Appendix S1: Figure S1; Tsi GL‐770, Transystem Inc., Hsinchu City, Chinese Taipei).

Our simulated focal landscape encompassed an 81‐km2 gridded landscape within the larger Burlington ORV zone, and had a 900‐m2 subunit resolution (30 m × 30 m grid cells; described in detail in the following paragraphs). The average bait density distributed by NRMP using the bait delivery algorithm was 110 baits/km2 across the study area we defined, given the land cover composition within this area and the associated land cover‐specific target densities (please refer to Appendix S1: Table S1 for the composition and total area of NLCD land cover types within our study area used in bait delivery planning). To reflect NRMP average baiting levels in our defined study area, we implemented an average bait density of 110 baits/km2 for baiting simulations. Therefore the average bait densities for NRMP‐based and habitat selection‐based baiting were similar, but the densities within particular landcover types were different. This approach allowed for comparison between NRMP conditions and our simulated habitat selection‐based baiting strategy, which by design lacked most land cover‐based restrictions except for those related to habitat selection patterns (details below). We used a finer spatial scale in our simulations than that used for operational bait delivery, because we estimated habitat selection at this smaller spatial scale and because it enabled the simplifying assumption that raccoons and baits located within the same grid cell equated to a raccoon encountering a bait.

Raccoon capture and tracking

Raccoons were captured prior to fall ORV during 2016 using cage traps (Tomahawk model 608, Tomahawk Live Trap, Wisconsin, USA). We fitted 25 individuals with Q4000E GPS collars (Telemetry Solutions, California, USA) equipped with very high frequency (VHF) beacons. During July through September, individual raccoon GPS relocation data, or fixes, were collected every 30 min to 6 h. This study followed guidelines outlined by the Institutional Animal Care and Use Committees of the University of New Hampshire (#160901) and USDA‐APHIS National Wildlife Research Center (QA2669). In this area, population‐level virus neutralizing antibody seroprevalence was estimated through pre‐ORV and post‐ORV serum sampling of target meso‐carnivore populations, as described in Gilbert, Johnson, Nelson, et al. (2018).

Simulation model

Overview

The workflow of our analyses and simulation framework is described in Figure 2. First, we analyzed raccoon GPS data (Figure 2.1a) to: (1) calculate distances moved by individual raccoons at a 30‐min time step (i.e., step lengths; the distribution of movement distances at each time step for each individual); and (2) estimate resource selection coefficients for each raccoon using landcover data from the 30 m resolution raster NLCD land cover data (Homer et al., 2015; Figure 2.1b,c). We then developed an IBM of raccoon movement and bait encounter informed by these analyses that matched the spatial resolution of the habitat selection analysis and the temporal resolution of the GPS data collection (Figure 2.2d). To investigate the effects of raccoon habitat selection, we considered a continuum of selection strength ranging from more general to more specialized, which were both relative to the estimated habitat selection of radio‐tracked raccoons, and modeled individual‐level and population‐level habitat selection, in separate simulations. We held individual‐level movement parameters constant across different habitat selection conditions to focus on the effect of magnitude and variation in habitat selection on predicted bait encounter and seroconversion (Figure 2.2d).

FIGURE 2.

FIGURE 2

Simulation workflow. To simulate raccoon movement and oral‐baited rabies vaccine seroconversion, we first collected (a) GPS relocation data from 25 wild‐caught raccoons captured within an oral rabies vaccination (ORV) vaccination zone in Burlington, Vermont, USA during July–September 2016. We used (b) 30‐m resolution raster land cover data reclassified into nine land cover types to (c) fit resource selection functions (RSF) to individual‐level raccoon relocation data and fit a gamma distribution to individual‐level 30‐min interval distances moved (step lengths; in m). (d) Next, we simulated raccoon movement across gridded landscapes composed of nine land cover types according to different assumptions of habitat selection behavior, each in separate simulations. Then we simulated different ORV baiting designs (e–g) and (h) spatially overlaid raccoons and baits. We calculated the probability of seroconversion in individual raccoons given within‐cell vaccine bait co‐location using a discrete daily decay function (d[t], please refer to text), consumption rate given co‐location (u = 0.5), seroconversion rate given consumption (s = 0.9), and randomly assigned baits for potential consumption if multiple raccoons were present in a cell (N = total within‐cell raccoons)

Next, to explore the importance of raccoon habitat selection on bait encounter using different baiting designs, we simulated baiting designs that differed relative to NRMP baiting operations in three components of baiting designs: (1) the spatial arrangement of baits (i.e., the proportion of baits in different landcover types and road‐limited vs. area‐wide baiting); (2) coverage (evenness of bait distribution across the study area); and (3) density (baits/km2) (Figure 2.3e–g). We then overlaid simulated baiting designs on raccoon movement scenarios and estimated the proportion of raccoons that encountered and consumed a vaccine bait, resulting in seroconversion (rabies antibody seroprevalence of the simulated population; main output of the simulation model). Bait consumption and seroconversion involved three processes (Figure 2): (1) co‐location of a raccoon and bait within the same grid cell; (2) bait consumption given co‐location that accounted for non‐target and conspecific bait competition and reduced bait availability over time; and (3) seroconversion given bait consumption. We estimated seroprevalence for each set of conditions relative to operational baiting and data‐based raccoon movement in the area (Figure 2.3h,4).

Finally, to investigate how landscape heterogeneity influences the effectiveness of baiting designs based on raccoon movement ecology, we compared outcomes conducted on the landscape in our study area of Burlington, Vermont to those from identically sized, artificial landscapes that differed in the proportion and patch size of landcover types preferred by radio‐tracked raccoons in Burlington (Figure 1). Simulations and data analysis were conducted in R v.3.6.2 (please refer to Data S1 for simulation code; R Core Team, 2019). We describe each component of the analysis in detail in the following sections.

Estimation of habitat selection and movement distances from GPS data

We used RSF (Boyce et al., 2002) to evaluate raccoon third‐order (within‐home range) habitat selection using a use‐availability design (Johnson, 1980). We compared GPS locations of 25 individual raccoons to available points (n = 10,000) generated within each raccoon's seasonal late summer/autumn home range. We used 95% kernel density estimation (KDE) to estimate home range size during the 3 months of telemetry data collection. Because this 3 month duration may not represent stationary raccoon home ranges, we opted for a simple (and potentially more conservative) estimate of home range size that better reflected actual use instead of including probable future use in the delineation (e.g., autocorrelated KDE; Noonan et al., 2019). Landcover was extracted for all locations from NLCD land cover data (R package raster; Hijmans, 2021). We reclassified land cover into nine categories that we assumed were functionally relevant to raccoon ecology as described in Davis et al. (2019): open‐space and low‐density development, medium‐ to high‐density development, deciduous and mixed forest, coniferous forest, shrub and grassland, pasture, crops, wetlands, and other (Appendix S1: Table S1). Individual‐level RSF coefficients for each land cover type relative to open‐space and low‐density development were estimated using an exponential regression (fitted using a logistic regression; McDonald, 2013) using the IndRSA package (https://github.com/BastilleRousseau/IndRSA; Bastille‐Rousseau & Wittemyer, 2019). We estimated population‐level RSF coefficients using generalized linear mixed models with a binomial distribution, a logit link, and individual as a random intercept (Gillies et al., 2006, package lme4 in R; Bates et al., 2015). We estimated distributions of step lengths—distances moved by individuals at a 30‐min time scale—by fitting a gamma distribution to the distances (continuous measure of distance in meters; with gamma distribution parameters shape and scale; Appendix S1: Table S2) between GPS relocation fixes of each tracked raccoon at a 30‐min interval.

Simulation of raccoon movement

We simulated discrete‐space raccoon movement across 30 m spatial resolution gridded landscapes (30 m × 30 m; 900 m2 cell size, the same spatial resolution as the land cover data) composed of nine landcover types using a biased random walk algorithm (Uhlenbeck & Ornstein, 1930). Raccoons moved among grid cells according to rules governed by three independently parameterized processes, each given equal weight, including raccoon density, home range attraction, and habitat selection informed by landcover and our habitat selection analyses (Figure 2a–d). Movement was modeled at a 30‐min time step to match the temporal resolution (i.e., fix rate) of raccoon GPS data. For each raccoon at each time step, a continuous distance was randomly drawn from the step length distribution. For distances <15 m, individuals stayed within the cell at time t + 1, whereas for step lengths >15 m, a set of potential destination grid cells surrounding the individual's current cell location were defined. The product of three processes was used to weight the cell‐level probability of movement to each potential destination cell: (1) habitat selection; (2) home range attraction; and (3) conspecific avoidance relative to host density. The probability of selecting a cell based on habitat selection was weighted using RSF coefficients, calculated at the individual or population level depending on the movement scenario, as:

wi,jx=expβi,jexpβmax,j

where w(x) is the relative habitat selection strength at cell x of individual or population j for landcover type i in geographical space, β i is the selection coefficient for landcover type i, and β max is the largest estimated habitat selection coefficient for individual or population j. Home range attraction, h, was modeled to constrain raccoon movement within a home range area, and was calculated as a discrete approximation of a negative exponential function, where the squared distance (in m) of cell k from the home range centroid was calculated as:

hj,k=expbxrxc2

where b is the decay rate, x are points in Euclidean space, c is the centroid of cell k and r the home range center point of individual j. Finally, we modeled conspecific density‐dependent effects on movement behavior, which we calculated as the inverse of the count of raccoons in a cell in the previous time step. Simulations were performed for 1440 time‐steps, equivalent to 1 month of movement.

To explore the effects of magnitude and variation in raccoon habitat selection on bait encounter across similar conditions of habitat availability, we simulated movements in the gridded landscape in greater Burlington that differed in the strength of individual‐level and population‐level habitat selection (i.e., data‐based, generalist, or specialist) (Table 1). Data‐based raccoon movement reflected habitat selection patterns estimated using GPS data from radio‐tracked raccoons in greater Burlington, which suggested that raccoons in this area exhibit substantial individual variation in habitat selection resulting in weak population‐level habitat selection (Table 1; Appendix S1: Table S2). Generalist movement reflected a theoretical case in which animals neither preferred or avoided any land cover type; it was therefore equivalent to random movement with respect to land cover but was constrained by conspecific density and home range attraction. Specialist movement behaviors were also theoretical but informed by data in that they were modeled by doubling the data‐based estimated RSF coefficients for the preferred landcover types for radio‐tracked raccoons (preferred types: NLCD‐classified deciduous [41] and mixed forest [43] land cover classes and wetland areas including woody wetlands [90] and herbaceous wetlands [95]; Table 1; Appendix S1: Table S2). In the individual‐level data‐based selection scenario, we incorporated estimated resource selection coefficients for individual radio‐tagged raccoons (Appendix S1: Table S2), assigned randomly to each simulated individual at the start of each simulation and in tandem with an individual's associated movement parameters. The population‐level data‐based scenario reflected the average habitat selection response of radio‐tagged raccoons, drawn from the population‐level habitat selection analysis, such that selection was constant among individuals (Appendix S1: Table S2). Under our population‐based specialist scenario, all individuals exhibited constant, strong selection, while individuals in the individual‐based specialist scenario exhibited variation in habitat selection strength among individuals (Appendix S1: Table S2). Comparing results across the continuum of habitat specialization and variability allows for inference about how baiting designs can be optimized based on knowledge of local animal movement behavior and the influence of individual‐level movement heterogeneity (e.g., McClure et al., 2020). Each habitat selection scenario was applied at three raccoon densities that represent a realistic range of raccoon densities in suburban–urban landscapes (5, 15, 30 raccoons/km2; Urban, 1970, Moore & Kennedy, 1985, Slate et al., 2020). Each raccoon movement scenario (habitat selection scenario × raccoon density) was repeated 100 times.

TABLE 1.

Raccoon habitat selection patterns and bait component scenarios implemented in simulations

Raccoons Baiting
Initiation of raccoon on the landscape Habitat selection Density (inds/km2) Distribution: landcover targeting Distribution: road targeting Coverage (% grid cells with baits) Density (baits/km2)
Random Generalist 30, 15, 5 Habitat selection‐based versus NRMP off‐time calculator Road‐limited (NRMP) versus area‐wide 3% (NRMP 2016) versus 6% (NRMP 2017) High (NRMP) versus low
Based on similar population‐level resource use Data based, population average 30, 15, 5 Habitat selection‐based versus NRMP off‐time calculator Road‐limited (NRMP) versus area‐wide 3% (NRMP 2016) versus 6% (NRMP 2017) High (NRMP) versus low
Near favored habitat (deciduous and wetland) Specialist, population average 30, 15, 5 Habitat selection‐based versus NRMP off‐time calculator Road‐limited (NRMP) versus area‐wide 3% (NRMP 2016) versus 6% (NRMP 2017) High (NRMP) versus low
Based on similar individual‐level habitat selection Data‐based, individual variation 30, 15, 5 Habitat selection‐based versus NRMP off‐time calculator Road‐limited (NRMP) versus area‐wide 3% (NRMP 2016) versus 6% (NRMP 2017) High (NRMP) versus low
Near favored habitat (deciduous and wetland) Specialist, individual variation 30, 15, 5 Habitat selection‐based versus NRMP off‐time calculator Road‐limited (NRMP) versus area‐wide 3% (NRMP 2016) versus 6% (NRMP 2017) High (NRMP) versus low

Note: High bait density = 110 baits/km2 and low bait density = 55 baits/km2.

Initialization of raccoon movement simulations

Raccoon populations were initialized on the landscape for each simulation iteration using the habitat selection patterns described in the previous section. Initial locations were generated at random for generalist movement conditions (Appendix S1: Figure S2b). For data‐based scenarios, we evaluated the composition of each individual and population‐based range in terms of landcover type (Appendix S1: Figure S2a). We extracted the proportion of each landcover type around each grid cell within 20 cells or a 600 m radius (e.g., corresponding to the average estimated Burlington raccoon home range size, data not shown) and initiated individuals proportionally to the similarity (i.e., how similar the area is in terms of proportion of each landcover) between observed home range composition and surrounding grid cells. For specialist scenarios, initial locations occurred in areas with higher abundance of selected landcover types (woody and herbaceous wetland and deciduous or mixed forest) within a 600 m radius (Appendix S1: Figure S2c).

Simulation of bait consumption and seroconversion

Baits were delivered within cells on day 20 of each movement simulation. We assumed each raccoon co‐located with a bait in a grid cell had a bait consumption probability of 0.5 based on the expert opinion of NRMP (Figure 2). Spatial overlap between baits and target animals on the landscape are necessary for bait uptake by target animals, but other factors such as bait competition both from conspecifics and non‐target species also influence bait uptake probability (Elmore et al., 2017; Slate et al., 2020). We accounted for bait competition from conspecifics by randomly selecting one raccoon to encounter the bait when multiple raccoons were co‐located in a cell, leading to a bait consumption probability of less than 0.5 when raccoon densities were high within grid cells. To account for competition from non‐target carnivores such as opossums (Slate et al., 2020) and decreasing bait palatability over time, we included a discrete decay function for bait availability in which 30% of baits within a grid cell were randomly removed every 12 h (discrete equation: n h= n init × .70h/12, where h = hour, n = number of baits, init = initial time step; similar to bait disappearance rates reported by Smyser et al., 2013), with a maximum bait availability time of 10 days. Last, we assumed that seroconversion probability, given consumption, was 0.9 to reflect immunogenicity following oral contact with the vaccine (Brown et al., 2012; Gilbert, Johnson, Walker, et al., 2018). For each simulation, we extracted the proportion of raccoons that seroconverted, or rabies antibody seroprevalence.

Baiting designs

We modified three components of baiting strategies: spatial arrangement, coverage, and bait density. Spatial arrangement included two conditions for how the baits were placed relative to landcover data: (1) using NRMP bait distribution that incorporated the habitat‐based off‐time calculator (NRMP baiting); or (2) using raccoon habitat selection patterns as described above (described from this point forwards as habitat baiting). To simulate habitat baiting targeting specialist and data‐based raccoons, baits were distributed proportionally to resource selection of a given landcover type according to population‐level RSF coefficients as described above. For strict generalists that did not display habitat preferences or avoidances, baits were randomly distributed among all landcover types except open water. Across habitat‐varying spatial delivery strategies, each condition was simulated by either constraining baiting delivery to roads only (road‐limited baiting; actual condition) or by delivering baits over the entire study area (area‐wide baiting; alternative condition). We examined two bait densities: one that was 110 baits/km2 across all landcover types including those with reduced or no baiting applied as described above (high bait density; equivalent to 150 baits/km2 in NRMP‐defined baitable habitats as described above) and a lower density condition of 55 baits/km2 across all landcover types (low bait density; equivalent to 75 baits/km2 in NRMP‐targeted habitats). Finally, we compared two levels of grid cell coverage, although this factor is not routinely measured for spatial planning of bait delivery by NRMP. Low coverage included 3% (1233/41,100) of grid cells with baits (similar to NRMP baiting pattern in 2016) while high coverage included 6% (2466/41,100) of grid cells with baits (similar to NRMP baiting pattern in 2017). We caution that operational baiting strategies are implemented at a larger spatial resolution than the scale at which we modeled bait delivery. However, because NRMP baiting varied among years in overall landscape coverage, we used the concept of grid cell coverage to examine the evenness of baiting effort across space in an ORV area. The full set of raccoon movement × bait strategy simulation scenarios, 240 in total, are described in Table 1.

Artificial landscapes

To explore how landscape characteristics and road structure in Burlington influenced our results, we conducted a separate set of simulations on artificial landscapes that varied in the proportion of land cover types preferred by raccoons (landscape composition) and the clustering of those land cover types across the study area (patch size based on fractal dimension). We generated neutral landscapes using fractional Brownian motion with the R package NLMR (Sciaini et al., 2018). We simulated four artificial landscapes with the same road structure and spatial extent as our study area that differed in one or both dimensions of patch size and landscape composition relative to Burlington. Specifically, these four artificial landscapes had: (1) similar patch sizes and proportion of all landcover types as Burlington (Figure 2b); (2) smaller patch sizes of preferred habitat (i.e., more fragmented) but with the same landscape composition as observed in Burlington (Figure 2c); (3) similar patch sizes as in Burlington, but with an increase in preferred habitat relative to Burlington (i.e., an equal proportion of each landcover type and therefore higher proportion of preferred habitat; Figure 2d); and (4) smaller patch sizes of preferred habitat and an increase in preferred habitat relative to Burlington Figure 2e).

For each artificial landscape, we simulated raccoon movement with either data‐based or specialist habitat selection patterns estimated from radio‐tagged raccoons captured in Burlington, as described previously. We assumed similar individual‐level habitat selection for movement simulations in these artificial landscapes (i.e., not the population average nor population level) along with conspecific density and home range attraction movement constraints. We created a different landscape for each iteration and used NRMP conditions for raccoon and bait density parameters (15 raccoons/km2, high bait density application) because simulation results on the Burlington landscape did not indicate interactions in these parameters. For each habitat selection condition, we compared: (1) habitat baiting to NRMP baiting; (2) road‐limited to area‐wide baiting; and (3) coverage of 3% versus 6% of study grid cells (Table 1).

Statistical analyses

We used a linear mixed effects model with a logit link to analyze the relative impacts of baiting strategy features on the primary model outcome: rabies antibody seroprevalence. All covariates were considered as categorical (i.e., “dummy” variables). Replicate was added as a random intercept because each scenario was repeated 100 times. Simulation parameters (habitat selection patterns by raccoons, raccoon density, bait distribution by landcover, bait density, bait coverage, and road‐only vs. area‐wide baiting) were included as main effects. An interaction between raccoon habitat selection and bait distribution by landcover, and a series of three‐way interactions of this interaction with all other parameters were also added. Heat maps were produced from the model predictions to illustrate the impact of all parameters and their interactive influences relative to NRMP conditions (data‐based habitat selection by raccoons and NRMP‐based baiting from 2016: high bait density, road‐limited baiting, 3% coverage, which includes the NRMP's off‐time algorithm for determining distribution of baits to different landcover types). Simulations based on artificial landscapes were analyzed similarly. In this case, an interaction between habitat selection by raccoons and landscape type was added and a series of three‐way interactions with all other parameters.

RESULTS

Habitat selection and step length patterns

At the population level, raccoons displayed selection for woody and herbaceous wetlands, deciduous and mixed forest, and grassland and shrub land cover types relative to developed open space and low intensity development. Raccoons exhibited substantial individual variation in resource selection with some individuals selecting resources avoided by other raccoons (Appendix S1: Table S2). Individual response was especially strong for deciduous and mixed forest with 56% (14/25) of individuals selecting it and 28% (7/25) of individuals avoiding it, and for wetlands with 52% (13/25) and 32% (8/25) of individuals selecting and avoiding it, respectively. Raccoons consistently avoided medium and high intensity development relative to open space and low intensity development (92%, 23/25). Individual variation was also present in step length (Appendix S1: Table S2).

Effects of bait distribution

Our model was scaled to predict post‐ORV population‐level seroprevalence among raccoons at similar levels to that measured seasonally by NRMP in Burlington during 2016 and 2017 (44% [N = 195] and 27% [N = 234] respectively; our model: 35 [34–36 CI]% under 2016 baiting conditions; Figure 3a). Contrary to our predictions, for data‐based raccoon movement, seroprevalence predictions were similar or slightly lower under habitat‐based baiting relative to NRMP baiting for road delivery (Figure 3a,b,d), but with area‐wide baiting the habitat‐based baiting led to higher seroprevalence as we predicted (Figure 3c). However, if raccoons were either habitat generalists or specialists, seroprevalence was substantially higher compared with NRMP baiting when baiting matched habitat selection patterns (up to 21% higher for specialist) under all conditions (Figure 3). Overall, using population‐level movement rules increased seroprevalence predictions for all combinations compared with individual‐level movement rules (Appendix S1: Figure S3), suggesting that higher individual‐level variation in habitat selection decreases seroprevalence under any given baiting design.

FIGURE 3.

FIGURE 3

Effects of baiting design and raccoon habitat selection on predicted rabies seroprevalence. Plots show absolute difference in seroprevalence for different baiting designs relative to NRMP conditions (white block in (a), with predicted absolute seroprevalence of 0.35). Red shades indicate that the design leads to lower seroprevalence relative to NRMP baiting conditions while blue shades indicate higher seroprevalence. Rows in each panel correspond to the spatial distribution of baiting strategies across land cover types (i.e., proportion of baits distributed to different landcover types). Habitat‐based and NRMP‐based baiting stratifies baiting using habitat selection patterns and an algorithm drawn from decades of raccoon ORV experience by the NRMP, respectively. Columns correspond to raccoon habitat selection behaviors. Labels on top of the panels indicate changes in the baiting strategy relative to NRMP conditions with (a) representing standard NRMP delivery and distribution, (b) lower bait density, (c) bait were distributed across the full area rather than on roads, and (d) spatial coverage was doubled, to 6%

Effects of bait density and coverage

Bait density and coverage affected overall seroprevalence, but not which baiting design was best relative to raccoon movement (Figure 3b,d). Decreasing the bait density from our high to low treatment decreased seroprevalence by 11% under otherwise standard NRMP baiting conditions (Figure 3b). Increasing grid cell baiting coverage from 3% to 6% increased seroprevalence by 8.5%. However, although predicted seroprevalence of the habitat‐based strategy was similar to the NRMP baiting strategy under both bait density scenarios, it unexpectedly performed worse than the NRMP baiting strategy along roads when coverage was increased from 3% to 6%.

Effects of raccoon density

Raccoon density had a strong impact on predicted seroprevalence but did not influence which strategy led to greater seroprevalence (Figure 4), indicating that the baiting strategies acted similarly across the raccoon densities we examined (Appendix S1: Table S3). Under the observed baiting and movement conditions, seroprevalence was predicted to be 3% higher when raccoon density was decreased from 15 to 5 raccoons/km2 and 3% lower when raccoon density was doubled, from 15 to 30 raccoons/km2. This indicates that while raccoon density is a significant factor driving overall seroprevalence, it does not affect whether habitat‐based or NRMP‐based baiting is more effective.

FIGURE 4.

FIGURE 4

Effects of raccoon density. Panels are the same as in Figure 3 except that NRMP conditions are in the lower middle of panel (b) (white block, predicted absolute seroprevalence of 0.35) and each panel reflects results for different raccoon densities: (a) 5 individuals/km2, (b) 15 individuals/km2, and (c) 30 individuals/km2

Effects of landscape composition and structure

The result that habitat‐based baiting was only advantageous when habitat selection was strong or with area‐wide baiting suggested that some of our results may have been impacted by the specific road structure relative to landscape composition and patch size in Burlington. Visual inspection of the Burlington landscape revealed that most roads do not intersect raccoon‐preferred habitat and the habitat roads do intersect is relatively homogenous (i.e., large patch size). Therefore, we compared seroprevalence for the habitat‐based and NRMP baiting strategies using data‐based versus specialist raccoon habitat selection in artificial landscapes, while assuming the same area and road structure as in Burlington (Figure 5). Here, we found that when there was a higher proportion of raccoon‐preferred habitat or smaller patch sizes, habitat‐based baiting was better, even when raccoons displayed weak selection for preferred land cover types (i.e., reflecting data‐based habitat selection patterns) and using road‐based delivery methods (Figure 5a,b). We also found that the importance of area‐wide baiting for increasing seroprevalence was reduced in these other landscapes (higher proportion of raccoon‐preferred habitat, smaller patch size) relative to Burlington (where patch sizes were large and raccoon‐preferred habitat was limited; Figure 5c). In other words, in these artificial landscapes, the amount of benefit gained from habitat‐based baiting depended on the composition and patch size of raccoon‐preferred habitat relative to raccoon movement patterns, especially in proximity to roadways. Increasing coverage from 3% to 6% increased seroprevalence rates by up to 18% in all the artificial landscapes and by 5% in Burlington (Figure 5d), suggesting that targeting habitat along roads more systematically may improve seroprevalence under many different landscape conditions.

FIGURE 5.

FIGURE 5

Effects of landscape composition and patch size. Rows within panels describe different landscape conditions: Burlington, Vermont, USA (“actual”) and four simulated landscapes comprised of two landscape metrics relative to Burlington (described in Figure 1): Patch size (P) and proportion (C) of preferred habitat of raccoons. Columns correspond to raccoon habitat selection behavior (“data‐based” describes weak habitat selection whereas “specialist” describes strong habitat selection). Colors represent absolute differences in seroprevalence relative to the NRMP conditions (white square in lower left corner in (a); 0.35 predicted seroprevalence) as described in Figure 3. Labels on top of the panels indicate changes in the baiting strategy relative to NRMP conditions

DISCUSSION

The effectiveness of ORV programs targeting raccoons can be hindered by challenges associated with landscape‐level bait delivery and processes that influence bait uptake rates by raccoons across heterogeneous landscapes. We developed a novel simulation framework that incorporates movement behavior of free‐ranging raccoons, realistic multiclass landscapes, and spatial bait data from previous ORV efforts to explore if and how raccoon movement behavior could be integrated to increase oral vaccine baiting‐associated population immunity to RV. We identified raccoon habitat‐specialization conditions and landscape characteristics that determine how different components of baiting strategies can be altered to optimize population seroconversion to ORV in urban and suburban areas. We found that habitat‐based baiting increased seroprevalence when raccoons showed strong habitat selection patterns or when landscapes had substantial areas of raccoon‐preferred habitat and were more heterogeneous (small patch sizes), suggesting that habitat baiting using selection patterns could be beneficial in some but not all landscape contexts. Relatedly, we showed that individual‐level variability in raccoon habitat preference and avoidance patterns decreased seroprevalence using any baiting design. Finally, increasing bait coverage, bait density, or expanding the distribution of baits beyond roads led to higher seroprevalence under all baiting designs, but these components of baiting strategies did not affect whether or not it is advantageous to do habitat‐based versus NRMP‐based baiting.

In our models, habitat‐based baiting in the greater Burlington ORV area increased seroprevalence for raccoon populations characterized as habitat specialists or strict generalists, but not for raccoons displaying weak habitat selection patterns similar to those exhibited by radio‐tracked individuals. Raccoons are commonly described as ecological generalists, and are widespread in rural and agricultural areas, prairie ecosystems, and urban and suburban landscapes (Beasley et al., 2011; Chamberlain et al., 2007; Prange et al., 2003). At the population scale, our resource selection analysis suggested weak resource selection among raccoons for wooded areas and wetlands, consistent with other resource selection analyses in raccoons conducted across a variety of landscapes (Chamberlain et al., 2007; Prange et al., 2003; Urban, 1970). Yet, we also report substantial individual‐level variation in habitat selection strength, as well as a wide range of individual responses to a variety of habitats among radio‐tracked raccoons. This variation may reflect behavioral plasticity in response to fine‐scale environmental variability in resources across urban–suburban landscapes or could reflect heterogeneity among raccoons in their degree of individual specialization (Piersma & Drent, 2003; Schuttler et al., 2015). Individual‐level variation in habitat selection could reduce achieved seroprevalence using habitat‐based baiting designs by dampening the effects of a population‐level baiting design that uses population averages such as the one we modeled. Our results underscore the utility of leveraging variable individual habitat selection and avoidance to identify different behavioral tactics and their intrinsic and extrinsic drivers (Bastille‐Rousseau & Wittemyer, 2019), which could then be used to refine baiting to target specific combinations of strategies.

Our results suggest several promising avenues for optimizing the spatial distribution of baits targeting meso‐carnivores in urban–suburban landscapes. First, we found that seroprevalence gains were highest with area‐wide baiting relative to road‐limited baiting across all baiting designs all else being equal, because more of the raccoon‐preferred habitats were away from roads. In rural and agricultural areas, the standard approach to bait delivery is by fixed‐wing aircraft using GPS technologies and automated machinery to standardize and accurately deliver baits along preprogrammed and precisely spaced flight lines (Slate et al., 2009). In densely populated urban–suburban landscapes, however, fixed‐wing aircraft delivery is not feasible, and NRMP baiting is accomplished predominantly by hand baiting from vehicles along roadways (Slate et al., 2009) Our work indicates that alternative delivery methods such as helicopters or bait stations, which extend bait application beyond major roads in developed areas could improve baiting effectiveness and vaccination coverage (Berentsen et al., 2018; Slate et al., 2020). In addition, spatial bait coverage along roads could be further improved by incorporating minor roads into delivery planning in addition to major roads. This approach is currently being implemented by NRMP using smaller subunits for baiting targets (i.e., planning using 1 km2 rather than 37 km2 subunits). However, an important implication of our artificial landscape simulation results is that habitat‐based baiting can increase seroprevalence along roads dramatically, when the roads pass through heterogeneous and highly available raccoon‐preferred habitats.

A second point for spatial bait optimization is that bait density played an important role in predicting seroprevalence in our models, as expected. Rabies seroprevalence decreased significantly when bait density was halved, leading to a reduction in seroprevalence from 35% to 24% on average. The current target density for bait application in rural and urban–suburban ORV zones in the United States and Canada ranges from 37.5–300 baits/km2, with 75 (rural) and 150 baits/km2 (urban–suburban) being standard application rates (Slate et al., 2020). Our work suggests that the current target bait density of 150 baits/km2 may be the minimum lower threshold needed for effective baiting in urban areas with moderate to high raccoon densities (5–30 raccoons/km2). Given that baits are the most expensive cost associated with ORV baiting, the optimization of bait density represents an important avenue for increasing both cost and population‐level vaccination coverage effectiveness (Slate et al., 2020). Third, we found that increasing the spatial coverage of baits from 3% to 6% within the baiting area led to notable increases in seroprevalence, suggesting that, even within existing road delivery methods, baiting modifications that increase coverage (i.e., evenness of bait distribution) could yield significant gains in baiting effectiveness, provided that they are logistically feasible. Finally, we note that, although alternative baiting strategies increased predicted seroprevalence in our models relative to standard NRMP conditions, maximum predicted seroprevalence remained below 50%. These predicted seroprevalence levels are lower than the minimum predicted vaccination coverage (seroprevalence) needed to induce population‐level herd immunity based on rabies modeling efforts (Rees et al., 2013; Reynolds et al., 2015; Thulke & Eisinger, 2008). We note that a recent evaluation of RRV elimination status that included the Burlington, Vermont area suggested an ORV‐associated case reduction in the context of declining regional prevalence (Davis et al., 2019). There may be additional spatial factors at play regarding the landscape transition from rural to urban areas that impact RV control in raccoon populations in the northeastern United States, in part to explain why apparently suboptimal seroconversion may still be associated with case reduction in urban areas.

Urban development and land‐use change, including roads, influence landscape ecology and may impact target animal movements, space use, and bait availability. Roads can act as barriers to, or facilitate, movement in wildlife, either increasing habitat fragmentation or increasing landscape connectivity, depending on species and population‐specific behavioral responses (Coffin, 2007). Raccoons may avoid or be averse to crossing major roads while heavily using culverts and other road‐associated anthropogenic habitats for denning and foraging sites along smaller roads (Hoffmann & Gottschang, 1977; Prange et al., 2003). Major roads could constrain raccoon movement between large patches of preferred habitat through avoidance behaviors, decreasing the accessibility of habitats to raccoons and diminishing the effectiveness of habitat‐based baiting where baits are delivered on roads. Alternatively, raccoons may utilize road‐associated habitat indiscriminately, with the effects of roads on baiting effectiveness driven by road and landscape composition and their interactions with raccoon movement and habitat selection. We did not include raccoon behavioral responses to roads in our models, but our habitat selection analysis uncovered significant and consistent avoidance behaviors of raccoons to medium and high intensity development, which correlates with major road structure. An explicit consideration of how urban‐adapted meso‐carnivores respond to roads, with a specific emphasis on whether roads influence movements and habitat use in a manner that enhances or decreases bait encounter rates, could provide insight into optimal bait application along roads. Finally, given that gains in seroprevalence from habitat‐based baiting were greater in artificial landscapes for data‐based raccoon movement compared with the actual Burlington landscape, our artificial landscape analysis highlights the limits of generalizing results to other landscapes without a better understanding of how habitat selection among target wildlife interacts with road and landscape structure.

Spatial heterogeneity is both a cause and consequence of physical and biological processes that could influence wildlife disease management efforts using oral baiting strategies. Landscape heterogeneity can directly affect the movement and spatial distribution of wildlife at both broad and fine spatial scales, including for raccoons and other urban‐adapted meso‐carnivores such as striped skunks and coyotes (Cullingham et al., 2009; Rioux‐Paquette et al., 2014; Russell et al., 2005; Tardy et al., 2014). Spatial heterogeneities can also emerge from dynamic ecological processes such as sociality and demography. In our models, we included density‐dependent conspecific avoidance, because it can be an important cue for individual‐level movement decisions and because conspecific density can mediate space use through density‐dependent effects on habitat selection, including in raccoons (Tardy et al., 2014; White et al., 2018). However, we did not include social or family group behaviors in our models. Spatial heterogeneity in host–host contacts stemming from social behaviors could affect conspecific bait competition in a dynamic and non‐linear way that we did not capture in this work. Furthermore, contact heterogeneity can also have important implications for a directly transmitted pathogen such as RV (Reynolds et al., 2015). Raccoons exhibit a highly variable fission–fusion social structure that varies with seasonality, habitat availability and provisioning, and conspecific density (Cullingham et al., 2008; Dharmarajan et al., 2009; Gehrt & Fritzell, 1998). Conspecific behavior and social structure in raccoons may differ in urban environments relative to rural areas. Additional extensions of our modeling framework could therefore include social structure and conspecific behavior in urban‐adapted raccoons. An additional key extension to our modeling framework would be the inclusion of RV transmission and disease spread to explore the mechanistic effects of habitat selection and landscape heterogeneity on disease incidence and population‐level ORV effectiveness.

Our approach leverages methods in movement ecology to improve zoonotic disease management efforts and incorporates raccoon‐urban habitat associations through movement and habitat selection analyses informed by raccoon movement data. We implemented a third‐order within‐home range RSF for modeling raccoon movement that was informative at the spatial scale that baiting is conducted and could be flexibly applied to other wildlife and landscapes. RSFs provide an objective relative ranking of habitat or resources compared with ranking based on expert opinion often used in wildlife baiting programs. However, we note that depending on the species and movement parameters of interest, other approaches might also be applicable. For example, integrated Step Selection Analyses (iSSAs; Avgar et al., 2016) could be an efficient way of parameterizing movement‐based IBMs given iSSAs estimate movement parameters and selection coefficients in a single step, making the coefficients potentially more robust and informative (but please refer to Bastille‐Rousseau et al., 2018 on potential limits of such an analysis in informing movement behavior). In addition, the conditional nature of the iSSA means that the coefficients representing selection reflect how landcovers are being selected locally. However, the benefits of an integrated approach such as an iSSA might be diminished if other key ecological processes are modeled within the IBM framework, such as in our case with home range center attraction and avoidance of conspecifics, as these two aspects are not directly evaluated in an iSSA approach. Nevertheless, a robust assessment of alternative approaches to modeling movement and wildlife‐habitat associations that could enhance efficacy of oral vaccination campaigns and other wildlife baiting programs would be of merit and valuable in future work.

Spatially explicit models can be useful for testing alternative control and mitigation strategies within an adaptive management paradigm in which infectious disease management and research are iterative (Gilbert & Chipman, 2020; White & Forester, 2018). Our work supports the idea that a non‐uniform landscape‐level application of baits can be effective, as is reflected in current expert opinion‐based NRMP baiting strategies, and as suggested by others (Boyer et al., 2011; Eisinger et al., 2005; Haydon et al., 2006; Russell et al., 2005) We also show that the specific benefits of habitat baiting on seroprevalence may be context specific, with the degree and variability in habitat selection interacting with urban–suburban landscape composition and patch size to determine population seroprevalence. Our work therefore underscores the utility of accounting for both habitat selection and landscape composition and structure in planning baiting efforts, and supports the continued prioritization of movement data collection within ORV programs targeting wildlife to better understand habitat selection and movement patterns in urban–suburban landscapes, especially during baiting season(s). Our novel simulation approach could readily be applied to other baiting and target species systems to serve as a tool for bait optimization, in support of effective oral baiting for invasive species and wildlife disease management.

CONFLICT OF INTEREST

The authors declare no conflict of interest.

AUTHOR CONTRIBUTIONS

Katherine M. McClure, Kim M. Pepin, and Amy T. Gilbert designed the research with input from Guillaume Bastille‐Rousseau, Zaid Abdo, George Wittemyer; Katherine M. McClure and Guillaume Bastille‐Rousseau wrote the model code with contributions from Amy J. Davis and Kim M. Pepin; Guillaume Bastille‐Rousseau analyzed the movement data, conducted the simulations, and analyzed the model results with input from Kim M. Pepin; Carolyn A. Stengel collected raccoon telemetry data; Kathleen M. Nelson and Richard B. Chipman led ORV efforts and bait data collection; Katherine M. McClure, Kim M. Pepin, and Guillaume Bastille‐Rousseau wrote the first draft of the manuscript; all authors provided substantial critical feedback on the draft and gave final approval for publication. The findings and conclusions in this publication have not been formally disseminated by the USDA and do not represent Agency determination or policy.

Supporting information

Appendix S1

Data S1

ACKNOWLEDGMENTS

We thank the USDA National Rabies Management Program for supporting this work and for fruitful modeling discussions with the USDA National Wildlife Research Center's quantitative group.

McClure, Katherine M. , Bastille‐Rousseau Guillaume, Davis Amy J., Stengel Carolyn A., Nelson Kathleen M., Chipman Richard B., Wittemyer George, Abdo Zaid, Gilbert Amy T., and Pepin Kim M.. 2022. “Accounting for Animal Movement Improves Vaccination Strategies against Wildlife Disease in Heterogeneous Landscapes.” Ecological Applications 32(4): e2568. 10.1002/eap.2568

Handling Editor: Beth Gardner

Katherine M. McClure and Guillaume Bastille‐Rousseau contributed equally.

Funding information USDA

DATA AVAILABILITY STATEMENT

Data (McClure et al., 2021) are available in the USDA Research Data Archive at https://doi.org/10.2737/NWRC-RDS-2021-004.

REFERENCES

  1. Avgar, T. , Potts J. R., Lewis M. A., and Boyce M. S.. 2016. “Integrated Step Selection Analysis: Bridging the Gap between Resource Selection and Animal Movement.” Methods in Ecology and Evolution 7: 619–30. [Google Scholar]
  2. Bastille‐Rousseau, G. , Murray D. L., Schaefer J. A., Lewis M. A., Mahoney S. P., and Potts J. R.. 2018. “Spatial Scales of Habitat Selection Decisions: Implications for Telemetry‐Based Movement Modelling.” Ecography 41: 437–43. [Google Scholar]
  3. Bastille‐Rousseau, G. , and Wittemyer G.. 2019. “Leveraging Multidimensional Heterogeneity in Resource Selection to Define Movement Tactics of Animals.” Ecology Letters 22: 1417–27. [DOI] [PubMed] [Google Scholar]
  4. Bates, D. , Maechler M., Bolker B., and Walker S.. 2015. “Fitting Linear Mixed‐Effects Models Using lme4.” Journal of Statistical Software 67: 1–48. [Google Scholar]
  5. Beasley, J. C. , Atwood T. C., Byrne M. E., Vercauteren K. C., Johnson S. R., and Rhodes O. E.. 2015. “A Behaviorally‐Explicit Approach for Delivering Vaccine Baits to Mesopredators to Control Epizootics in Fragmented Landscapes.” PLoS One 10: 1–18. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Beasley, J. C. , Olson Z. H., Dharmarajan G., Eagan T. S., and Rhodes O. E.. 2011. “Spatio‐Temporal Variation in the Demographic Attributes of a Generalist Mesopredator.” Landscape Ecology 26: 937–50. [Google Scholar]
  7. Berentsen, A. R. , Dunbar M. R., Fitzpatrick C. E., and Walter W. D.. 2013. “Spatial Ecology of Urban Raccoons in Northeastern Ohio: Implications for Oral Rabies Vaccination.” The Prairie Naturalist 45: 39–45. [Google Scholar]
  8. Berentsen, A. R. , Patrick E. M., Blass C., Wehner K., Dunlap B., Hicks B., Hale R., Chipman R. B., and Vercauteren K. C.. 2018. “Seroconversion of Raccoons Following Two Oral Rabies Vaccination Baiting Strategies.” Journal of Wildlife Management 82: 226–31. [Google Scholar]
  9. Blanton, J. D. , Niezgoda M., Hanlon C. A., Swope C. B., Suckow J., Saidy B., Nelson K., Chipman R. B., and Slate D.. 2018. “Evaluation of Oral Rabies Vaccination: Protection against Rabies in Wild Caught Raccoons (Procyon lotor).” Journal of Wildlife Diseases 54: 520–7. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Boyce, M. , Vernier P., Nielsen S., and Schmiegelow F.. 2002. “Evaluating Resource Selection Functions.” Ecological Modelling 157: 281–300. [Google Scholar]
  11. Boyer, J.‐P. , Canac‐Marquis P., Guérin D., Mainguy J., and Pelletier F.. 2011. “Oral Vaccination against Raccoon Rabies: Landscape Heterogeneity and Timing of Distribution Influence Wildlife Contact Rates with the ONRAB Vaccine Bait.” Journal of Wildlife Diseases 47: 593–602. [DOI] [PubMed] [Google Scholar]
  12. Brown, L. J. , Rosatte R. C., Fehlner‐Gardiner C., Taylor J. S., Davies J. C., and Donovan D.. 2012. “Immune Response and Protection in Raccoons (Procyon lotor) Following Consumption of Baits Containing ONRAB®, a Human Adenovirus Rabies Glycoprotein Recombinant Vaccine.” Journal of Wildlife Diseases 48: 1010–20. [DOI] [PubMed] [Google Scholar]
  13. Chamberlain, M. J. , Austin J., Leopold B. D., and Burger L. W.. 2007. “Effects of Landscape Composition and Structure on Core Use Areas of Raccoons (Procyon lotor) in a Prairie Landscape.” American Midland Naturalist 158: 113–22. [Google Scholar]
  14. Coffin, A. W. 2007. “From Roadkill to Road Ecology: A Review of the Ecological Effects of Roads.” Journal of Transport Geography 15: 396–406. [Google Scholar]
  15. Cullingham, C. , Kyle C., Pond B., Rees E., and White B.. 2009. “Differential Permeability of Rivers to Raccoon Gene Flow Corresponds to Rabies Incidence in Ontario, Canada.” Molecular Ecology 18: 43–53. [DOI] [PubMed] [Google Scholar]
  16. Cullingham, C. , Pond B., Kyle C., Rees E., Rosatte R., and White B.. 2008. “Combining Direct and Indirect Genetic Methods to Estimate Dispersal for Informing Wildlife Disease Management Decisions.” Molecular Ecology 17: 4874–86. [DOI] [PubMed] [Google Scholar]
  17. Davis, A. J. , Nelson K. M., Kirby J. D., Wallace R., Ma X., Pepin K. M., Chipman R. B., and Gilbert A. T.. 2019. “Rabies Surveillance Identifies Potential Risk Corridors and Enables Management Evaluation.” Viruses 11: 1–13. [DOI] [PMC free article] [PubMed] [Google Scholar]
  18. Dharmarajan, G. , Beasley J. C., Fike J. A., and Rhodes O. E.. 2009. “Population Genetic Structure of Raccoons (Procyon lotor) Inhabiting a Highly Fragmented Landscape.” Canadian Journal of Zoology 87: 814–24. [Google Scholar]
  19. Eisinger, D. , Thulke H. H., Selhorst T., and Müller T.. 2005. “Emergency Vaccination of Rabies under Limited Resources ‐ Combating or Containing?” BMC Infectious Diseases 5: 1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  20. Elmore, S. A. , Chipman R. B., Slate D., Huyvaert K. P., VerCauteren K. C., and Gilbert A. T.. 2017. “Management and Modeling Approaches for Controlling Raccoon Rabies: The Road to Elimination.” PLoS Neglected Tropical Diseases 11: 1–24. [DOI] [PMC free article] [PubMed] [Google Scholar]
  21. Gehrt, S. , and Fritzell E.. 1998. “Resource Distribution, Female Home Range Dispersion and Male Spatial Interactions: Group Structure in a Solitary Carnivore.” Animal Behaviour 55: 1211–27. [DOI] [PubMed] [Google Scholar]
  22. Gilbert, A. 2018. “Rabies Virus Vectors and Reservoir Species.” Revue scientifique et technique (International Office of Epizootics) 37: 371–84. [DOI] [PubMed] [Google Scholar]
  23. Gilbert, A. , and Chipman R.. 2020. “Rabies Control in Wild Carnivores.” In Rabies: Basis of the Disease and its Management, 3rd ed., edited by Fooks A. and Jackson A., 617–70. London: Academic Press. [Google Scholar]
  24. Gilbert, A. , Johnson S., Walker N., Wickham C., Beath A., and VerCauteren K.. 2018. “Efficacy of Ontario Rabies Vaccine Baits (ONRAB) against Rabies Infection in Raccoons.” Vaccine 36: 4919–26. [DOI] [PubMed] [Google Scholar]
  25. Gilbert, A. T. , Johnson S. R., Nelson K. M., Chipman R. B., Vercauteren K. C., Algeo T. P., Rupprecht C. E., and Slate D.. 2018. “Field Trials of Ontario Rabies Vaccine Bait in the Northeastern USA, 2012–14.” Journal of Wildlife Diseases 54: 790–801. [DOI] [PubMed] [Google Scholar]
  26. Gillies, C. S. , Hebblewhite M., Nielsen S. E., Krawchuk M. A., Aldridge C. L., Frair J. L., Saher D. J., Stevens C. E., and Jerde C. L.. 2006. “Application of Random Effects to the Study of Resource Selection by Animals.” Journal of Animal Ecology 75: 887–98. [DOI] [PubMed] [Google Scholar]
  27. Hadidian, J. , Prange S., Rosatte R., Riley S., and Gehrt S.. 2010. “Raccoons (Procyon lotor).” In Urban Carnivores: Ecology, Conflict, and Conservation, edited by Gehrt S., Riley S., and Cypher B., 35–47. Baltimore, MD: The Johns Hopkins University Press. [Google Scholar]
  28. Haydon, D. T. , Randall D. A., Matthews L., Knobel D. L., Tallents L. A., Gravenor M. B., Williams S. D., et al. 2006. “Low‐Coverage Vaccination Strategies for the Conservation of Endangered Species.” Nature 443: 692–5. [DOI] [PubMed] [Google Scholar]
  29. Hijmans, R. 2021. “Raster: Geographic Data Analysis and Modeling.” R Package Version 3.4 ‐ 13. https://cran.r-project.org/package=raster.
  30. Hoffmann, C. , and Gottschang J.. 1977. “Numbers, Distribution, and Movements of a Raccoon Population in a Suburban Residential Community.” Journal of Mammalogy 58: 623–36. [Google Scholar]
  31. Homer, C. G. , Dewitz J. A., Yang L., Jin S., Danielson P., Xian G., Coulston J., Herold N. D., Wickham J. D., and Megown K.. 2015. “Completion of the 2011 National Land Cover Database for the Conterminous United States ‐ Representing a Decade of Land Cover Change Information.” Photogrammetric Engineering and Remote Sensing 81: 345–54. [Google Scholar]
  32. Howald, G. , Donlan C. J., Galván J. P., Russell J. C., Parkes J., Samaniego A., Wang Y., et al. 2007. “Invasive Rodent Eradication on Islands.” Conservation Biology 21: 1258–68. [DOI] [PubMed] [Google Scholar]
  33. Johnson, D. H. 1980. “The Comparison of Usage and Availability Measurements for Evaluating Resource Preference.” Ecology 61: 65–71. [Google Scholar]
  34. Kays, R. , Crofoot M. C., Jetz W., and Wikelski M.. 2015. “Terrestrial Animal Tracking as an Eye on Life and Planet.” Science 348: aaa2478. [DOI] [PubMed] [Google Scholar]
  35. Long, J. A. , and Nelson T. A.. 2013. “A Review of Quantitative Methods for Movement Data.” International Journal of Geographical Information Science 27: 292–318. [Google Scholar]
  36. McClure, K. M. , Bastille‐Rousseau G., Davis A. J., Stengel C. A., Nelson K. M., Chipman R. B., Wittemyer G., Abdo Z., Gilbert A. T., and Pepin K. M.. 2021. Raccoon Use‐Availability and Oral Rabies Vaccination (ORV) Bait Data from the Burlington, Vermont ORV Zone. Research Dataset Series. Ft. Collins, CO: USDA, APHIS, WS National Wildlife Research Center. 10.2737/NWRC-RDS-2021-004 [DOI] [Google Scholar]
  37. McClure, K. M. , Gilbert A. T., Chipman R. B., Rees E. E., and Pepin K. M.. 2020. “Variation in Host Home Range Size Decreases Rabies Vaccination Effectiveness by Increasing the Spatial Spread of Rabies Virus.” Journal of Animal Ecology 89: 1375–86. [DOI] [PMC free article] [PubMed] [Google Scholar]
  38. McDonald, T. L. 2013. “The Point Process Use‐Availability or Presence‐Only Likelihood and Comments on Analysis.” Journal of Animal Ecology 82: 1174–82. [DOI] [PubMed] [Google Scholar]
  39. Mencher, J. S. , Smith S. R., Powell T. D., Stinchcomb D. T., Osorio J. E., and Rocke T. E.. 2004. “Protection of Black‐Tailed Prairie Dogs (Cynomys ludovicianus) Against Plague After Voluntary Consumption of Baits Containing Recombinant Raccoon Poxvirus Vaccine.” Infection and Immunity 72: 5502–5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  40. Moore, D. , and Kennedy M.. 1985. “Factors Affecting Response of Raccoons to Traps and Population Size Estimation.” The American Midland Naturalist 114: 192–7. [Google Scholar]
  41. Moore, S. M. , Gilbert A., Vos A., Freuling C. M., Ellis C., Kliemt J., and Müller T.. 2017. “Rabies Virus Antibodies from Oral Vaccination as a Correlate of Protection against Lethal Infection in Wildlife.” Tropical Medicine and Infectious Disease 2: 31. [DOI] [PMC free article] [PubMed] [Google Scholar]
  42. Muller, T. , and Freuling C.. 2018. “Rabies Control in Europe: An Overview of Past, Current and Future Strategies.” Revue scientifique et technique (International Office of Epizootics) 37: 409–19. [DOI] [PubMed] [Google Scholar]
  43. Müller, T. F. , Schröder R., Wysocki P., Mettenleiter T. C., and Freuling C. M.. 2015. “Spatio‐Temporal Use of Oral Rabies Vaccines in Fox Rabies Elimination Programmes in Europe.” PLoS Neglected Tropical Diseases 9: 1–16. [DOI] [PMC free article] [PubMed] [Google Scholar]
  44. Nathan, R. , Getz W. M., Revilla E., Holyoak M., Kadmon R., Saltz D., and Smouse P. E.. 2008. “A Movement Ecology Paradigm for Unifying Organismal Movement Research.” Proceedings of the National Academy of Sciences of the United States of America 105: 19052–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  45. Noonan, M. J. , Tucker M. A., Fleming C. H., Akre T. S., Alberts S. C., Ali A. H., Altmann J., et al. 2019. “A Comprehensive Analysis of Autocorrelation and Bias in Home Range Estimation.” Ecological Monographs 89: 1–21. [Google Scholar]
  46. Nugent, G. , Yockney I. J., Whitford E. J., Cross M. L., Aldwell F. E., and Buddle B. M.. 2016. “Field Trial of an Aerially‐Distributed Tuberculosis Vaccine in a Low‐Density Wildlife Population of Brushtail Possums (Trichosurus vulpecula).” PLoS One 11: 1–19. [DOI] [PMC free article] [PubMed] [Google Scholar]
  47. Pieracci, E. G. , Pearson C. M., Wallace R. M., Blanton J. D., Whitehouse E. R., Ma X., Stauffer K., Chipman R. B., and Olson V.. 2019. “Trends in Human Rabies Deaths and Exposures ‐ United States, 1938‐2018.” Morbidity and Mortality Weekly Report 68: 524–8. [DOI] [PMC free article] [PubMed] [Google Scholar]
  48. Piersma, T. , and Drent J.. 2003. “Phenotypic Flexibility and the Evolution of Organismal Design.” Trends in Ecology and Evolution 18: 228–33. [Google Scholar]
  49. Prange, S. , Gehrt S., and Wiggers E.. 2003. “Demographic Factors Contributing to High Raccoon Densities in Urban Landscapes.” Journal of Wildlife Management 67: 324–33. [Google Scholar]
  50. R Core Team . 2019. R: A Language and Environment for Statistical Computing. Vienna: R Foundation for Statistical Computing. [Google Scholar]
  51. Rees, E. E. , Pond B. A., Tinline R. R., and Denise B.. 2013. “Modelling the Effect of Landscape Heterogeneity on the Efficacy of Vaccination for Wildlife Infectious Disease Control.” Journal of Applied Ecology 50: 881–91. [Google Scholar]
  52. Reynolds, J. J. H. , Hirsch B. T., Gehrt S. D., and Craft M. E.. 2015. “Raccoon Contact Networks Predict Seasonal Susceptibility to Rabies Outbreaks and Limitations of Vaccination.” Journal of Animal Ecology 84: 1720–31. [DOI] [PubMed] [Google Scholar]
  53. Riley, S. P. D. , Hadidian J., and Manski D. A.. 1998. “Population Density, Survival, and Rabies in Raccoons in an Urban National Park.” Canadian Journal of Zoology 76: 1153–64. [Google Scholar]
  54. Rioux‐Paquette, S. , Talbot B., Garant D., Mainguy J., and Pelletier F.. 2014. “Modelling the Dispersal of the Two Main Hosts of the Raccoon Rabies Variant in Heterogeneous Environments with Landscape Genetics.” Evolutionary Applications 7: 734–49. [DOI] [PMC free article] [PubMed] [Google Scholar]
  55. Rupprecht, C. E. , Hanlon C. A., and Hemachudha T.. 2002. “Rabies Re‐Examined.” Lancet 2: 327–43. [DOI] [PubMed] [Google Scholar]
  56. Russell, C. A. , Smith D. L., Childs J. E., and Real L. A.. 2005. “Predictive Spatial Dynamics and Strategic Planning for Raccoon Rabies Emergence in Ohio.” PLoS Biology 3: e88. [DOI] [PMC free article] [PubMed] [Google Scholar]
  57. Savarie, P. J. , Shivik J. A., White G. C., Hurley J. C., and Clark L.. 2001. “Use of Acetaminophen for Large‐Scale Control of Brown Treesnakes.” The Journal of Wildlife Management 65: 356–65. [Google Scholar]
  58. Schneider, A. L. , Gilbert A. T., Walter W. D., Vandeberg G. S., and Boulanger J. R.. 2019. “Spatial Ecology of Urban Striped Skunks (Mephitis mephitis) in the Northern Great Plains: A Framework for Future Oral Rabies Vaccination Programs.” Urban Ecosystem 22: 539–52. [Google Scholar]
  59. Schuttler, S. G. , Ruiz‐López M. J., Monello R., Wehtje M., Eggert L. S., and Gompper M. E.. 2015. “The Interplay between Clumped Resources, Social Aggregation, and Genetic Relatedness in the Raccoon.” Mammal Research 60: 365–73. [Google Scholar]
  60. Sciaini, M. , Fritsch M., Scherer C., and Simpkins C. E.. 2018. “NLMR and Landscapetools: An Integrated Environment for Simulating and Modifying Neutral Landscape Models in R.” Methods in Ecology and Evolution 9: 2240–8. [Google Scholar]
  61. Sidwa, T. J. , Wilson P. J., Moore G. M., Oertli E. H., Hicks B. N., Rohde R. E., and Johnston D. H.. 2005. “Evaluation of Oral Rabies Vaccination Programs for Control of Rabies Epizootics in Coyotes and Gray Foxes: 1995–2003.” Journal of the American Veterinary Medical Association 227: 785–92. [DOI] [PubMed] [Google Scholar]
  62. Sillero‐Zubiri, C. , Marino J., Gordon C. H., Bedin E., Hussein A., Regassa F., Banyard A., and Fooks A. R.. 2016. “Feasibility and Efficacy of Oral Rabies Vaccine SAG2 in Endangered Ethiopian Wolves.” Vaccine 34: 4792–8. [DOI] [PubMed] [Google Scholar]
  63. Slate, D. , Algeo T. P., Nelson K. M., Chipman R. B., Donovan D., Blanton J. D., Niezgoda M., and Rupprecht C. E.. 2009. “Oral Rabies Vaccination in North America: Opportunities, Complexities, and Challenges.” PLoS Neglected Tropical Diseases 3: 1–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  64. Slate, D. , Saidy B. D., Simmons A., Nelson K. M., Davis A., Algeo T. P., Elmore S. A., and Chipman R. B.. 2020. “Rabies Management Implications Based on Raccoon Population Density Indexes.” Journal of Wildlife Management 2014: 1–14. [Google Scholar]
  65. Smyser, T. J. , Page L. K., Johnson S. A., Hudson C. M., Kellner K. F., Swihart R. K., and Rhodes O. E.. 2013. “Management of Raccoon Roundworm in Free‐Ranging Raccoon Populations Via Anthelmintic Baiting.” Journal of Wildlife Management 77: 1372–9. [Google Scholar]
  66. Tardy, O. , Massé A., Pelletier F., Mainguy J., and Fortin D.. 2014. “Density‐Dependent Functional Responses in Habitat Selection by Two Hosts of the Raccoon Rabies Virus Variant.” Ecosphere 5: 1–16. [Google Scholar]
  67. Thulke, H. , and Eisinger D.. 2008. “The Strength of 70%: Revision of a Standard Threshold of Rabies Control.” Developments in Biologicals 131: 291–8. [PubMed] [Google Scholar]
  68. Tomkiewicz, S. M. , Fuller M. R., Kie J. G., and Bates K. K.. 2010. “Global Positioning System and Associated Technologies in Animal Behaviour and Ecological Research.” Philosophical Transactions of the Royal Society B: Biological Sciences 365: 2163–76. [DOI] [PMC free article] [PubMed] [Google Scholar]
  69. Tompkins, D. M. , and Ramsey D.. 2007. “Optimising Bait‐Station Delivery of Fertility Control Agents to Brushtail Possum Populations.” Wildlife Research 34: 67–76. [Google Scholar]
  70. Uhlenbeck, G. , and Ornstein L.. 1930. “On the Theory of the Brownian Motion.” Physical Review 36: 823–41. [Google Scholar]
  71. Urban, D. 1970. “Raccoon Populations, Movement Patterns, and Predation on a Managed Waterfowl Marsh.” Journal Wildlife management 34: 372–82. [Google Scholar]
  72. Wallace, R. M. , Gilbert A., Slate D., Chipman R., Singh A., Wedd C., and Blanton J. D.. 2014. “Right Place, Wrong Species: A 20‐Year Review of Rabies Virus Cross Species Transmission among Terrestrial Mammals in the United States.” PLoS One 9: 1–11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  73. White, L. A. , and Forester J. D.. 2018. “Dynamic, Spatial Models of Parasite Transmission in Wildlife: Their Structure, Applications and Remaining Challenges.” Journal of Animal Ecology 87: 559–80. [DOI] [PubMed] [Google Scholar]
  74. White, L. A. , Forester J. D., and Craft M. E.. 2018. “Disease Outbreak Thresholds Emerge from Interactions between Movement Behavior, Landscape Structure, and Epidemiology.” Proceedings of the National Academy of Sciences of the United States of America 115: 7374–9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  75. WHO . 2018. “WHO Expert Consultation on Rabies, Third Report.”
  76. Wunner, W. 2007. “Rabies Virus.” In Rabies, 2nd ed., edited by Jackson A. and Wunner W., 23–56. London: Academic Press. [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Supplementary Materials

Appendix S1

Data S1

Data Availability Statement

Data (McClure et al., 2021) are available in the USDA Research Data Archive at https://doi.org/10.2737/NWRC-RDS-2021-004.


Articles from Ecological Applications are provided here courtesy of Wiley

RESOURCES