Abstract
Wild bees are indispensable pollinators, supporting global agricultural yield and angiosperm biodiversity. They are experiencing widespread declines, resulting from multiple interacting factors. The effects of urbanization, a major driver of ecological change, on bee populations are not well understood. Studies examining the aggregate response of wild bee abundance and diversity to urbanization tend to document minor changes. However, the use of aggregate metrics may mask trends in particular functional groups. We surveyed bee communities along an urban-to-rural gradient in SE Michigan, USA, and document a large change in observed sex ratio (OSR) along this gradient. OSR became more male biased as urbanization increased, mainly driven by a decline in medium and large bodied ground-nesting female bees. Nest site preference and body size mediated the effects of urbanization on OSR. Our results suggest that previously documented negative effects of urbanization on ground-nesting bees may underestimate the full impact of urbanization, and highlight the need for improved understanding of sex-based differences in the provision of pollination services by wild bees.
Introduction
Wild bees (Apoidea: Hymenoptera) are critically important both to agricultural production and the maintenance of angiosperm biodiversity1,2. But populations of many species are in widespread decline3 due to multiple interacting factors, including parasites and disease4, climate change3,4, pesticide use5 and habitat loss5. Pesticide use and habitat loss in particular, are largely driven by agricultural conversion and intensification5–7. Urbanization has also contributed to habitat loss worldwide, evidenced by the increase in the amount of land occupied by urban development in the past 50 years8,9 and this trend is expected to accelerate in the coming decades9. Less well understood, however, is how urbanization affects bee communities.
Studies examining changes in bee communities along the rural-to-urban gradient have found relatively minor effects on overall abundance and diversity, particularly in comparison to the effects of agricultural intensification10–12. However, evaluating only aggregate abundance and diversity masks trends in particular guilds of bees; most notably, studies have consistently found reduced abundance and/or diversity of ground-nesting bees in urban areas10,12–15. This has been attributed to the lack of appropriate nesting substrate for ground-nesting bees in urban areas, though reduction in ground-nesting bee nest density or nest site availability has rarely been shown directly (but see ref.16). Thus, while the available evidence suggests that urban areas are capable of supporting bee communities17,18, it also indicates that these communities are likely to differ systematically from those found outside cities, with, for example, an underrepresentation of ground-nesting bees10.
While considering nesting or feeding ecology can reveal differential effects of urbanization on bee communities10, using ecological guild or even species as the unit of analysis may obscure other important effects of urbanization on bee communities. In particular, life history differences between female and male bees seem likely to result in distinct trends in observed sex ratio (OSR) with increasing urbanization19. There are non-exclusive mechanisms by which urbanization may drive changes in OSR, explored in greater detail below: (1) sex-specific patterns of movement and dispersal, (2) labile sex ratios and (3) temperature.
Sex-specific movement patterns
For most of their life cycle, non-parasitic female bees are central-place foragers, collecting nectar and pollen in order to provision their brood; as a result, most foraging occurs close to the nest site20. Male bees, on the other hand, do not engage in parental care, instead dispersing in search of mates. Moreover, while reproductive females also disperse from the natal nest prior to establishing their own nest, females tend to disperse shorter distances than males21–23. In urban landscapes, habitat patches (e.g. community gardens) are fragmented within a built matrix that is likely to be low in suitable nesting sites (at least for ground-nesting bees10,16) and floral resources24, but see ref.25. Sex-based differences in movement patterns, in combination with this high degree of fragmentation, could result in changes to OSRs relative to those seen in more intact landscapes.
Labile sex ratios
Sex allocation in bees is labile, and dependent in part on (1) food resource availability, with greater food abundance resulting in a higher proportion of female offspring26,27, and (2) brood cell parasitism rates, with increased parasitism pressure resulting in reduced provisioning and therefore fewer female offspring28,29. Systematic changes in the ability of foragers to provision their brood along the urban-to-rural gradient, resulting from changes in either the abundance or distribution of suitable floral resources or brood parasitism rates, could therefore result in OSR shifts along an urbanization gradient.
Temperature
Another possible explanation for differences in OSR across an urban-to-rural gradient may be phenological shifts associated with the urban heat island effect. Bee emergence is related to temperature30 suggesting that bee phenology will possibly be advanced in more urbanized areas, where temperatures are higher than the surrounding landscape31. Moreover, in many solitary bee species, male bees tend to emerge several days earlier than female bees. Since pan-trap sampling occurred on the same day at all sites for each sampling bout, this could lead to shifts in OSR as temperature increases along the urbanization gradient if the sampling date fell during the emergence period of one or more species.
Environmentally-generated spatial variation in OSR in bees has been scarcely investigated. Recent work has documented decreases in female relative abundance in bumble bees (Bombus spp.) along a rural-to-urban gradient19. Since most bumble bee species are eusocial (or social parasites), sex allocation - and resultant OSR - may be influenced by factors absent in solitary bee populations, including queen-worker genetic conflict32,33. Thus, findings from bumble bees cannot necessarily be extrapolated to the wild bee community as a whole, comprised as it is primarily of non-eusocial species. This study represents, to the best of our knowledge, the first investigation of OSR in a complete wild bee community along a land use gradient.
The potential for urbanization to drive changes in OSR is significant for several reasons. First, changes in adult sex ratios can affect population dynamics34,35; assuming a constant sex ratio when modeling demographic rates can lead to incorrect conclusions about population trends34,35. Second, there is evidence for sex-based differences in bee foraging behavior, including floral preferences36, floral constancy (i.e. the tendency to sequentially visit flowers of the same species)37, pollen transfer efficiency38, and flight distance between foraging bouts37,38. Thus, changes to OSR have the potential to impact both bee population dynamics and pollination services.
Here, we document a shift in OSR in bee communities found in community gardens along a rural-to-urban gradient, where the proportion of male bees increases with urbanization. We find that the observed increase in male relative abundance is primarily due to declining absolute abundance of medium- and large-bodied female ground-nesting bees as urbanization increases. We discuss potential mechanisms that may generate the OSR shifts, as well as implications for future research on urban bee communities.
Results
We caught a total of 3,336 bees (Table S1) consisting of 143 species across 28 genera (Table S2). Of these, 2,481 (74%; 95 species) belonged to species that nest underground (hereafter ‘ground-nesting bees’), while 855 (26%; 48 species) belonged to species that nest above ground in cavities or hollow stems (hereafter ‘cavity-nesting bees’). Ground-nesting bees in the sampled population were comprised of 60.9% eusocial bees, 18.8% solitary bees, and 18.1% bees that either nest communally or exhibit variability in sociality mode (classified as “other” in this paper; see Methods). The remaining 2.2% of ground-nesting bees were cleptoparasites or bees with unknown sociality mode. Cavity-nesting bees were overwhelmingly solitary (96.0%).
The effect of urbanization, as measured by impervious surface cover (hereafter ‘ISC’), on bee OSR was qualitatively similar regardless of the scale at which it was assessed (500 m, 1 km, 1.5 km, or 2 km), but the model assessing urbanization at the 2 km scale had the lowest AIC value (Table 1; ∆AIC = 1.48 for next-best model measuring urbanization at 1.5 km), so this scale was used for subsequent analyses.
Table 1.
Predictor(s) | Residual deviance | Significance - p | Effect Size - β | AIC |
---|---|---|---|---|
500 m | 20.2824 | (500 m)6.60e−5 | −0.32 ± 0.08 | 187.38 |
1 km | 17.6024 | (1 km)1.76e−5 | −0.40 ± 0.09 | 184.7 |
1.5 km | 14.9124 | (1.5 km)4.51e−6 | −0.51 ± 0.11 | 182.01 |
2 km | 13.4224 | (2 km)2.08e−6 | −0.57 ± 0.12 | 180.53 |
2 km + Floral abundance | 13.2023 | (2 km)8.83e−6 (Abund)0.84 | (2 km)−0.57 ± 0.13 (Abund)4.25e−7 ± 2.13−6 | 182.35 |
2 km + Floral area | 11.9723 | (2 km)6.71e−6 (Area)0.26 | (2 km)−0.54 ± 0.12 (Area)2.55e−7 ± 2.26e−6 | 181.13 |
2 km + Richness | 13.1923 | (2 km)1.17e−5 (Richness)0.82 | (2 km)−0.55 ± 0.13 (Richness)2.31e−4 ± 0.001 | 182.34 |
Models were GLMs with poisson distribution and log-link function. The first four rows present the effect of impervious surface cover measured at different scales (i.e. within 500 m of the garden, within 1 km, etc.). Floral metrics are season-long means (abundance and area; averaged over the number of floral surveys) or totals (richness) for an area within 20 m of the study location.
We found residual spatial autocorrelation (SA) in a small number of models; in all other cases calculation of Moran’s I indicated no SA. In cases where SA was detected, inclusion of Moran’s eigenvectors as predictors in the model had only minor effects on estimates and significance levels of other model terms and overall model fit, with no qualitative changes to results (Table S3). Below, where we report model output for a model that had SA, reported values are from the model modified to include Moran’s eigenvectors.
Neither total bee abundance nor the abundance of ground-nesting bees was affected by urbanization (total: t = −0.36, d.f. = 24, p = 0.73; ground-nesting: t = −1.09, d.f. = 24, p = 0.29), but abundance of cavity-nesting bees increased with urbanization (t = 2.62, d.f. = 24, p = 0.01) (Figure S1). Local floral resource availability, whether measured by total number of blooms, total floral area or floral richness within 20 m of the sampling point, had no effect on bees when season-long average floral resource availability was considered, but positively influenced total bee abundance and richness when survey periods were taken into account (Table 2). While the effects of all 3 floral metrics were qualitatively similar, floral abundance, as measured by the total number of blooms, was the best predictor of bee abundance, while floral richness was the best predictor of bee richness (Table 2). The effects of floral resource availability were similar whether bees were considered in aggregate or with nesting guilds and sexes considered separately, except that floral resource availability was not found to influence the abundance of male cavity-nesting bees (AIC value for model including floral richness was identical to AIC value for model that omitted it; Table 2).
Table 2.
Relationship between floral resource availability and bee community characteristics | |||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|
Floral abundance | Floral area | Floral richness | Other predictors | ||||||||||
Resid. dev. | z | ß | ∆AIC | Resid. dev. | z | ß | ∆AIC | Resid. dev. | z | ß | ∆AIC | ||
All bees | |||||||||||||
Total abundance | 830.296 | 5.54*** | 0.31 | 0.0 | 846.796 | 3.09*** | 0.21 | 16.5 | 837.696 | 4.54*** | 0.32 | 7.4 | Period |
Female abundance | 785.397 | 5.89*** | 0.34 | 0.0 | 802.697 | 3.46*** | 0.23 | 17.3 | 794.697 | 4.62*** | 0.32 | 9.3 | — |
Male abundance | 547.895 | 3.16*** | 0.31 | 0.0 | 555.195 | 1.51 | 0.17 | 7.3 | 553.595 | 1.96 | 0.22 | 5.6 | %ISC + Period |
Richness | 597.697 | 4.97*** | 0.18 | 5.2 | 610.297 | 3.08** | 0.13 | 17.8 | 592.497 | 5.57*** | 0.23 | 0.0 | — |
Ground-nesting bees | |||||||||||||
Total abundance | 793.096 | 5.10*** | 0.32 | 0.0 | 807.096 | 2.88** | 0.21 | 15.0 | 799.596 | 4.11*** | 0.34 | 6.5 | Period |
Female abundance | 745.896 | 5.15*** | 0.33 | 0.0 | 759.196 | 3.06** | 0.22 | 14.3 | 751.796 | 4.21*** | 0.32 | 5.9 | %ISC |
Male abundance | 474.095 | 2.91** | 0.35 | 0.0 | 479.595 | 1.64 | 0.21 | 5.5 | 477.495 | 2.21* | 0.30 | 3.4 | %ISC + Period |
Cavity-nesting bees | |||||||||||||
Total abundance | 504.083 | 2.91** | 0.23 | 0.0 | 510.083 | 1.32 | 0.11 | 6.0 | 504.683 | 2.72** | 0.23 | 0.6 | %ISC |
Female abundance | 461.783 | 2.73** | 0.24 | 0.0 | 467.283 | 1.17 | 0.11 | 5.5 | 463.083 | 2.40* | 0.22 | 1.3 | %ISC |
Male abundance | 312.583 | 1.32 | 0.17 | 0.3 | 314.183 | 0.34 | 0.05 | 1.9 | 312.283 | 1.44 | 0.19 | 0.0 | %ISC |
Comparison of model output for GLMMs with study site as a random effect and an observation-level random effect included to account for overdispersion. “Other predictors” refers to additional predictors beyond the floral resource metric included in the best model. Boldface indicates output from the best model. %ISC: percent of the landscape covered by impervious surfaces within 2 km of the study site. Significance levels: *p < 0.05, **p < 0.01, ***p < 0.001.
No metric of floral resource availability (considered either as season-long averages or separated by period) was a significant predictor of OSR (Tables 1 and 2). Mean minimum temperature was a significant predictor of OSR, though less so than ISC (Table S4) and the significant relationship was drive by mean minimum temperature’s correlation with ISC. When all observations across the survey were combined, the best model for predicting OSR included only urbanization, determined by AIC values, (Table 1). When sampling periods were considered separately, models including floral resource metrics were indistinguishable from the model including only urbanization and sampling period (∆AIC < 1; Table 2). These findings held whether the entire bee community was considered together or nesting guilds were considered independently (Tables S5 and S6). Moreover, there was no relationship between local floral resource metrics and urbanization (Table S7). The observed sex ratio (OSR) of the sample populations changed significantly along the rural-to-urban gradient, with relative abundance of females decreasing with urbanization (z = −4.73, d.f. = 23, p < 0.001; Fig. 1A). This overall change in OSR was driven entirely by changes in ground-nesting bees (z = −3.66, d.f. = 23, p < 0.001, corrected for SA); in cavity-nesting bees OSR was consistent across the rural-to-urban gradient (z = −1.42, d.f. = 23, p = 0.16). The change in OSR in ground-nesting bees is the result of declining female abundance with increasing urbanization (t = −2.18, d.f. = 24, p = 0.04); male abundance remained essentially unchanged across the urbanization gradient (t = 1.41, d.f. = 24, p = 0.17; Fig. 1B). These results are robust even with the removal of eusocial members of the genus Bombus - the most abundant genus of ground-nesting bees - from the dataset (Table S3). By contrast, in cavity-nesting bees, abundance of both sexes increased with urbanization, marginally so in females (t = 1.98, d.f. = 24, p = 0.06) and significantly in males (t = 3.36, d.f. = 24, p = 0.003; Fig. 1C). These results were robust even when we removed the 2 sites with >50% ISC from the dataset (Table S8), indicating that the relationship between OSR and urbanization occurs with even low-to-moderate degree of urbanization. The decline in female relative abundance in ground-nesting bees was significant and consistent across sociality classes (Table 3) suggesting that shifts in OSR were not related to degree of sociality. This was true despite the smaller number of solitary bees and bees in the ‘other’ category caught relative to eusocial bees. Therefore, the pattern of OSR shift in ground-nesting bees was not driven exclusively by eusocial species.
Table 3.
Effect of Prop. Impervious Surface Coverage on OSR of Ground Nesting Bees Across Sociality Categories | |||
---|---|---|---|
Sociality Categories | Residual Deviance | Significance - p | Effect Size - β |
Eusocial | 19.0724 | 0.019 | −0.385 ± 0.164 |
Other | 18.6622 | 0.048 | −1.001 ± 0.507 |
Solitary | 16.7724 | 0.003 | −0.994 ± 0.334 |
Model for Eusocial bees was corrected for SA (Table S3).
The relationship between urbanization and OSR in ground nesters is mediated by body size: there was no effect of urbanization on OSR in small ground-nesting bees (z = −0.686, d.f. = 24, p = 0.49); while both medium and large ground-nesting bees experienced decreases in female relative abundance with increasing urbanization. The effect of urbanization on OSR was stronger for large than medium bees [large: z = −3.79, d.f. = 23, p < 0.001 (corrected for SA); medium: z = −3.07, d.f. = 24, p = 0.002; Figure S2].
No change in OSR was seen across the season for cavity-nesting bees (z = −0.872, d.f. = 86, p = 0.383). In ground-nesting bees, OSR changed significantly across the season, with the proportion of female bees caught declining at each successive sampling period (z = –8.345, d.f. = 99, p < 0.001). Moreover, correlation between ground nesting OSR and urbanization was seen only in the second half of the survey season; periods one (19 May–5 Jun) and two (19 Jun–2 Jul) show no significant change in OSR across the rural-to-urban gradient (Fig. 2).
Discussion
Here we document a shift in observed sex ratio (OSR) of ground-nesting bees along an urbanization gradient, with the relative abundance of female bees declining as urbanization increases while the abundance of male ground-nesting bees remained unaffected by urbanization. Because provisioning female bees tend to focus foraging efforts in the vicinity of their nest20, female abundance is likely to be correlated with local nest density. Therefore, these data suggest that urbanization reduces nest density of ground-nesting bees, consistent with findings from other researchers10,12,13, and that this generates the observed OSR shift in ground-nesting bees. A key question, then, is why we do not see a parallel decline in male ground-nesting bees with increasing urbanization. One possible explanation is that, because male bees are not tied to a nest, they may be disproportionately abundant in floral resource-rich areas even if nest density in these areas is low. Male bees also tend to disperse longer distances than dispersing reproductive females21–23. Sampling sites for this study were located in community gardens, which tend to have higher density and diversity of floral resources than the surrounding landscape39 and the disparity between within-garden and outside-garden floral resource availability increases with urbanization in the study region39. This pattern could lead to a disproportionate concentration of male bees at more urban sampling sites. Our finding that urbanization-associated changes in ground-nesting bee OSR occur only among medium- and large-bodied bees further supports this explanation. Movement distance in bees is strongly correlated with body size40; thus, males of larger species are more likely to disperse sufficiently far from their natal nest to reach resource patches in urban landscapes. The sample of smaller-bodied bees, on the other hand, more closely reflects the makeup of the locally-originating population.
An alternative explanation for the observed OSR shift could be urbanization-induced changes in sex allocation by bees. Specifically, it is known that sex allocation in bees can be influenced by floral resource availability26,27 and abundance of brood parasites28,29, as both factors influence provisioning of brood cells27,28. In most bee species, the production of reproductive females requires greater resource investment than the production of males; consequently, reduced maternal provisioning may result in a shift towards production of males27,28. In eusocial species, production of workers (which are female but do not reproduce), is also correlated with resource availability41. Thus, the observed decrease in female relative abundance with urbanization could be the result of reduction in the production of females due to reduced floral resource availability in urban landscapes. Our finding that OSR is influenced by urbanization for only medium and large bees is potentially consistent with either sex allocation or dispersal-based explanations for OSR shifts: larger bees are likely to both have larger foraging ranges (and thus be more affected by floral resource availability in the wider landscape, potentially leading to increased production of males in resource-scarce landscapes) and disperse greater distances (allowing for disproportionate concentration of dispersing males in urban habitat patches). However, effects of floral resource scarcity should not depend on bee nesting strategy; the fact that the OSR shift was found only in ground-nesting bees argues against a resource-mediated shift in sex allocation. Moreover, floral surveys revealed no relationship between urbanization and local (20 m) floral resource availability. Study sites were located within community gardens, which in our study area tend to have higher floral abundance and richness than the surrounding landscape39, so the lack of correlation between local floral resource availability and urbanization does not preclude the possibility that landscape-scale floral resource availability was negatively correlated with urbanization; we did not assess landscape-scale floral resource availability in this study. However, the high diversity and abundance of floral resources found within garden study sites likely attenuates the effect of landscape-level floral resource availability42. In contrast, parasitism rates may depend on nesting strategy, with ground-nesting bees likely experiencing higher parasite pressure43,44. This is consistent with our finding that OSR shifts occurred only in ground-nesting bees, but does not offer any immediate explanations as to why OSR shifts were not apparent in small ground nesting bees. While it is possible that parasite pressure along the urbanization gradient contributes to OSR shifts, we did not directly assess parasite abundance in this study nor are we aware of any study that assesses brood cell parasitism rates along an urban gradient. Further research on the environmental drivers of brood parasitism in bees is needed before we can reach conclusions about the role of parasitism in the observed OSR shift.
We also considered temperature as one of the potential mechanisms driving shifts in OSR. Urbanization and average daily minimum temperature are significantly correlated but the data available does not support temperature as a mechanism for shifts in OSR. While temperature did significantly correlate with the changes seen in overall OSR, this is due to the aforementioned correlation between temperature and urbanization. Temperature also had a distinctly less favorable AIC score when compared to urbanization (Table S4). Additionally, if higher temperatures were causing earlier emergence of males in urban sites, then it would be reasonable to expect that OSR would be more male biased earlier in the season, which we did not find (Fig. 2). The lack of pattern in the OSR of cavity-nesting bees further weakens the case for temperature as one would expect similar changes as those seen in the OSR of ground nesting bees if ambient temperature was driving the OSR shift.
Our finding that bee abundance and richness are positively related to local floral resource availability is consistent with other studies of the determinants of bee community composition in urbanized landscapes14,45,46. This is true despite the fact that the scale at which floral resources were sampled is far smaller than the foraging range of most bees. These findings highlight the importance of floral resource-rich habitat patches for conserving wild bee populations, particularly in highly fragmented landscapes.
Finally, we found that the abundance of both male and female cavity nesting bees increased with urbanization. This is an anticipated result given that a number of studies have found similar results for cavity-nesting bees10,12,13,45–48. This may be due to the presence of anthropogenic cavities in urbanized habitats providing nesting resources for cavity-nesting bees12,49 in contrast to ground-nesting bees. Cavity-nesting bees may also benefit from a reduction in competition for floral resources due to the reduced abundance of female ground-nesting bees.
Our findings highlight the importance of considering sex-specific differences in bee behavior when analyzing the effects of environmental change on bee populations. Even though our results pertain to just one year of sampling and interannual variation may affect the degree of change in OSR, they suggest that research may be underestimating the negative impacts of urbanization on ground-nesting bees. While multiple studies have found reductions in ground-nesting bee populations in urban areas10,12,13, the magnitude of these reductions may be greater than what total abundance measures indicate if, as we suggest in this study, urban ground-nesting bee populations are subsidized by males dispersing from less urban areas. Further research in other urban areas is needed to determine the generality of the trend we document here, and to conclusively distinguish among the potential mechanisms driving urbanization-related OSR shifts in ground-nesting bees. Finally, these results stress the need for improved understanding of how sex-specific behavior in bees, including patterns of floral preference and pollen transfer efficiency, affect pollination services. At this point, while we know enough to suspect that these differences may be substantial36–38, further research is needed to predict the effects of a local shift in bee community sex ratio on plant communities.
Methods
Study location
Sampling occurred at 26 sites distributed along a rural-to-urban gradient in southeastern Michigan, USA (Figure S3). Sites spanned a distance of 110 km, with the surrounding land use ranging from dense urban core to suburban to rural-agricultural. 21 of 26 sites were community gardens, 3 sites were nature reserves, and the remaining 2 sites were rural farms. The gardens or farms sampled in each city were either part of an independent managing organization, single home owner properties or property of the University of Michigan (see Table S9). All gardens and farms included in the study observe organic growing practices prohibiting the use of synthetic pesticides and fertilizers.
Pollinator sampling
Bee fauna were sampled from 19 May to 25 September 2014, using pan traps and active netting. This combination of sampling techniques is widely used in studies of bees, and has been shown to thoroughly sample bee communities50.
For pan trapping, 2 oz (59 mL) plastic cups (Dart Container Corporation, Mason, MI USA) coated with UV-reflective paint in one of three colors (white, yellow, and blue), were filled with water and a small amount of soap as a surfactant. Pan traps were placed at all sites once every two weeks for a total of 9 trapping dates. Sampling occurred only on days that were sunny or partly sunny, with wind speeds below 4 m/s. On sampling days, pan traps were placed in all 26 sites before 1000 h and left for 24 h. Pan traps were then removed and all trapped arthropods were placed in 70% ethanol for later processing. Within each site, two pan traps of each color (6 total) were arranged in an 4 m × 2 m rectangle with a pan trap placed at each vertex and middle of the longer sides of the rectangle. This arrangement of pan traps is more compact than that used by some studies, and was devised to accommodate the small areas we were often granted access to sample in (e.g. one plot within a community garden) and to keep our sampling standardized across the study area. To maintain visibility to bees and accommodate changing vegetation heights over the course of the sampling period, pan traps were affixed to adjustable-height PVC pipes, and positioned to be 5–10 cm above surrounding herbaceous vegetation height.
Netting at each site occurred 4 times over the sampling season, once a month from May-September. To account for variation in diurnal activity patterns across species, each sampling event comprised two 30-minute sessions, one between 0900–1200 h and another between 1300–1600h, with the same requirements on meteorological conditions as for pan trapping (see above). Netted bees were transferred to vials containing 70% ethanol for later processing.
All bees were identified to species and assigned to sex. Identification was accomplished using the Discoverlife key51, with additional identifications made by Dr. Jason Gibbs (University of Manitoba, Winnipeg, Canada) and Jamie Pawelek (Wild Bee Garden Design, formerly University of California Berkeley, USA). Specimens are housed at the University of Michigan Museum of Zoology (accession numbers UMMZI-99924 through UMMZI-103259).
Pollinator natural history and body size data
Once all specimens were identified to species, natural history profiles were compiled for each species using four characteristics: preferred nesting substrate, sociality, native status, and body size (Table S2). Most natural history data were generously provided by Dr. Jason Gibbs, supplemented as necessary with literature searches. Bees with known modes of sociality were placed in one of four categories: eusocial, solitary, cleptoparasitic, and other. The ‘other’ category includes species that (1) exhibit both solitary and eusocial strategies either within or across populations or (2) nest communally (‘solitary social’ and ‘communal’ designations in Table S2). Analyses across sociality showed no pattern for cleptoparasites or bees with unknown sociality. However, our sample number of bees in these categories was very low, which affected statistical power. As a measure of body size, we used female intertegular (IT) distance, which is strongly correlated with flight ability and is therefore a proxy measurement of bee dispersal ability and foraging distance40. When IT distance could not be found in the literature52, we measured IT distance of 5 females of that species from our collection and took the mean as the species-specific IT distance. In cases where the species was represented by fewer than 5 individuals, we took measurements from all available samples; in general variance in IT distance across conspecific individuals was small (Table S2). We only measured IT distances of workers for eusocial species. Bees were then classified as small (≤1.5 mm), medium (>1.5–3.0 mm), or large (>3.0 mm) on the basis of IT span.
Landscape-level impervious surface measurements
We used National Land Cover Database (NLCD) data from 201153 to calculate the amount of urban development surrounding each study site as described in ref.19. Briefly, we used proportion of ISC as our measure of urbanization, and measured ISC at radii of 500 m, 1 km, 1.5 km, and 2 km around the study site. The NCLD classifies land cover in 30 m cells; summing cells within the relevant radius categorized as high- or medium-intensity developed gives the total area of impervious surfaces within each buffer (Table S10).
We used GLMs with Poisson distribution and log-link function to determine the radius at which ISC had the most explanatory power over bee observed sex ratio (OSR), and which, therefore, to include in subsequent analyses. For each radius, we fit a model with overall OSR as the response variable, and proportional ISC at the radius of interest as the sole predictor. We used AIC values to select the best radius.
Local floral resource and temperature measurements
Floral resource availability within 20 m of the center of pan trap placement was measured at each pan trap sampling date. We identified all plants in flower within this circle to species or morphospecies, and recorded the number of open blooms on each species using a modified logarithmic scale (1–10 blooms, 11–50, 51–100, 101–200, 201–500, 500–1000, >1000). Species-specific flower dimensions were recorded in the field, and per-flower area calculated, as in ref.4. Per-species floral area at a given survey was then calculated by multiplying floral abundance (mean value of the abundance bin) by flower size. Summing counts and area for all species gives the overall floral abundance and area, respectively, at each site per sampling date. Mean floral count and area, and total floral richness were calculated for each survey period (see Analysis) and for the entire season (Table S11), and we used these metrics to assess the effect of floral resources on the bee community.
Temperature at each site was measured by data loggers (HOBO, Onset Computing Corporation, Bourne, MA USA) placed in an unshaded area within the floral survey circle. Data loggers remained throughout the sampling season and recorded daily average, minimum and maximum temperatures every 24 hours. Because data loggers at several sites were compromised, temperature data were available for 22 of 26 sites (Table S9). While mean minimum temperature had a significant effect on OSR (z = −2.92, d.f. = 20, p = 0.003), it was also significantly correlated with ISC (e.g. p < 0.001 at 2 km radius). The direction and magnitude of the effects of temperature and ISC were similar, and the model including ISC had a lower AIC value (ΔAIC = 5.43). Thus, we omitted any measure of temperature from the analyses described below; including mean minimum temperature in our models had little impact on model outcomes (Table S4).
Analysis
All analyses were carried out in R v.3.4.154. Because we were interested in the response of wild bees to urbanization, we excluded records of the managed European honey bee (Apis mellifera) from our analysis; A. mellifera represented 4.9% of collected bees (164 individuals).
The OSR was found by adding together the number of female bees of all species collected at a site, then dividing this by the total number of bees collected at that site. For analysis of the relationship between floral resources and OSR only, OSR at each site was calculated for each sampling period, rather than for the entire season. To model the relationship between OSR and environmental variables, we used GLMs with Poisson distribution and log-link function. To avoid the difficulties of interpretation when modeling ratios, we used number of female bees as our response variable, with log(total bee abundance) included as an offset. Predictor variables in the maximal model included: ISC within 2 km, season-long average floral area within 20 m and season-long total floral richness within 20 m. To test the relationship between OSR and each predictor, we conducted stepwise reduction of the model, beginning with the predictor showing the least explanatory power. The best model was then selected using AIC comparison. Models were checked for overdispersion, and in all cases the dispersion parameter value was <1.4.
Because floral resource availability varied idiosyncratically across sites over the study duration, we evaluated the relationship between floral resource availability and bee community measures for each of 4 periods (in addition to the season-long averages outlined above). Each period consisted of a net-sampling event and the two bracketing pan-trapping events, and had a duration of 3–4 weeks. To model this relationship, we used GLMMs with site as a random effect, and an additional observation-level random effect to account for overdispersion. The maximal model for each bee community measure (i.e. abundance or OSR) in this case included a floral resource metric (abundance, area, or richness), survey period, and ISC. Because of strong collinearity among the 3 floral metrics, a separate model was fit for each metric. Model selection proceeded as outlined above. Since OSR was not affected by floral resource availability (see Results), further investigation of the association between OSR and environmental or bee community attributes was conducted using season-long averages and GLMs, as described in the previous paragraph, rather than data separated by period.
Particularly when we increased the radius at which impervious surface was considered, there was some overlap in study sites. To account for this, we assessed spatial autocorrelation (SA) in all models by calculating Moran’s I for the residuals of all models. In cases where residuals showed significant SA, we used the Moran eigenvector approach55, implemented with the ‘ME()’ function in R package ‘spdep’56 to adjust the model to account for SA. This approach accounts for SA through the addition of one or more orthogonal eigenvectors describing the spatial structure in the data as model predictor term(s).
Only 2 of 26 sites in the study had >50% ISC at the 2 km scale. To test whether these 2 sites had undue influence on our results, we conducted an identical analysis to that described above after removing observations from those sites from the dataset (Table S8).
To assess whether patterns in OSR differed across the season, we fit a model similar to those outlined for overall OSR, but with the addition of period and a period × ISC interaction as predictors. Because this model indicated both a significant effect of period and a significant period × ISC interaction (see Results), we then fit a separate model for each period, with ISC at the 2 km range the sole predictor.
To determine whether OSR response to urbanization was significantly affected by species attributes (i.e. preferred nest substrate, body size, and sociality), we constructed GLMs that included urbanization, species attribute of interest, and an urbanization × species attribute interaction term as predictors; a significant interaction term indicated significant differences among species in OSR response to urbanization, mediated by the attribute of interest. When a significant interaction was found, we divided the data by attribute of interest (e.g. ground-nesting vs. cavity-nesting; small, medium, or large bees), then ran a separate model for each guild to assess how the relationship between OSR and urbanization varied across guilds.
A parallel analysis was conducted for bee abundance, with model form, predictors, and model selection process as above, with two exceptions. First, because we were looking at abundance, rather than OSR, these models omitted the offset term. Second, abundance data were in all cases significantly overdispersed; to account for this overdispersion, a quasi-Poisson distribution was used in place of the Poisson distribution. Because AIC values cannot be calculated from quasi- distributions, we instead used the related quasi-AIC metric for model comparison.
Bumble bees (Bombus spp.) made up a large portion of our sample set; most bumble bee species are eusocial, and as such may experience controls on OSR that differ substantially from other bees (see Introduction). In order to verify that changes in the OSR were not driven solely by bumble bees, additional analyses of OSR changes in ground nesting bees and urbanization were done with bumble bees removed. Analyses show no qualitative differences with bumble bees removed: OSR still becomes less female-biased as urbanization increases (Table S3).
We assessed the relationship between metrics of floral resource availability and urbanization using GLMs with log-link function. As with bee abundance data, floral richness and area metrics were significantly overdispersed, so quasi-Poisson distributions were used to account for overdispersion.
Supplementary information
Acknowledgements
Thank you to all local gardening organizations for assistance with sampling efforts. Thank you to the University of Michigan Consulting for Statistics, Computing, & Analytics Research (CSCAR) Center for assistance in choosing and justifying model choices. Thank you to Professor Rufus Isaacs and extension agent Marissa Schuh at Michigan State University for assistance in assessing commercial B. impatiens use in the area. This work was partially supported by the University of Michigan Mcubed 1.0 Grant (Project ID: 181) to I.P., the Matthaei Botanical Garden & Nichols Arboretum Student Research Funds to P.G., and research block grants from the University of Michigan Department of Ecology and Evolutionary Biology to P.G. & G.F. & C.V. P.G. was partially supported through the Graham Institute-Dow Sustainability Fellows Program. J.M. and B.I. were partially supported through the University of Michigan-Undergrad Research Opportunities Program (UROP).
Author Contributions
G.F., P.G., M.C.S. and C.V. are all first authors and are listed alphabetically. G.F., P.G., M.C.S., C.V. and I.P. conceived of the study. G.F., P.G., M.C.S. and C.V. collected field data. M.C.S. and J.M. compiled G.I.S. landscape profiles for all the sites. All authors assisted with data processing and analysis. G.F., P.G., M.C.S., C.V. and I.P. contributed to the writing and revising of the manuscript, with G.F. serving as main editor.
Data Availability
All data from the analysis presented here is including as Supplementary Data files with this publication.
Competing Interests
The authors declare no competing interests.
Footnotes
Publisher’s note: Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Gordon Fitch, Paul Glaum, Maria-Carolina Simao and Chatura Vaidya contributed equally.
Electronic supplementary material
Supplementary information accompanies this paper at 10.1038/s41598-019-39601-8.
References
- 1.Biesmeijer J, Roberts S, Reemer M. Parallel declines in pollinators and insect-pollinated plants in Britain and the Netherlands. Science. 2006;313(5785):351–354. doi: 10.1126/science.1127863. [DOI] [PubMed] [Google Scholar]
- 2.Garibaldi LA, et al. Wild pollinators enhance fruit set of crops regardless of honey bee abundance. Science. 2013;339(6127):1608–1611. doi: 10.1126/science.1230200. [DOI] [PubMed] [Google Scholar]
- 3.Potts SG, et al. Global pollinator declines: trends, impacts and drivers. Trends Ecol. Evol. 2010;25(6):345–353. doi: 10.1016/j.tree.2010.01.007. [DOI] [PubMed] [Google Scholar]
- 4.González-Varo JP, et al. Combined effects of global change pressures on animal-mediated pollination. Trends in Ecology & Evolution. 2013;28(9):524–530. doi: 10.1016/j.tree.2013.05.008. [DOI] [PubMed] [Google Scholar]
- 5.Goulson D, Nicholls E, Botías C, Rotheray EL. Bee declines driven by combined stress from parasites, pesticides, and lack of flowers. Science. 2015;347(6229):1255957. doi: 10.1126/science.1255957. [DOI] [PubMed] [Google Scholar]
- 6.Schreinemachers P, Tipraqsa P. Agricultural pesticides and land use intensification in high, middle and low income countries. Food Policy. 2012;37(6):616–626. doi: 10.1016/j.foodpol.2012.06.003. [DOI] [Google Scholar]
- 7.Koh I, et al. Modeling the status, trends, and impacts of wild bee abundance in the United States. Proc. Natl. Acad. Sci. 2016;113(1):140–145. doi: 10.1073/pnas.1517685113. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Sleeter BM, et al. Land-cover change in the conterminous United States from 1973 to 2000. Glob. Environ. Chang. 2013;23(4):733–748. doi: 10.1016/j.gloenvcha.2013.03.006. [DOI] [Google Scholar]
- 9.Seto KC, Güneralp B, Hutyra LR. Global forecasts of urban expansion to 2030 and direct impacts on biodiversity and carbon pools. Proc. Natl. Acad. Sci. USA. 2012;109(40):16083–16088. doi: 10.1073/pnas.1211658109. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Cane JH, Minckley RL, Kervin LJ, Roulston TH, Neal M. Complex responses within a desert bee guild (Hymenoptera: Apiformes) to urban habitat fragmentation. Ecol. Appl. 2006;16(2):632–644. doi: 10.1890/1051-0761(2006)016[0632:CRWADB]2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 11.Banaszak-Cibicka W, Żmihorski M. Wild bees along an urban gradient: winners and losers. J. Insect Conserv. 2011;16(3):331–343. doi: 10.1007/s10841-011-9419-2. [DOI] [Google Scholar]
- 12.Fortel L, et al. Decreasing abundance, increasing diversity and changing structure of the wild bee community (Hymenoptera: Anthophila) along an urbanization gradient. PLoS One. 2014;9(8):e104679. doi: 10.1371/journal.pone.0104679. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Matteson KC, Ascher JS, Langellotto GA. Bee richness and abundance in New York City urban gardens. Ann. Entomol. Soc. Am. 2008;101(1):140–150. doi: 10.1603/0013-8746(2008)101[140:BRAAIN]2.0.CO;2. [DOI] [Google Scholar]
- 14.Ahrne K, Bengtsson J, Elmqvist T. Bumble bees (Bombus spp) along a gradient of increasing urbanization. PLoS One. 2009;4(5):e5574. doi: 10.1371/journal.pone.0005574. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Neame LA, Griswold T, Elle E. Pollinator nesting guilds respond differently to urban habitat fragmentation in an oak-savannah ecosystem. Insect Conserv. Divers. 2013;6(1):57–66. doi: 10.1111/j.1752-4598.2012.00187.x. [DOI] [Google Scholar]
- 16.Jha S, Kremen C. Resource diversity and landscape-level homogeneity drive native bee foraging. Proc. Natl. Acad. Sci. 2013;110(2):555–558. doi: 10.1073/pnas.1208682110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Baldock KCR, et al. Where is the UK’s pollinator biodiversity? The importance of urban areas for flower-visiting insects. Proc. R. Soc. B Biol. Sci. 2015;282(1803):20142849. doi: 10.1098/rspb.2014.2849. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Theodorou P, et al. The structure of flower visitor networks in relation to pollination across an agricultural to urban gradient. Funct. Ecol. 2017;31(4):838–847. doi: 10.1111/1365-2435.12803. [DOI] [Google Scholar]
- 19.Glaum P, Simao M-C, Vaidya C, Fitch G, Iulinao B. Big city Bombus: using natural history and land-use history to find significant environmental drivers in bumble-bee declines in urban development. R. Soc. Open Sci. 2017;4(5):170156. doi: 10.1098/rsos.170156. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Osborne JL, et al. Bumblebee flight distances in relation to the forage landscape. J. Anim. Ecol. 2008;77(2):406–415. doi: 10.1111/j.1365-2656.2007.01333.x. [DOI] [PubMed] [Google Scholar]
- 21.Wolf S, Toev T, Moritz RLV, Moritz RFA. Spatial and temporal dynamics of the male effective population size in bumblebees (Hymenoptera: Apidae) Popul. Ecol. 2012;54(1):115–124. doi: 10.1007/s10144-011-0285-2. [DOI] [Google Scholar]
- 22.López-Uribe MM, Morreale SJ, Santiago CK, Danforth BN. Nest suitability, fine-scale population structure and male-mediated dispersal of a solitary ground nesting bee in an urban landscape. PLoS One. 2015;10(5):1–21. doi: 10.1371/journal.pone.0125719. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ulrich Y, Perrin N, Chapuisat M. Flexible social organization and high incidence of drifting in the sweat bee, Halictus scabiosae. Mol. Ecol. 2009;18(8):1791–1800. doi: 10.1111/j.1365-294X.2009.04154.x. [DOI] [PubMed] [Google Scholar]
- 24.Matteson KC, Grace JB, Minor ES. Direct and indirect effects of land use on floral resources and flower-visiting insects across an urban landscape. Oikos. 2013;122(5):682–694. doi: 10.1111/j.1600-0706.2012.20229.x. [DOI] [Google Scholar]
- 25.Lowenstein DM, Matteson KC, Xiao I, Silva AM, Minor ES. Humans, bees, and pollination services in the city: the case of Chicago, IL (USA) Biodivers. Conserv. 2014;23(11):2857–2874. doi: 10.1007/s10531-014-0752-0. [DOI] [Google Scholar]
- 26.Tepedino VJ, Torchio PF. Temporal variability in the sex ratio of a non-social bee, Osmia lignaria propinqua: extrinsic determination or the tracking of an optimum? Oikos. 1982;38:177–182. doi: 10.2307/3544017. [DOI] [Google Scholar]
- 27.Kim J. Influence of resource level on maternal investment in a leaf-cutter bee (Hymenoptera: Megachilidae) Behav. Ecol. 1999;10(5):552–556. doi: 10.1093/beheco/10.5.552. [DOI] [Google Scholar]
- 28.Seidelmann K. Open-cell parasitism shapes maternal investment patterns in the Red Mason bee Osmia rufa. Behav. Ecol. 2006;17:839–848. doi: 10.1093/beheco/arl017. [DOI] [Google Scholar]
- 29.Seidelmann K, Ulbrich K, Mielenz N. Conditional sex allocation in the Red Mason bee. Osmia rufa. Behav. Ecol. Sociobiol. 2010;64:337–347. doi: 10.1007/s00265-009-0850-2. [DOI] [Google Scholar]
- 30.Bartomeus I, et al. Climate-associated phenological advances in bee pollinators and bee-pollinated plants. Proceedings of the National Academy of Sciences. 2011;108(51):20645–20649. doi: 10.1073/pnas.1115559108. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 31.Kim HH. Urban heat island. International Journal of Remote Sensing. 1992;13(12):2319–2336. doi: 10.1080/01431169208904271. [DOI] [Google Scholar]
- 32.Bourke AFG. Sex ratios in bumble bees. Philosophical Transactions: Biological Sciences. 1997;352(1364):1921–1933. doi: 10.1098/rstb.1997.0179. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Brown MJF, Schmid-Hempel R, Schmid-Hempel P. Queen-controlled sex ratios and worker reproduction in the bumble bee Bombus hypnorum, as revealed by microsatellites. Molecular Ecology. 2003;12(6):1599–1605. doi: 10.1046/j.1365-294X.2003.01840.x. [DOI] [PubMed] [Google Scholar]
- 34.Bessa-Gomes C, Legendre S, Clobert J. Allee effects, mating systems and the extinction risk in populations with two sexes. Ecol. Lett. 2004;7(9):802–812. doi: 10.1111/j.1461-0248.2004.00632.x. [DOI] [Google Scholar]
- 35.Eberhart-Phillips LJ, et al. Sex-specific early survival drives adult sex ratio bias in snowy plovers and impacts mating system and population growth. Proc. Natl. Acad. Sci. 2017;114(27):5474–5481. doi: 10.1073/pnas.1620043114. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 36.Ritchie AD, Ruppel R, Jha S. Generalist behavior describes pollen foraging for perceived oligolectic and polylectic bees. Environ. Entomol. 2016;45(4):909–919. doi: 10.1093/ee/nvw032. [DOI] [PubMed] [Google Scholar]
- 37.Ne’eman G, Shavit O, Shaltiel L, Shmida A. Foraging by male and female solitary bees with implications for pollination. J. Insect Behav. 2006;19(3):383–401. doi: 10.1007/s10905-006-9030-7. [DOI] [Google Scholar]
- 38.Ostevik K, Manson J, Thomson J. Pollination potential of male bumble bees (Bombus impatiens): movement patterns and pollen-transfer efficiency. J. Pollinat. Ecol. 2010;2(4):21–26. doi: 10.26786/1920-7603(2010)3. [DOI] [Google Scholar]
- 39.Fitch, G. M. Urbanization-mediated context dependence in the effect of floral neighborhood on pollinator visitation. Oecologia185(4), 713–723 (2017). [DOI] [PubMed]
- 40.Greenleaf SS, et al. Bee foraging ranges and their relationship to body size. Oecologia. 2007;153(3):589–596. doi: 10.1007/s00442-007-0752-9. [DOI] [PubMed] [Google Scholar]
- 41.Pelletier, L. & McNeil, J. N. The effect of food supplementation on reproductive success in bumblebee field colonies. Oikos103(3), 688–694 (2003).
- 42.Vaidya, C., Fisher, K., & Vandermeer, J. Colony development and reproductive success of bumblebees in an urban gradient. Sustainability10(6), 1–14 (2018).
- 43.Michener, C. D. From solitary to eusocial: need there be a series of intervening species? In Hölldobler, B., and Lindauer, M. (eds), Experimental Behavioral Ecology and Sociobiology, G. Fischer, Stuttgart, 293–305 (1985).
- 44.Wcislo WT. Parasitism rates in relation to nest site in bees and wasps (Hymenoptera: Apoidea) J. Insect Behav. 1996;9:643–656. doi: 10.1007/BF02213885. [DOI] [Google Scholar]
- 45.Pardee GL, Stacy MP. Native plants are the bee’s knees: local and landscape predictors of bee richness and abundance in backyard gardens. Urban Ecosystems. 2014;17(3):641–659. doi: 10.1007/s11252-014-0349-0. [DOI] [Google Scholar]
- 46.Tonietto R, et al. A comparison of bee communities of Chicago green roofs, parks and prairies. Landscape and Urban Planning. 2011;103(1):102–108. doi: 10.1016/j.landurbplan.2011.07.004. [DOI] [Google Scholar]
- 47.Zanette LRS, Martins RP, Ribeiro SP. Effects of urbanization on Neotropical wasp and bee assemblages in a Brazilian metropolis. Landsc Urban Plan. 2005;71(2–4):105–121. doi: 10.1016/j.landurbplan.2004.02.003. [DOI] [Google Scholar]
- 48.Aizen MA, Feinsinger P. Forest fragmentation, pollination, and plant reproduction in a Chaco dry forest. Ecology. 1994;75(2):330–351. doi: 10.2307/1939538. [DOI] [Google Scholar]
- 49.Hernandez JL, Frankie GW, Thorp RW. Ecology of urban bees: A review of current knowledge and directions for future study. Cities and the Environment. 2009;2(1):1–15. doi: 10.15365/cate.2132009. [DOI] [Google Scholar]
- 50.Roulston TH, Smith SA, Brewster AL. A Comparison of Pan Trap and Intensive Net Sampling Techniques for Documenting a Bee (Hymenoptera: Apiformes) Fauna. J. Kansas Entomol. Soc. 2011;80(2):179–181. doi: 10.2317/0022-8567(2007)80[179:ACOPTA]2.0.CO;2. [DOI] [Google Scholar]
- 51.Ascher, J. S. & Pickering, J. Discover Life bee species guide and world checklist (Hymenoptera: Apoidea: Anthophila) (2016).
- 52.Bartomeus I, et al. Historical changes in northeastern US bee pollinators related to shared ecological traits. Proceedings of the National Academy of Sciences. 2013;110(12):4656–4660. doi: 10.1073/pnas.1218503110. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 53.Homer CG, et al. Completion of the 2011 National Land Cover Database for the conterminous United States - representing a decade of land cover change information. Photogramm. Eng. Remote Sensing. 2015;81(5):345–354. [Google Scholar]
- 54.R Core Team. A Language and Environment for Statistical Computing (2017).
- 55.Griffith DA, Peres-Neto PR. Spatial modeling in ecology: The flexibility of eigenfunction spatial analyses. Ecology. 2006;87(10):2603–2613. doi: 10.1890/0012-9658(2006)87[2603:SMIETF]2.0.CO;2. [DOI] [PubMed] [Google Scholar]
- 56.Bivand R, Piras G. Comparing Implementations of Estimation Methods for Spatial Econometrics. Journal of Statistical Software. 2015;63(18):1–36. doi: 10.18637/jss.v063.i18. [DOI] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Supplementary Materials
Data Availability Statement
All data from the analysis presented here is including as Supplementary Data files with this publication.