Skip to main content
PLOS One logoLink to PLOS One
. 2022 Feb 8;17(2):e0263056. doi: 10.1371/journal.pone.0263056

INHABIT: A web-based decision support tool for invasive plant species habitat visualization and assessment across the contiguous United States

Peder Engelstad 1,*, Catherine S Jarnevich 2, Terri Hogan 3, Helen R Sofaer 2,¤a, Ian S Pearse 2, Jennifer L Sieracki 3, Neil Frakes 4,¤b, Julia Sullivan 5, Nicholas E Young 1, Janet S Prevéy 2, Pairsa Belamaric 5,¤c, Jillian LaRoe 5
Editor: Daniel de Paiva Silva6
PMCID: PMC8824347  PMID: 35134065

Abstract

Narrowing the communication and knowledge gap between producers and users of scientific data is a longstanding problem in ecological conservation and land management. Decision support tools (DSTs), including websites or interactive web applications, provide platforms that can help bridge this gap. DSTs can most effectively disseminate and translate research results when producers and users collaboratively and iteratively design content and features. One data resource seldom incorporated into DSTs are species distribution models (SDMs), which can produce spatial predictions of habitat suitability. Outputs from SDMs can inform management decisions, but their complexity and inaccessibility can limit their use by resource managers or policy makers. To overcome these limitations, we present the Invasive Species Habitat Tool (INHABIT), a novel, web-based DST built with R Shiny to display spatial predictions and tabular summaries of habitat suitability from SDMs for invasive plants across the contiguous United States. INHABIT provides actionable science to support the prevention and management of invasive species. Two case studies demonstrate the important role of end user feedback in confirming INHABIT’s credibility, utility, and relevance.

Introduction

A lingering problem in the complex interplay of conservation science and decision-making is how to resolve the disconnect between producers and users of scientific data. Digital communication platforms, (e.g., websites and web applications), are common solutions to bridge this gap and often fall under the umbrella of decision support tools (DSTs), software designed to fill knowledge gaps and support decision-making by analyzing and communicating information. Despite the ever-improving technological capabilities and functionality of DSTs, there continues to be a lack of uptake from practitioners, stakeholders, managers, and policy makers due to usability issues [1], misaligned policy priorities [2], lack of training or trust [3], and lack of relevance [4].

Surveys of end users highlight ways to improve DST adoption, like building long-term partnerships [4] and facilitating multidirectional dialogues between researchers, collaborators, and end users [5]. These efforts can help generate high-quality end user feedback and help frame decisions, especially in the early phases of the DST development cycle. These recommendations indicate that useful DSTs can arise within existing conservation science frameworks, such as translational ecology [6], which emphasize collaboration, co-ownership, and engagement. This method of co-producing data, via the synthesis of knowledge and experience from subject matter experts and the technical expertise of scientists, can lead to more actionable information and avoid landing off target from practical management-based needs.

Species distribution models (SDMs) can inform conservation and management decisions but a lack of communication between modelers and potential users continues to limit the integration of model outputs into decision-making [7]. Using statistical algorithms, SDMs can generate estimates of habitat suitability across space, can reveal drivers of species’ distributions, and are an important tool for guiding management of both rare and invasive species. These models can inform sampling and surveillance design, and spatial prioritization decisions for management actions and regulatory decisions [8].

Although SDMs have important technical caveats and limitations, they are the primary tool for generating spatial predictions of habitat suitability for species presence. For invasive species, model outputs can quantify risk of establishment. Familiarity with SDMs can increase their uptake by managers and other decision-makers, but many people in these roles may lack the data, time, or expertise to develop their own models, even via relatively accessible platforms [e.g. 9, 10]. At the same time, model outputs associated with scientific publications are relatively difficult for decision-makers to independently discover and use [11]. Web-based DSTs have the potential to make SDM outputs more accessible, enhance efficiency by providing information on problematic invaders of interest to multiple user groups, and may be co-produced with users to deliver model results in an interpretable manner relevant to established decision-making processes.

Despite these benefits, we are aware of only a single attempt at this kind of DST, a regional effort by National Park Service (NPS) Inventory and Monitoring from 2008 that was only accessible offline. No known web-based DSTs with outputs from nationally scoped SDMs are readily available to invasive species managers in the United States. As a consequence, agencies that manage and plan for invasive species currently rely almost exclusively on occurrence location data from free, web-based aggregators such as the Early Detection and Distribution Mapping System (EDDMapS) [12], CalFlora [13], or the Global Biodiversity Information Facility (GBIF) [14]. These datasets describe historical and current known locations based on biased sampling efforts, lacking the full geographic coverage that suitability maps can provide. And while outputs from SDMs have been integrated with web-based DSTs in other areas of conservation science [1519], many facets of data delivery leave room for improvement, including low spatial resolution maps, limited numbers of species, difficult to navigate interfaces, and irregular or inconsistent updates and maintenance.

There is a clear need to fill this information gap with a resource that provides high-resolution spatial predictions of invasive plant species habitat suitability, has ongoing maintenance to meet shifting management use cases, and caters to a broad suite of potential end users. Therefore, we present a novel DST: the Invasive Species Habitat Tool (INHABIT; http://gis.usgs.gov/inhabit), a freely available resource designed to bridge the producer-user divide, drive knowledge sharing, and deliver credible SDM outputs to inform invasive plant species management at multiple spatial scales. This tool is a collaboratively and iteratively built R Shiny web application displaying spatial and aspatial summaries of ensembled SDMs covering the contiguous United States for numerous invasive plant species. All model outputs in INHABIT result from an established SDM methodology [20]. As a result, we focus on an introduction to the tool’s design features, the collaborative nature of its development, and highlight case studies that demonstrate the impact and integration of user feedback to INHABIT’s iterative evolution.

Methods

Initial design & development

The conceptual foundations leading to the creation of INHABIT emerged from conversations between NPS invasive species coordinators and U.S. Geological Survey (USGS) researchers around the need for, and communication of, SDMs for invasive species of concern. Management activities can be informed by SDMs at both local and regional scales, but model outputs need to be effectively distributed to land managers. Presentations of early web-platform mockups of INHABIT at workshops and conferences elicited feedback on desired content and design from early adopters including the NPS Invasive Plant Management Teams (IPMTs). These regional teams contribute to surveillance and control of invasive plant species, and restoration efforts at multiple parks within their regions. They also aid local managers through consultation and by providing training in invasive plant management techniques.

With input from IPMTs, NPS coordinators selected an initial set of species that had occurrence data, were regionally or nationally important, and were of high priority to potential early adopters. To aid in model development, IPMT representatives also provided feedback on the suite of potential predictors anticipated to be useful for modeling the distributions of these species. Coordinators from NPS and researchers from USGS expanded initial species lists with additional species of interest from other potential users, including the Bureau of Land Management and U.S. Fish and Wildlife Service. With multiple agency stakeholders, the platform needed to support management at multiple spatial scales within management units of differing sizes or across regions. The consensus between management stakeholders and researchers called for a platform that included: a relatively simple and intuitive user-interface for spatial and non-spatial data, compatibility with devices taken into the field, and the ability to rapidly provide user feedback.

A final consideration in the development of INHABIT was to deliver it via a platform that could regularly accommodate new iterations of SDM models and rapidly integrate improved interface features based on user community experiences (Fig 1). As early versions of INHABIT evolved, users actively engaged with the developers through presentations at scientific meetings attended by resource managers. Developers also presented to specific user groups to elicit feedback (e.g., Department of the Interior [DOI] invasive species community, Western Governors Association, internal agency invasive species groups). For example, USGS hosted a one-day workshop in 2019 with representatives from DOI agencies to further review INHABIT design and content. This workshop resulted in several changes to the tool including modifications to the map display, edits to the explanatory text to aid interpretation for non-modelers, and changes in statistical summary content. Workshop participants developed specific questions designed to improve user engagement with the inclusion of a feedback page.

Fig 1. A conceptual diagram illustrating the development of the Invasive Species Habitat Tool (INHABIT).

Fig 1

Co-production starts on the left and follows through to eventual adoption and land management or policy actions. The grey middle circle denotes the iterative cycle where updates are made to species distribution models and user interface elements.

Architecture

For several reasons, we chose to deliver INHABIT’s SDM map outputs and statistical summaries through the R Shiny web-application platform [21]. First, it is free, open-source software and is interoperable with all R libraries tested for this project. Second, Shiny apps are accessible simultaneously by multiple users, ensuring all users are working with the same version of the data. Third, Shiny’s default stylesheet has a preconfigured responsive design, allowing the app to recognize different device types, an advantage when operating from differing physical locations (e.g., moving between office computers and field mobile devices). Finally, integrating changes to a Shiny app’s codebase is simple and straightforward, which allows INHABIT to rapidly adapt to feedback from stakeholders through updates to the content and format of the displays. These features make it easy to address common challenges in DST development related to misinterpretation, load speeds, and the creation of meaningful functionality [22].

The data feeding INHABIT come from an established modeling workflow [20], wherein presence-background SDMs are fit using five statistical algorithms and two background point generation methods, yielding up to 10 total models per species. To build these models and generate spatial predictions of relative habitat suitability, the algorithms combine systematically vetted presence data (drawn from multiple online repositories) and species-specific spatial predictors (selected using natural history knowledge and drawn from a broader suite of predictors covering the contiguous United States). Each of the 10 models’ mapped continuous predictions were subject to a set of four discrete thresholds to produce binary predictions. These binary predictions were summed to create ensembled maps (one per threshold) along a gradient of inclusivity, from a precautionary threshold predicting the greatest amount of suitable habitat to a targeted threshold focusing on areas with higher suitability values.

Graphical user interface

Two main features comprise the graphical user interface of INHABIT: a left-hand sidebar consisting of user-defined inputs and a larger panel on the right with five navigational tabs (Fig 2). The sidebar is a static panel containing species and map-based selection toggles. The tabs atop the main panel allow users to navigate to different sections of the application: “Map”, “Management Area Table”, “Model Details”, “About/F.A.Q.”, and “Feedback”. The “Map” tab shows spatial outputs: habitat suitability maps, management unit boundaries, and species occurrence locations. The “Management Area Table” displays information on the estimated relative risk of establishment posed by the focal species to each management area (e.g., national parks, wildlife refuges), including predicted amount of suitable habitat and the nearest known occurrence. The “Model Details” tab includes an array of technical information related to predictor variables, statistical model performance, and estimated species’ responses to environmental drivers within the underlying SDMs. The “About” tab summarizes funding and data sources and answers frequently asked questions. The “Feedback” tab contains a form to provide comments and suggestions on website functionality and content or to suggest new species to add to the tool.

Fig 2. The layout and features of the Invasive Species Habitat Tool (INHABIT; http://gis.usgs.gov/inhabit) landing page in August 2021.

Fig 2

The sidebar panel is visible on the left and the main panel on the top right with the “Map” tab selected.

Sidebar

In the sidebar, users can select a species of interest by clicking into a drop-down menu to search by species’ common name or scientific name. For each species, there are eight possible habitat suitability map visualizations, controlled by a slider bar. The maps are ensembles of up to 10 SDM outputs created using a continuum of four different threshold selection methods commonly used in SDMs to develop more or less targeted binary predictions across the landscape. They include: Minimum Predicted Presence (MPP), first percentile (0.01), tenth percentile (0.1), and Maximum Sensitivity Plus Specificity (MaxSS). The MPP threshold is the minimum predicted value for any of the occurrence points used in model generation while the first and tenth percentile threshold correspond to the value that would classify either 1% or 10% of the occurrence point locations used to fit the models as unsuitable. The MaxSS threshold optimizes the balance between model sensitivity and specificity, minimizing the mean of the error rate for both presence and background observations. Users can alternate between these four model thresholds using the slider bar based on their intended use and desire for a more precautionary (inclusive suitability) or targeted (more selective suitability) map. This qualitative range can help users select the map output most applicable to their specific management need (e.g., locating potential satellite populations). Based on stakeholder suggestions to reduce or clarify technical language, the slider bar range labels are qualitative (“Precautionary” to “Targeted”) to better translate the meanings of these thresholds.

For all maps, users can also choose to mask areas where environmental conditions are outside the environmental range of occurrence points used to build the model by using the “Restrict Environmental Conditions” radio buttons. With the selection set to “Yes”, environmentally dissimilar areas are displayed as light blue (Fig 2) rather than reflecting calculated ensembled suitability value for the selected threshold. Because model predictions are more credible within the environmental range of the training data, this feature addresses potential concerns about statistical extrapolation within the unrestricted map [23].

Management unit boundaries for multiple federal agencies and four counties are also searchable in the sidebar. Upon selection of a management unit, the map will zoom to that unit’s extent or to the full extent of multiple selected unit boundaries. This feature enhances the utility of the tool for management and planning at the scale of individual management units (e.g., a focal park or refuge). Finally, users can also display the data used in model building, including the species occurrence locations and background sampling boundaries [20].

Map tab

By default, the main panel loads the “Map” tab (Fig 2), displaying the spatial predictions of ensembled SDMs. The map’s color scheme represents the level of ensemble model agreement, with the darker colors indicating areas where more models predict suitable habitat and lighter colors where more models predict unsuitable habitat. This visualization choice provides a straightforward and quickly digestible way to distinguish spatial patterns on the landscape, giving users an initial ‘gut check’ on data credibility. As users modify the input parameters in the sidebar, the map will update accordingly based on species selection, model threshold, and occurrence location display options. Metadata about the extent considered in model development (contiguous United States or global for species with few U.S. records) and species model version are visible in the lower left-hand corner.

The habitat suitability data used to build the maps are an ensemble of up to 10 model outputs and cover the contiguous United States at a 90 m spatial resolution. Normally, maps this large can be notoriously slow to load with most R data visualization libraries. To address this, we used gdal2tiles (GDAL 2.4.1), a program that slices maps into thousands of smaller image files, which we subsequently upload to cloud-storage to ensure reasonable load times. This method also allows INHABIT to retain high spatial detail across zoom levels, providing the flexibility to accommodate users from local, regional, or national management contexts.

Management area table tab

The “Management Area Table” tab summarizes attributes of invasion risk within each management unit for the focal invasive plant species. The calculated values in the table are: “Estimated Suitable Area”, “Percent of Unit Area”, “Known Presence? (Count)”, and “Minimum Distance to Known Occurrence”. These data are quantitative, tabular complements to the map visualizations. Values in the table derive from the first percentile threshold of the habitat suitability map (with novel environments excluded) and are restricted to locations where a majority of the models in the ensemble indicate a location as ‘suitable’. The first two quantitative columns in the table show the total number of acres of potential habitat within the boundaries of the management unit (defined as any location with an ensemble value greater than or equal to half the total number of models used), followed by the percent of the total unit area.

Especially for instances where the map may be more difficult to interpret, these numbers provide land managers with a quick assessment of overall risk posed by an invader. Tallies of the occurrence points used to develop the SDMs summarize the known state of infestation within a management unit (“Known Presence?”) and the unit’s proximity to known species locations (“Minimum Distance to Occurrence”). These columns can help determine the threat status of an invasive plant species. Metaphorically, is it in the house, on the doorstep, or further down the road? Although the common language of scientific data is metric units, end user feedback indicated that managers would prefer imperial units. Summaries of habitat suitability and distance to the nearest known occurrence provide information on the potential extent of an invasion and its near-term likelihood. Taken together, these data can guide surveillance strategies at regional and local scales.

Model details tab

The “Model Details” tab is a resource for users wanting more technical information about the underlying models feeding INHABIT. Whereas the map conveys an aggregated version of the SDM output, the “Model Details” tab provides a more disassembled view of the individual models used within the SDMs to highlight the variation between model algorithms and background data selection methods. The “Model Details” tab contains

the nested sub-tabs of “Evaluation Metrics”, “Variable Response Curves”, “Variable Importance”, “Variable Sources”, and “Credibility Assessment” (Fig 3).

Fig 3. Example content clipped from the “Model Details” tab.

Fig 3

Each chart’s symbology also indicates model type: boosted regression trees (BRT), generalized linear model (GLM), multiadaptive regression splines (MARS), maximum entropy (MAXENT), random forest (RF), and background point generation method (target or kernel density estimate [KDE]). A) Evaluation metrics; in each column, the first number is the value with full model training data and the second, in parentheses, is the mean value from 10-fold cross-validation splits. B) Response curve images representing relative habitat suitability across environmental predictor values. Numbers in the upper left corner within each plot indicate mean, low, and high variable importance values reading from left to right. C) A tabular view of variable importance. Each row displays predictor names. D) Predictor descriptions and hyperlinks to variable sources, and E) the model credibility table based on the model assessment rubric from Tables 1a-c in [8]. Though it is a static template currently based on the overall modeling framework, the future version of this table will update its evaluative criteria relative to models for the selected species.

“Evaluation Metrics” displays a table of performance measures and accuracy statistics organized by model algorithm and background method. These include area under the receiver operating characteristic curve (AUC), area under the precision recall curve (AUC-PR), Correlation Coefficient, Percent Correctly Classified, Sensitivity,

Kappa, and True Skill Statistic. For detailed definitions of these metrics and the software used to compute them, see [10] for all except AUC-PR [24, 25]. These metrics provide multiple assessments of the performance of individual models, establishing transparency of the underlying model development process [8].

“Response Curves” presents a grid of graphs depicting the relationship between individual predictor values and relative habitat suitability, with a line for each model algorithm and background method retaining that predictor. The grid display orders by mean predictor relative importance across models, also represented with a numerical value in the upper left corner of each graph. (Fig 3B). Species experts can review environmental responses as they relate to the relative probability of occurrence and provide feedback indicating whether the response aligns with their knowledge of the species’ biology and life history. Where the form of curves align with practitioners’ expectations, these graphics can enhance the perceived credibility of model outputs and increase integration into decision-making frameworks. Where they do not, species experts can provide feedback for future iterations of models related to predictor inclusion.

“Variable Importance” provides a table of values indicating which environmental predictors are consistently influential in building the predictions across models (Fig 3C). As with the response curves, the output gives users an opportunity to compare estimated relationships to expert knowledge, including the ability to view the total number and relative ranking of predictors. “Predictor Sources” (Fig 3D) displays more detailed descriptions of each predictor used to model the selected species and provides hyperlinks to the original data or publications. Finally, “Credibility Assessment” (Fig 3E) includes an evolving portion of INHABIT: a template from [8] to interpret and assess the various aspects of SDM development process. In the future, this section will incorporate species-by-species information to reflect updates resulting from iterative model versions.

About and feedback tabs

The “About” tab provides a summary of INHABIT’s development partnerships, funding sources, answers to frequently asked questions (generated through user feedback), and citation information. The “Feedback” tab provides a list of questions, many of which came from a one-day workshop that included the INHABIT team and representatives from DOI land management agencies. Many of the questions attempt to identify how users are currently implementing INHABIT in their management strategies, what additional species they would like added to INHABIT, and what aspects of the website’s interface may be difficult to understand or use. Other questions attempt to solicit specific feedback to expand the credibility of INHABIT related to the SDM outputs, including evaluations of the ecological feasibility of the spatial predictors used or feedback about potential new occurrence location data for future model iteration. Finally, users can request new DST features, identify instructions or explanations that could be streamlined or more clearly explained, or reference missing capabilities found in other decision tools.

Case studies

DST developers often have a good sense of what features are technically achievable or practical. But much of the fine-tuning and iteration comes from open dialogues around actionable user feedback and use cases. We acknowledge and attribute these suggestions on the “About” tab, helping remind visitors that INHABIT is a communal, collaborative effort. But the evolution of its relevance and utility is also the result of facilitated discussions with specific end users. The following case studies show how intensive engagement can help strengthen the bridge between scientists and practitioners and further demonstrate how INHABIT can inform ongoing management actions and complement existing planning frameworks.

“Search and destroy” at Joshua Tree National Park

Individuals or small teams perform much of the work to control existing invasive plant species populations through activities such as backpack spraying, tractor mowing, and small-scale prescribed burns. Detection of new populations of invasive plants can be challenging given logistical, financial, and staffing constraints compounded by the time required to navigate rough or roadless terrain even in small management units. Spatial outputs from SDMs, like those found on INHABIT, can help guide sampling and survey efforts for known problematic invaders [26]. These efforts can also guide early detection and rapid response (EDRR) planning in regions without established invasive plant species populations [27].

One early adopter, the Lake Mead IPMT, saw potential for INHABIT to help with fountain grass (Cenchrus setaceus [Forssk.] Morrone), an invasive African bunch grass widely used as an ornamental plant. Fountain grass seeds are wind-dispersed and can travel great distances, making the species problematic in Joshua Tree National Park, a management unit located in the Southern California desert that collaborates with IPMT field crews to survey and treat fountain grass and other invasive plant species. The INHABIT team reached out to managers at the park to evaluate INHABIT and provide feedback on data pertaining to fountain grass, given the potential of the spatial outputs to complement ongoing treatment efforts by the IPMT in and around the park. The majority of known populations exist in the north and southwestern portions of the park, often adjacent to populated areas where the species has been planted. However, Joshua Tree National Park is an expansive and topographically diverse landscape, with large areas of the park only accessible by foot. New fountain grass infestations are usually found while navigating off-trail in wilderness settings, making searching for new satellite populations of fountain grass challenging.

Park staff indicated that accurate habitat suitability maps from INHABIT, combined with their local knowledge and expertise, help prioritize ‘search and destroy’ missions. Initial test drives of this process helped locate and treat remote fountain grass infestations (Fig 4), an independent validation of the predictions made by INHABIT models. This helped demonstrate the actionable nature of INHABIT’s information and the effectiveness of the delivery mechanism for real-world management. Going forward, park staff at Joshua Tree National Park anticipate that INHABIT will help update invasive plant watchlists, which can be shared with volunteer groups to augment the survey capacity of park or IPMT field crews, especially in remote areas. Given the positive experience of these early adopters, INHABIT is now a part of the NPS Pest & Invasive Species Management Project Kit, which provides step-by-step guidance for conducting invasive species and pest management at NPS units. The tool will be highlighted as a resource for individual park managers planning invasive plant prevention, EDRR, and control efforts.

Fig 4. Maps of fountain grass habitat suitability within Joshua Tree National Park.

Fig 4

The top map displays the full park extent while the bottom inset map displays the independently surveyed validation points (not included in the Invasive Species Habitat Tool [INHABIT] models) provided by the National Park Service.

“Defined by water” with the U.S. Fish and Wildlife Service

Acknowledging and incorporating constructive feedback from end users is critical for the iterative improvement of DSTs. These interactions help ensure that end-products are relevant and meaningful to potential users, an important stepping stone to long-term adoption [4]. Additionally, collaborative design can help establish a community understanding of the standard for credible information between scientists and practitioners [28]. This understanding is important when the core products of a DST have the capacity to facilitate management recommendations. When parties can collaboratively improve the information and data that feed into DSTs, it becomes easier for all users to trust the validity and accuracy of downstream products.

As an example of this, the INHABIT team met with U.S. Fish and Wildlife Service (FWS) staff to discuss how the tool could integrate within the existing risk assessment and invasive plant prioritization frameworks used by their refuge system. From these conversations, FWS ecologists identified credibility issues with INHABIT’s mapped predictions for species of concern within refuge boundaries. Their expert knowledge of these biological systems (e.g., wetlands and water-dominated landscapes) helped isolate where mapped predictions were ecologically unreasonable and where the establishment of specific invasive plant species would be improbable.

Biologists from FWS described the refuge system as generally being “defined by water”, emphasizing that the failure to appropriately capture wetland areas on the landscape could broadly undermine the utility of the tool for informing decisions on FWS units. Initially, INHABIT models lacked predictors to delineate and capture water and wetlands. In response, we built a suite of new predictors (S1 Table) including topographic indices indicating soil moisture potential, spectral time-series data identifying trends in water persistence, and high-resolution waterflow information from the National Hydrography Dataset. We shared these predictors and new model iterations with FWS biologists, who in turn evaluated which predictors were the most intuitive and plausible (Fig 5).

Fig 5. Maps of median normalized difference moisture index (April to September).

Fig 5

This new predictor was reviewed favorably by the U.S. Fish and Wildlife Service for future model iterations due to its ability to delineate water bodies and seasonally inundated wetlands. Two example refuges from Oregon, USA are shown: Bear Lake Wildlife Refuge (left) and Malheur National Wildlife Refuge (right).

Iterating INHABIT through feedback

The discussed use cases demonstrate the essential nature of ongoing conversations with current and potential users of INHABIT to continually add practical functionality and make the tool easier to use. One of INHABIT’s strengths is its ability to rapidly address small user interface requests, giving regular users the confirmation that their voices are being heard. Iterative updates to the tool’s visual style (e.g., map colors, scale bar, zoom limits, number of thresholds included), clarifications on technical language, and data additions (e.g., new management boundaries, new species, new predictors) have already been made as direct responses to user feedback.

Continued feedback and requests provide new and exciting ways in which INHABIT can grow and evolve. For example, conversations with FWS highlighted the utility of an alternate management summary option, which would summarize each species’ habitat suitability maps and occurrence information within a focal management unit. The current table emphasizes the relative risk posed by a single species to different management units, while the proposed table would compare risk across species for a single management unit. This ‘ranked risk’ approach for a selected management unit is an upcoming feature offering an alternative to the current management summary information, a suggestion whose utility has been echoed by other agencies, representing an entirely new use-case driven by ongoing user engagement and feedback. Integrating this feature into INHABIT directly addresses the type of quantitative support needed for multi-year planning efforts that FWS and other land management agencies develop within management units. These ranked risk summaries have broad support across agencies and address commonly understood management concerns like EDRR or watchlist generation.

Additional changes to INHABIT in active development also come from commonly received feedback. For example, to complement existing management datasets and allow INHABIT to more directly inform fieldwork, users can now download every map found on INHABIT [29]. Expanded selections for management boundaries will include National Forests from the United States Forest Service and we aim to develop partnerships with the Bureau of Indian Affairs to incorporate tribal lands and support tribal invasive species management. These and other planned enhancements (color scheme accessibility, expanded zoom levels, further simplification of map to three thresholds) will allow INHABIT to remain fresh and relevant as a unique resource in the management of invasive plant species.

Conclusion

INHABIT is a web-based decision support tool designed to display actionable scientific data in the form of spatial and aspatial SDM outputs covering the contiguous United States in support of invasive plant species management. This tool is the outcome of a mutual vision by USGS researchers, NPS and other stakeholders to build a data sharing platform that will allow for rapid feedback from existing and new collaborators and regular updates to both models and user interface features. The two case studies highlighted here illustrate that expert knowledge of species-specific biology, frank discussions of credibility, and long-term partnerships are incredibly valuable when it comes to iterative development of both SDMs and user interface design of DSTs for conservation science. Iterative models can incorporate new occurrence data such as in case study one, new and updated predictors such as case study two (S1 Table), and other feedback related to the ecological plausibility of the model predictions.

Going forward, the flexible architecture of INHABIT’s underlying R Shiny platform will allow it to evolve to meet the challenges of new data, unique use cases, or complex feature requests. Further down the road, integration with powerful cloud-computing resources could enhance the interactivity and flexibility of the tool, expanding its potential userbase. By remaining functionally agile, INHABIT can continue to facilitate actionable, science-based decision-making and improve the effectiveness and credibility of SDMs in the prevention of invasive plant species and prioritization of management decisions.

Supporting information

S1 Table. List of environmental variables considered for invasive habitat suitability modeling.

The variable column includes the name, listed within brackets are the unit of measurement, spatial (cell) resolution, and temporal resolution (if applicable). Each variable also has a specific description and source. Red variable names represent first version variables removed from the second version of the predictor list due to high correlations, redundancy, or contributing little importance to models. Yellow variable names represent second version variables that replaced a similar predictor from the first version. Green variable names represent second version variables that were created in response to feedback and added to the second version of the predictor list to improve model sensitivity. Variable names without an associated color represent first version variables that were retained in the second version list without being modified.

(DOCX)

Acknowledgments

We would like to thank the technical staff who worked tirelessly behind the scenes to bring this project to life: Kylie Baratta, Josh Beard, Paul Hoyeu, Tim Mancuso, Natalya Rapstine, Kristen Richardson, and Justin Wright. We also thank Curt Deuser, Bridgette Flanders, Jeremy Jirak, and Jess Wenick for beta testing and providing feedback for INHABIT. Any use of trade, firm, or product names is for descriptive purposes only and does not imply endorsement by the U.S. Government.

Data Availability

INHABIT is a publicly accessible website where users can view, copy, and download the presented data. In the variable sources tab, links to predictor layers are given whenever possible. Links to occurrence location databases and management polygons sources are provided in the F.A.Q. Additional resources for map data (and associated metadata) are available on ScienceBase at http://doi.org/10.5066/P92476V6.

Funding Statement

Funding for this project was provided by the U.S. Geological Survey Invasive Species Program (https://www.usgs.gov/ecosystems/invasive-species-program), the U.S. Geological Survey Core Science Systems (CSS): Science Analytics and Synthesis (https://www.usgs.gov/core-science-systems/science-analytics-and-synthesis/about), and the U.S. Fish and Wildlife Service (http://www.fws.gov). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Diez E, McIntosh BS. Organisational drivers for, constraints on and impacts of decision and information support tool use in desertification policy and management. Environ Model Softw. 2011;26: 317–327. doi: 10.1016/j.envsoft.2010.04.003 [DOI] [Google Scholar]
  • 2.Gibson FL, Rogers AA, Smith ADM, Roberts A, Possingham H, McCarthy M, et al. Factors influencing the use of decision support tools in the development and design of conservation policy. Environ Sci Policy. 2017;70: 1–8. doi: 10.1016/j.envsci.2017.01.002 [DOI] [Google Scholar]
  • 3.Stewart A, Edwards D, Lawrence A. Improving the science–policy–practice interface: Decision support system uptake and use in the forestry sector in Great Britain. Scand J For Res. 2014;29: 144–153. doi: 10.1080/02827581.2013.849358 [DOI] [Google Scholar]
  • 4.Rose D, Addison P, Ausden M, Bennun L, Mills C, O’Donnell S, et al. Decision support tools in conservation: a workshop to improve user-centred design. Res Ideas Outcomes. 2017;3: e21074. doi: 10.3897/rio.3.e21074 [DOI] [Google Scholar]
  • 5.Jarvis DH, Wachowiak MP, Walters DF, Kovacs JM. Adoption of web-based spatial tools by agricultural producers: Conversations with seven northeastern Ontario farmers using the Geo Visage decision support system. Agric. 2017;7: 69. doi: 10.3390/agriculture7080069 [DOI] [Google Scholar]
  • 6.Enquist CAF, Jackson ST, Garfin GM, Davis FW, Gerber LR, Littell JA, et al. Foundations of translational ecology. Front Ecol Environ. 2017;15: 541–550. doi: 10.1002/fee.1733 [DOI] [Google Scholar]
  • 7.Guisan A, Tingley R, Baumgartner JB, Naujokaitis-Lewis I, Sutcliffe PR, Tulloch AIT, et al. Predicting species distributions for conservation decisions. Arita H, editor. Ecol Lett. 2013;16: 1424–1435. doi: 10.1111/ele.12189 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Sofaer HR, Jarnevich CS, Pearse IS, Smyth RL, Auer S, Cook GL, et al. Development and Delivery of Species Distribution Models to Inform Decision-Making. Bioscience. 2019;69: 544–557. doi: 10.1093/biosci/biz045 [DOI] [Google Scholar]
  • 9.Kass JM, Vilela B, Aiello-Lammens ME, Muscarella R, Merow C, Anderson RP. Wallace: A flexible platform for reproducible modeling of species niches and distributions built for community expansion. O’Hara RB, editor. Methods Ecol Evol. 2018;9: 1151–1156. doi: 10.1111/2041-210X.12945 [DOI] [Google Scholar]
  • 10.Morisette JT, Jarnevich CS, Holcombe TR, Talbert CB, Ignizio D, Talbert MK, et al. VisTrails SAHM: Visualization and workflow management for species habitat modeling. Ecography (Cop). 2013;36: 129–135. doi: 10.1111/j.1600-0587.2012.07815.x [DOI] [Google Scholar]
  • 11.van Kerkhoff L, Lebel L. Linking Knowledge and Action for Sustainable Development. Annu Rev Environ Resour. 2006;31: 445–477. doi: 10.1146/annurev.energy.31.102405.170850 [DOI] [Google Scholar]
  • 12.EDDMapS. Early Detection & Distribution Mapping System. In: The University of Georgia—Center for Invasive Species and Ecosystem Health. [Internet]. 2021. [cited 9 Feb 2021]. Available: http://www.eddmaps.org/ [Google Scholar]
  • 13.CalFlora. 2021 [cited 16 Sep 2021]. Available: https://www.calflora.org
  • 14.GBIF: Global Biodiversity Information Facility. 2021 [cited 16 Sep 2021]. Available: http://www.gbif.org
  • 15.Feng X, Castro MC, Linde E, Papeş M. Armadillo Mapper. Trop Conserv Sci. 2017;10: 194008291772413. doi: 10.1177/1940082917724133 [DOI] [Google Scholar]
  • 16.Bariotakis M, Georgescu L, Laina D, Oikonomou I, Ntagounakis G, Koufaki M-I, et al. From wild harvest towards precision agriculture: Use of Ecological Niche Modelling to direct potential cultivation of wild medicinal plants in Crete. Sci Total Environ. 2019;694: 133681. doi: 10.1016/j.scitotenv.2019.133681 [DOI] [PubMed] [Google Scholar]
  • 17.Wszola LS, Simonsen VL, Stuber EF, Gillespie CR, Messinger LN, Decker KL, et al. Translating statistical species-habitat models to interactive decision support tools. Hazen EL, editor. PLoS One. 2017;12: e0188244. doi: 10.1371/journal.pone.0188244 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Harrity EJ, Stevens BS, Conway CJ. Keeping up with the times: Mapping range-wide habitat suitability for endangered species in a changing environment. Biol Conserv. 2020;250: 108734. doi: 10.1016/j.biocon.2020.108734 [DOI] [Google Scholar]
  • 19.McHenry J, Welch H, Lester SE, Saba V. Projecting marine species range shifts from only temperature can mask climate vulnerability. Glob Chang Biol. 2019;25: 4208–4221. doi: 10.1111/gcb.14828 [DOI] [PubMed] [Google Scholar]
  • 20.Young NE, Jarnevich CS, Sofaer HR, Pearse I, Sullivan J, Engelstad P, et al. A modeling workflow that balances automation and human intervention to inform invasive plant management decisions at multiple spatial scales. Di Febbraro M, editor. PLoS One. 2020;15: e0229253. doi: 10.1371/journal.pone.0229253 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Chang W, Cheng J, Allaire J, Xie Y, McPherson J. shiny: Web Application Framework for R. R package version 1.4.0. 2019. Available: https://cran.r-project.org/package=shiny [Google Scholar]
  • 22.Valle D, Toh K Ben, Millar J. Rapid prototyping of decision-support tools for conservation. Conserv Biol. 2019;33: 1448–1450. doi: 10.1111/cobi.13305 [DOI] [PubMed] [Google Scholar]
  • 23.Elith J, Phillips SJ, Hastie T, Dudík M, Chee YE, Yates CJ. A statistical explanation of MaxEnt for ecologists. Divers Distrib. 2011;17: 43–57. doi: 10.1111/j.1472-4642.2010.00725.x [DOI] [Google Scholar]
  • 24.Davis J, Goadrich M. The relationship between precision-recall and ROC curves. ACM International Conference Proceeding Series. New York, New York, USA: ACM Press; 2006. pp. 233–240. doi: 10.1145/1143844.1143874 [DOI]
  • 25.Sofaer HR, Hoeting JA, Jarnevich CS. The area under the precision‐recall curve as a performance metric for rare binary events. McPherson J, editor. Methods Ecol Evol. 2019;10: 565–577. doi: 10.1111/2041-210X.13140 [DOI] [Google Scholar]
  • 26.Crall AW, Jarnevich CS, Panke B, Young N, Renz M, Morisette J. Using habitat suitability models to target invasive plant species surveys. Ecol Appl. 2013;23: 60–72. doi: 10.1890/12-0465.1 [DOI] [PubMed] [Google Scholar]
  • 27.Cook G, Jarnevich C, Warden M, Downing M, Withrow J, Leinwand I. Iterative Models for Early Detection of Invasive Species across Spread Pathways. Forests. 2019;10: 108. doi: 10.3390/f10020108 [DOI] [Google Scholar]
  • 28.Morisette JT, Cravens AE, Miller BW, Talbert M, Talbert C, Jarnevich C, et al. Crossing Boundaries in a Collaborative Modeling Workspace. Soc Nat Resour. 2017;30: 1158–1167. doi: 10.1080/08941920.2017.1290178 [DOI] [Google Scholar]
  • 29.Jarnevich CS, LaRoe J, Engelstad P, Sullivan J. INHABIT species potential distribution across the contiguous United States: U.S. Geological Survey data release. 2021. doi: 10.1371/journal.pone.0256633 [DOI] [PMC free article] [PubMed] [Google Scholar]

Decision Letter 0

Daniel de Paiva Silva

16 Aug 2021

PONE-D-21-14256

INHABIT: a web-based decision support tool for invasive species habitat visualization and assessment across the contiguous United States

PLOS ONE

Dear Dr. Engelstad,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by October 13th, 2021. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: http://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Daniel de Paiva Silva, Ph.D.

Academic Editor

PLOS ONE

Journal requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf.

2.We note that the grant information you provided in the ‘Funding Information’ and ‘Financial Disclosure’ sections do not match.

When you resubmit, please ensure that you provide the correct grant numbers for the awards you received for your study in the ‘Funding Information’ section.

3. We note that Figures 2,4 and 5 in your submission contain [map/satellite] images which may be copyrighted. All PLOS content is published under the Creative Commons Attribution License (CC BY 4.0), which means that the manuscript, images, and Supporting Information files will be freely available online, and any third party is permitted to access, download, copy, distribute, and use these materials in any way, even commercially, with proper attribution. For these reasons, we cannot publish previously copyrighted maps or satellite images created using proprietary data, such as Google software (Google Maps, Street View, and Earth). For more information, see our copyright guidelines: http://journals.plos.org/plosone/s/licenses-and-copyright.

We require you to either (1) present written permission from the copyright holder to publish these figures specifically under the CC BY 4.0 license, or (2) remove the figures from your submission:

a. You may seek permission from the original copyright holder of Figures 2,4 and 5 to publish the content specifically under the CC BY 4.0 license. 

We recommend that you contact the original copyright holder with the Content Permission Form (http://journals.plos.org/plosone/s/file?id=7c09/content-permission-form.pdf) and the following text:

“I request permission for the open-access journal PLOS ONE to publish XXX under the Creative Commons Attribution License (CCAL) CC BY 4.0 (http://creativecommons.org/licenses/by/4.0/). Please be aware that this license allows unrestricted use and distribution, even commercially, by third parties. Please reply and provide explicit written permission to publish XXX under a CC BY license and complete the attached form.”

Please upload the completed Content Permission Form or other proof of granted permissions as an "Other" file with your submission.

In the figure caption of the copyrighted figure, please include the following text: “Reprinted from [ref] under a CC BY license, with permission from [name of publisher], original copyright [original copyright year].”

b. If you are unable to obtain permission from the original copyright holder to publish these figures under the CC BY 4.0 license or if the copyright holder’s requirements are incompatible with the CC BY 4.0 license, please either i) remove the figure or ii) supply a replacement figure that complies with the CC BY 4.0 license. Please check copyright information on all replacement figures and update the figure caption with source information. If applicable, please specify in the figure caption text when a figure is similar but not identical to the original image and is therefore for illustrative purposes only.

The following resources for replacing copyrighted map figures may be helpful:

USGS National Map Viewer (public domain): http://viewer.nationalmap.gov/viewer/

The Gateway to Astronaut Photography of Earth (public domain): http://eol.jsc.nasa.gov/sseop/clickmap/

Maps at the CIA (public domain): https://www.cia.gov/library/publications/the-world-factbook/index.html and https://www.cia.gov/library/publications/cia-maps-publications/index.html

NASA Earth Observatory (public domain): http://earthobservatory.nasa.gov/

Landsat: http://landsat.visibleearth.nasa.gov/

USGS EROS (Earth Resources Observatory and Science (EROS) Center) (public domain): http://eros.usgs.gov/#

Natural Earth (public domain): http://www.naturalearthdata.com/

Additional Editor Comments (if provided):

Dear Engelstad et al,

In light of a new round of reviews, I believe your manuscript could be accepted for publication after you perform more improvements to it. I agree with reviewer #1 that more work is needed to make the MS fit into one of the two proposed categories, especially the category #1 indicated by reviewer #1.

Considering the necessary changes, I will provide you with a two-month period to improve your MS (resubmit by October 13th, 2021). In case you need more time, please let me know. By the time of re-submission do not forget to prepare a rebuttal letter where you inform your reviewers of all the accepted/rejected suggested with the related justifications.

Sincerely,

Daniel Silva, Ph.D.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for this thoughtful article. The premise of the article is really important. I understood the premise as this: Researchers & scientists need to figure out who they are creating DST for, and engage those users early-on in the process of creating DSTs. I expected to read more details in the case studies about how the users interacted with INHABIT, how it was useful, what did and did not work for the users and why, and how you (the authors & DST developers) improved on the DST based on the users’ testing and feedback. I expected that all of this information from the case studies would be analyzed as data and thus be presented as a research paper. However, the article reads more like a description of the INHABIT DST. The data presented in the paper is related to the development of the invasive species habitat suitability models, and there is also a lot of detail on the functionality and design of the DST.

In my opinion, the information presented in this manuscript does not meet the PLOS ONE standards (https://journals.plos.org/plosone/s/reviewer-guidelines#loc-criteria-for-publication) for a research article. However, the INHABIT DST seems like a very useful tool with real-world applications, and I think that a paper describing the benefits of INHABIT, the assumptions of the model, and case studies should be published -- it just should not be labeled as a research paper based on the standards according to PLOS One. The manuscript does need major revisions.

I envision that you (the authors) can make edits and publish this one of two ways.

1) A manuscript that falls within the category of PLOS Ones’ “Methods, software, databases, and tools” paper:

https://journals.plos.org/plosone/s/submission-guidelines#loc-methods-software-databases-and-tools. The manuscript is currently much more like this type of an article than a standard PLOS ONE research article. I don’t think that you need to make as many edits in order to conform to PLOS ONE standards for this kind of submission.

Based on the guidelines at the URL above, this manuscript could be edited to focus MORE on the following aspects of INHABIT & the two case studies (the two sections in quotes below are copied from the URL above):

Utility

“The tool must be of use to the community and must present a proven advantage over existing alternatives, where applicable.…For software, databases, and online tools, the long-term utility should also be discussed, as relevant. This discussion may include maintenance, the potential for future growth, and the stability of the hosting, as applicable.”

- provide more details on the proven advantage over existing alternatives

- potential for future growth? Perhaps there are insights from the case studies

- the long term utility is implicit, but again, give more insights from the case studies, for example, any surveys from the users, or contracts with other users, or feedback submitted to the platform?

Validation

Submissions presenting methods, software, databases, or tools must demonstrate that the new tool achieves its intended purpose. If similar options already exist, the submitted manuscript must demonstrate that the new tool is an improvement over existing options in some way. This requirement may be met by including a proof-of-principle experiment or analysis; if this is not possible, a discussion of the possible applications and some preliminary analysis may be sufficient.

- the case studies do show validation

or,

2) With a lot more editing, this could be a standard research article that includes a lot more data (qualitative and quantitative, if available, plus any statistical analyses?) on the case studies, e.g., the feedback from participants in both groups, how you elicited their feedback, sample sizes, how you iterated on the design of the DST and/or co-created with the users your current version of INHABIT. What did you learn from the users and what kinds of questions elicited the learnings? How do you know that the user groups will continue to benefit from INHABIT? There seems to be a lot of great data from the FWS case study. It’s really great that you created new predictors to meet their stated needs, and that FWS was generally pleased by this—but these learnings are really glossed over it in lines 318-352. Also, what kinds of interesting feedback do you get submitted via the feedback form? How can this help further develop the DST? In order to present this as a research article that is more about user testing & iteration, perhaps look to some of the methods that entrepreneurs use when starting new businesses (see for example Lean Startup methodology).

Reviewer #2: Paper reviewed: “INHABIT: A web-based decision support tool

for invasive species habitat visualization and assessment

across the contiguous United States” by P. Engelstad, C.S. Jarnevich, T. Hogan, H.R. Sofaer, I.S. Pearse, J.L. Sieracki, N. Frakes, J. Sullivan, N.E. Young, J.S. Prevéy, P. Belamaric and J. LaRoe

Reviewer: Prof. V.K. Tokhtar, Doctor of Science (Biology),

Belgorod State National Research University (Russia)

Preserving biodiversity is among the main challenges faced by contemporary science. Solution to this problem may only be found in the course of cross-disciplinary research. Good prospects are offered by the use of mathematical approaches in natural sciences. The latter is in the focus of the paper reviewed.

The title and abstract are appropriate for the context. The paper is well-constructed, and the findings are sufficiently described.

The authors provide the results of developing the Invasive Species Habitat Tool (INHABIT), a web application DST built with R-Shiny to display spatially predicted habitat suitability from SDMs for invasive plants across the continental United States. The most important thing is that INHABIT provides actionable science to support the prevention and management of invasive species. Of equal importance is the fact that INHABIT is a publicly accessible website where users can view, copy, and download the presented data.

The authors describe the web-based decision support tool allowing for visualization of invasion species habitats across the contiguous United States. The tool bears testimony to the reliability of user data and facilitates research. INHABIT makes it possible to track the spread of invasive species, for instance, Cenchrus setaceus [Forssk.] Morrone (as exemplified with the case of Joshua Tree National Park) with a view to preventing its dispersal. A substantial advantage of the paper is the abundance of relevant graphic materials.

I believe the paper “INHABIT: A web-based decision support tool for invasive species habitat visualization and assessment across the contiguous United States” definitely deserves scientific attention, and the approaches described by the authors should be further implemented. I therefore recommend the paper for publication in PLOS ONE journal.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Valeriy K. Tokhtar

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2022 Feb 8;17(2):e0263056. doi: 10.1371/journal.pone.0263056.r002

Author response to Decision Letter 0


12 Nov 2021

Dr. Silva,

Thank you for giving us the chance to submit a revised version of our manuscript. We are pleased that the reviewers valued the contribution provided by our manuscript, and appreciate the thoughtful comments and suggestions you and the reviewers were able to provide. As suggested by Reviewer #1, our manuscript now reflects important changes to more closely align with PLOS ONE’s criteria for “Methods, software, databases, and tools”. Namely, we have reworked the introduction to provide more detail on the methods currently used to generate invasive plant management actions and include more detail on the novelty of the tool in this context. We also now include a third subsection to the case studies that expands upon the ways in which INHABIT has and will change as a direct result of user feedback.

In addition to the above comments, figure two has been revised to remove any copyright content. Figures four and five were flagged for possible copyright violations but they both only contain image content from our model outputs. Minor comments have been incorporated, and we have edited for clarity where suggested. See below for detailed responses to both reviewers.

Comments for Reviewer #1

We appreciate the reviewer’s suggestion that, as a description of a real-world application, the content of this manuscript falls under the “Methods, software, databases, and tools” category. To better structure the manuscript to fit the criteria of these types of submissions (namely, Utility and Validation), the reviewer suggested the following:

“provide more details on the proven advantage over existing alternatives “

We have edited a significant portion of the introduction to emphasize the novelty of this tool and describe its difference from currently available tools. From conversations with land managers and practitioners, we are not aware of any available tool equivalent to INHABIT. Without INHABIT, occurrence locations alone shape much of the spatial aspect of invasive species management and assessment in the United States. The use of occurrence locations in isolation paints an incomplete picture of the landscape and so can be complemented and filled in by predictions of habitat suitability from species distribution models. Overall, our tool represents a fundamental shift in the accessibility, interpretability, and utility of species distribution model outputs for the explicit purpose of invasive species management.

“potential for future growth? Perhaps there are insights from the case studies”

“the long term utility is implicit, but again, give more insights from the case studies, for example, any surveys from the users, or contracts with other users, or feedback submitted to the platform?”

To address these closely related comments, we have added a third section to the case studies entitled “Iterating INHABIT through feedback”. In this new section, we go into detail regarding the changes (big and small) to INHABIT that have already been implemented as a direct result of user feedback. Also highlighted are upcoming changes and their anticipated impact on the invasive species management community at large. The changes to the website come from a variety of sources, including the feedback tab, ongoing partner conversations, and web analytics analysis. In the future, a more formal usability survey may be conducted to help determine specific enhancements to web-design elements of INHABIT.

“the case studies do show validation”

We agree with the reviewer that validation is an important part of our work. Collaboration from the National Park Service has been very fruitful in providing on-the-ground confirmation of the SDM predictions available through INHABIT. Continually evolving validation strategies are also anticipated for future model workflow iterations, with more robust testing and training splits building off the current methods from Young et al, 2020.

Comments for Reviewer #2

We thank the reviewer for their enthusiasm about our work and agree that INHABIT is a boon to management planning through ease of access, downloadable materials, and unique visualizations. We appreciate the reviewer’s recommendation for publication and that, while the edits mentioned above represent changes to the manuscript, the fundamental structure has not been altered significantly.

We look forward to hearing from you in due time regarding our submission and to respond to

any further questions and comments you may have.

Sincerely,

Peder Engelstad

peder.engelstad@colostate.edu

+1 206-478-1474

9/21/2021

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Daniel de Paiva Silva

12 Jan 2022

INHABIT: a web-based decision support tool for invasive plant species habitat visualization and assessment across the contiguous United States

PONE-D-21-14256R1

Dear Dr. Engelstad,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Daniel de Paiva Silva, Ph.D.

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Dear Engelstad et al.,

It is with a great pleasure that I inform you that your manuscript was accepted for publication in PLoS One!

Good job!

Sincerely,

Daniel Silva

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. If the authors have adequately addressed your comments raised in a previous round of review and you feel that this manuscript is now acceptable for publication, you may indicate that here to bypass the “Comments to the Author” section, enter your conflict of interest statement in the “Confidential to Editor” section, and submit your "Accept" recommendation.

Reviewer #1: All comments have been addressed

Reviewer #2: All comments have been addressed

**********

2. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: N/A

Reviewer #2: Yes

**********

4. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

6. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Dear Peder,

Thank you for addressing my initial comments on the format of the paper so that it better fits Plos’ requirements of the methods, tools, etc. manuscript. This version is much improved! I have a much better understanding of how stakeholders can use INHABIT and how easy it is to adapt the tool to the needs and on-the-ground knowledge of users. Lines 377-387 is exactly what I was looking for in my previous review. Thank you for explaining a type of feedback, how you are adapting INHABIT, and why the change is useful.

I only have a few minor editorial suggestions to improve the clarity of sentences in a few locations.

I hope that this publication helps you reach more additional users. In addition, and not something that needs to be included in the publication, I hope that you’re considering training sessions and/or scheduling sessions at relevant scientific meetings to recruit additional users & continue to get feedback.

Minor suggestions:

Line 146:

Rather than stating that the modeling workflow is “…established by [citation 20]…”, can you specify the study’s authors and/or project in narrative form in the sentence?

Lines 364-367 (Figure 5 description)

Use of the word "positively evaluated" here is a little confusing. I think you are saying they (USFWS) “validated” the new predictor? Or that they evaluated the modifications, and agreed that the updates were more accurate/precise/realistic? Please consider rewording this to better reflect USFWS’s reaction.

Line 388: This sentence is a bit awkward -- I think the sentence is supposed to set up the rest of the paragraph to provide examples of commonly received feedback? If so, please consider rewording it for clarity so that readers know they are about to read about examples.

Lines 401-403: I suggest breaking up this sentence into >1 sentence for clarity. Specifically, the last clause in the sentence – it’s a bit unclear who or what can “…provide regular iteration…”.

Lines 406-407: This is the first place you mention case study 1 and 2 in the narrative, and while I assume case study 1 is “Search and Destroy” at Joshua Tree, it would be good to update the headings for the case study sections.

Reviewer #2: Conduct similar studies in other National Parks (in other states), expand the list of sites and compare the results

**********

7. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: Yes: Valery Tokhtar, Dr. Sci (Biol)

Acceptance letter

Daniel de Paiva Silva

31 Jan 2022

PONE-D-21-14256R1

INHABIT: a web-based decision support tool for invasive plant species habitat visualization and assessment across the contiguous United States

Dear Dr. Engelstad:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Daniel de Paiva Silva

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. List of environmental variables considered for invasive habitat suitability modeling.

    The variable column includes the name, listed within brackets are the unit of measurement, spatial (cell) resolution, and temporal resolution (if applicable). Each variable also has a specific description and source. Red variable names represent first version variables removed from the second version of the predictor list due to high correlations, redundancy, or contributing little importance to models. Yellow variable names represent second version variables that replaced a similar predictor from the first version. Green variable names represent second version variables that were created in response to feedback and added to the second version of the predictor list to improve model sensitivity. Variable names without an associated color represent first version variables that were retained in the second version list without being modified.

    (DOCX)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    INHABIT is a publicly accessible website where users can view, copy, and download the presented data. In the variable sources tab, links to predictor layers are given whenever possible. Links to occurrence location databases and management polygons sources are provided in the F.A.Q. Additional resources for map data (and associated metadata) are available on ScienceBase at http://doi.org/10.5066/P92476V6.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES