Abstract
The ability to collect and synthesize long-term environmental monitoring data is essential for the effective management of freshwater ecosystems. Progress has been made in assessment and monitoring approaches that have integrated routine monitoring programs into more holistic watershed-scale vulnerability assessments. While the concept of vulnerability assessment is well-defined for ecosystems, complementary and sometimes competing concepts of adaptive management, ecological integrity, and ecological condition complicate the communication of results to a broader audience. Here, we identify progress in freshwater assessments that can contribute to the identification and communication of freshwater vulnerability. We review novel methods that address common challenges associated with: 1) a lack of baseline information, 2) variability associated with a spatial context, and 3) the taxonomic sufficiency of biological indicators used to make inferences about ecological conditions. Innovation in methods and communication are discussed as a means to highlight meaningful cost-effective results that target policy towards heuristic ecosystem-management.
Keywords: Biomonitoring, freshwater assessment, ecological vulnerability, water quality
Introduction
Long-term environmental monitoring data is essential for impact evaluation and causal inferences 1 to plan effective freshwater ecosystem management. With increased development, water managers, policymakers, industry, government(s), and local community groups, have taken stewardship roles in monitoring water quality. 2 The challenge in managing freshwater ecosystems is an inherent lack of commonly accepted methods or strategies to ascertain impairment and communicate risk. Water quality monitoring programs will often make decisions based on logistics, cost, capacity, and existing policy and practice; rarely are factors behind the decision-making process adequately studied prior to the commencement of monitoring programs. Yet, awareness of sustainability in developing urban centers has increased in parallel to the demand for ecosystem services, which has highlighted the need for effective monitoring solutions.
We are beginning to move away from baseline assessment programs for the sake of monitoring and moving towards a more integrated watershed management system. Indeed, whereas previous ‘freshwater management’ would focus solely on one ecosystem, government(s) have increasingly moved towards integrated watershed management. 3 Here, we define the concept of vulnerability in freshwater assessment and review challenges associated with the detection and communication of ecological impairment. Progress in understanding freshwater vulnerability is framed by a review of approaches that address: 1) a lack of baseline information, 2) spatial variability, 3) and inferences made from biological indicators. Innovation in the communication of results has also become a prominent factor. Indeed, whereas ‘monitoring’ has historically been targeted as a means for baseline assessment, recent studies have suggested that it occurs within a framework of policy implementation and/or development informed by impact evaluation. 1
Defining vulnerability in freshwater assessment
The term vulnerability alone is one that is generally understood, but there are many contexts in which it is used, and many complex factors that are difficult to quantify that can inherently influence the potential for loss. 4 Vulnerability as a concept is not new in the social dimension, where it is readily applied at a community level to understand the influence of change. 5 The use of the term vulnerability in freshwater management is relatively new 6 but recognized as a means to conceptualize and communicate risk. 7 While there are many approaches to defining vulnerability from an ecosystem perspective, 8 a capacity to adapt implies that balance (e.g. resilience) and trajectory are the two principal factors that can define vulnerability. 9 Ecological stress challenges this paradigm, and the concept of ecological integrity attempts to capture resilience with respect to stress and disturbance.10,11 Thus, ecological impairment is a result of some form of stress, which increases the vulnerability associated with reduced adaptive capacity. We suggest that freshwater assessment should include implementation components to integrate methods of baseline monitoring and concepts of vulnerability and risk assessment with more focus on informing policy and management at the watershed scale (Figure 1).
Figure 1.
A review of the progress in freshwater vulnerability assessment in terms of moving from baseline monitoring to management and policy implementation. Implementation components are indicated in green bubbles.
A scan of the literature indexed in SCOPUS with the boolean search teams “Vulnerability AND assessment AND freshwater” found 408 papers published since January 9, 2023. Of these, 232 were deemed to be relevant articles covering the topic of freshwater assessment after a title and abstract scan. The number of publications that include the concept of vulnerability applied to freshwater assessments has increased in recent years, more than doubling since 2009 (Figure 2(a)). While most publications included the concept of vulnerability in freshwater assessment with a broad scope, a large portion of studies focused on the specific topic areas of groundwater, fish conservation, and water security (Figure 2(b)). The large increase in the number of publications that include vulnerability as a concept in freshwater assessment over the last decade highlights the move towards research at broader scales that include socio-ecological concepts.
Figure 2.
The number of publications that include the concept of vulnerability in freshwater assessment; (a) publications by year, and (b) a reflection of the topic area of publications, with general assessment grouped as ‘freshwater assessment’.
Methods of freshwater assessment
An ecosystem-based vulnerability assessment process aims to quantify impairment of the biotic and abiotic environment and identify the extent of threats that would require management intervention. 12 Broad inclusion of the concept of vulnerability in specific conservation strategies has been applied to fish,13–15 invasive species,16–18 and endangered populations.19,20 However, the characterization of ecological properties, such as water quality, biological attributes, and habitat, is required for site-specific risk assessment. 6
Metrics that synthesize relationships between biological indicators and environmental and/or stress gradients have become common in routine monitoring programs. 21 For example, the Index of Benthic Invertebrates (IBI), 22 Rapid Bioassessment Protocol (RBP), 11 Australian River Assessment System (AusRivAS), 23 and AQEM/STAR, 24 are used to assess freshwater and brackish ecosystems globally.25–28 Morphologically identified biota, such as benthic macroinvertebrates, are commonly used 29 ; however, recent studies have incorporated the use of diatoms, 30 dragonfly larvae, 31 fish (and their traits),32,33 and rare species. 7
While multimetric indices have been used for decades to simplify complex individual species-environment relationships to infer environmental conditions, shortcomings still exist. The first, and most prominent, problem is a lack of baseline information for comparisons of past environments or the calculation of a natural trajectory. 1 Secondly, spatial and temporal variabilities of biota can influence structural changes, causing “noise” in the assessment, which can prevent universal monitoring approaches. 34 Finally, cost-effectiveness can limit the amount of data collected, and the depth to which it is analyzed. A vulnerability assessment approach can also be applied to quantify the functional aspects of ecosystems, whereby aquatic trophic systems are examined with the use of trait-based metrics.35,36 While the optima and tolerance of biological indicators across stress gradients are used for assessment, species-specific ecological information, such as functional end-points, 1 is often lacking, and species-environment correlations are assumed to be independent of time. 37
Baseline context
There is often an assumption that historic data will provide an appropriate reference condition for management purposes, yet ecosystems evolve over time on a natural trajectory influenced by multiple collinear, and often competing, natural factors. 38 The natural condition of ecosystems could pre-date human settlement by several centuries, and monitoring programs are usually deployed after a problem is either identified or assumed. 39 Seldom do local governments have the capacity to monitor freshwater systems using a sampling resolution high enough to understand anthropogenic influences from natural variability. 40
The ability of paleolimnology to provide decades to centuries of missing data through the analyses of biological indicators preserved in sediment profiles has recently been highlighted as a means to complement the assessment of vulnerability.41,42 The community composition of indicators in lacustrine sediment can be used to reconstruct past conditions. By filling gaps in monitoring records and quantifying natural variability, paleolimnology provides a means to predict the future trajectory of lake and wetland ecosystems.43,44 However, Duarte et al. (2009) 45 note the disconnect between the expectation that ecosystems would return to a pre-disturbance state following intervention and the reality that ecological trajectories are influenced across time by a multitude of factors that may be independent of the original degradation pathway that restoration efforts were intended for. Regardless, reconstructions of baseline conditions can facilitate freshwater management so that decision-makers can adapt and respond to changes that are both anticipated and unanticipated.
Spatially-sensitive metrics
The use of trait-based methods for freshwater assessment is relatively new, with a large focus on streams and rivers. 46 Trait-based metrics are less prone to spatial variability on a regional scale47,48 and not influenced by biogeographical constraints, unlike taxonomic responses. 49 Indeed, the quantification of functional traits, especially feeding traits, can help assess the resilience of ecosystems as these attributes are fairly consistent over time. 7 While functional diversity is often the most widely used metric, especially in the assessment of populations of macroinvertebrates 50 and fish,51,52 some studies have found differences in phylogenetic diversity associated with human influence. 53 However, the interplay between local environment, habitat, and spatial processes can prevent “pure” species sorting of indicator taxa. 54 This has led to a bias of studies that focus on ecosystem-functioning relationships at a local scale. 50
Recent studies have deployed a metacommunity approach, which includes spatial processes and biological interactions as factors; anthropogenic impairment can also influence community structuring and consequently introduce variability to biotic metrics.34,55 Milošević et al. (2022) 34 suggest that a multifactor approach, which covers multiple sources of variability in aquatic biota, can significantly increase the sensitivity of monitoring programs, lowering “noise” in the models caused by natural variability. Thus, the inclusion of spatially-sensitive metrics can increase our understanding of impairment at a regional scale.
Emergent methods to address taxonomic sufficiency
A traditional morphological approach in biomonitoring attempts to have “as high as possible” taxonomic resolution for inferences to be made based on known environmental relationships with specific taxa. 56 However, the identification of species based solely on morphological features can be problematic; the number of misidentifications increases with taxonomic resolution. 57 Morphological identification of freshwater biota is also an extremely time-consuming high-expertise-driven process, which may not always be cost-effective or practical for routine monitoring 58 ; fewer taxonomists are getting stretched across more fields of inquiry than their capacity can accommodate.59,60
Historically, the solution to questions of taxonomic sufficiency has focused on metrics that could use lower taxonomic resolution but provide similar environmental inferences. The development of new methods of identification, such as DNA barcoding, could fundamentally change how we monitor and assess vulnerable ecosystems. High-throughput sequencing of environmental samples 61 can overcome constraints associated with morphological identification. Analysis of hundreds of specimens simultaneously offers an alternative to traditional morphotaxonomic identification, and can usually generate species-level outputs. 62 However, meta-barcoding approaches also have challenges, such as unknown threshold values for species delamination, a lack of abundance data that assessments are based on, as well as infrastructure and cost constraints. 63 Although, improvements in technology will likely lead to the expansion of genetic methods in the near future.
Computer-assisted automated deep learning approaches that use computer vision can be used for species identification to improve the cost-effectiveness of biomonitoring approaches. 64 Convolutional Neural Networks (CNN) have been applied to a wide variety of animal taxa (zooplankton, macroinvertebrates, corals, fishes, insects, and even mammals). 65 However, deep-learning models are sensitive to the amount of training data available, which can be limited in systems with a large number of rare taxa. 66 Computer-assisted deep-learning approaches are promising since the accuracy level in species identification done by artificial intelligence is high at a time when human expertise is limited.
Communication of vulnerability
When reviewing progress in understanding the vulnerability of freshwater ecosystems, one must also consider how vulnerabilities are communicated. Current methods of assessment can synthesize complex biological relationships into a metric score, but these are often difficult to communicate for policy and decision-making purposes. Disaster management (e.g. flood forecasting) has long used a probability-based calculation of likelihood to communicate risk, expressed as a recurrence interval. 67 The broader public's understanding of recurrence intervals is problematic 68 ; yet, a function of risk assessment relies on the underlying ability to base predictions of hazards on the probability they will occur based on past context. 67
Risk is defined and communicated in the hazard risk vulnerability assessment (HRVA) process as the likelihood an event will occur magnified by the consequences of the event occurring. 69 While developed for emergency management, 70 HRVA has recently been used for climate change adaptation and mitigation planning 71 and freshwater assessment. 72 HRVA is based on communication of the severity of disturbances and incorporates socio-economic and physical-environmental priorities of a particular location. Since HRVA was designed for synthesizing risk for broader public discourse, it offers a process in which adaptation and mitigation measures can be aligned to the output to help inform planning practices. While studies of water security have focused on the communication of vulnerability, we feel as though more effort needs to be made to integrate freshwater assessment with a broader implementation strategy (e.g. Figure 1), which could be informed by an assessment metric focused on communication of risk (similar to the HRVA process).
Conclusion
While decision-makers often a lack long-term modeling and forecasting of freshwater vulnerability to predict the trajectory of ecosystems, progress has been made in assessment methods to address current shortcomings in baseline information, spatial variability, and taxonomic sufficiency of indicators used for inferences of ecological condition. Our review shows that freshwater assessments that include the concept of vulnerability have increased in recent years; yet, few focus on the communication of associated risk to a broader public audience. As such, we recommend that the concept of vulnerability should be applied to freshwater assessment and focus on methods that further our ability to produce and communicate meaningful results. Further innovation in the communication of risk will allow decision-makers to target policy toward heuristic ecosystem management.
Author biographies
AS Medeiros is an interdisciplinary researcher who focuses on understanding the influence of environmental stress on freshwater services, past, present, and future. He is particularly motivated in applying new methodologies to community-based research and ecological vulnerability assessment. By combining principles of freshwater ecology, paleolimnology, and risk assessment, he is able to bridge the gap between the natural evolution of freshwater ecosystems and human-induced change that influences ecosystem services. This includes investigation of water security through the lens of sustainability and conservation, municipal planning, and engineering for freshwater supply services.
D Milošević is an expert taxonomist who specializes in the identification of non-biting midges (also known as chironomids). His research aims to refine taxonomic resolution through deep learning approaches to optimize our understanding of species-environment relationships and has pioneered methods in the automated identification of specimens for biomonitoring of European lakes and streams.
Footnotes
The author(s) declared no potential conflicts of interest with respect to the research, authorship, and/or publication of this article.
Funding: The author(s) received no financial support for the research, authorship, and/or publication of this article.
ORCID iDs: AS Medeiros https://orcid.org/0000-0002-7743-2560
D Milošević https://orcid.org/0000-0002-5328-3898
References
- 1.Wauchope HS, Amano T, Geldmann J, et al. Evaluating impact using time-series data. Trends Ecol Evol 2021; 36: 196–205. [DOI] [PubMed] [Google Scholar]
- 2.Halliday SJ, Skeffington RA, Wade AJ, et al. High-frequency water quality monitoring in an urban catchment: hydrochemical dynamics, primary production and implications for the water framework directive. Hydrol Processes 2015; 29: 3388–3407. [Google Scholar]
- 3.Wang G, Mang S, Cai H, et al. Integrated watershed management: evolution, development and emerging trends. J For Res 2016; 27: 967–994. [Google Scholar]
- 4.Adger WN. Vulnerability. Glob Environ Change 2006; 16: 268–281. [Google Scholar]
- 5.Ford JD, Smit B. A framework for assessing the vulnerability of communities in the Canadian Arctic to risks associated with climate change. Arctic 2004; 57: 389–400. [Google Scholar]
- 6.Plummer R, de Loë R, Armitage D. A systematic review of water vulnerability assessment tools. Water Resour Manage 2012; 26: 4327–4346. [Google Scholar]
- 7.Angeler DG, Allen CR, Birgé HE, et al. Assessing and managing freshwater ecosystems vulnerable to environmental change. Ambio 2014; 43: 113–125. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.De Lange HJ, Sala S, Vighi Met al. et al. Ecological vulnerability in risk assessment — A review and perspectives. Sci Total Environ 2010; 408: 3871–3879. [DOI] [PubMed] [Google Scholar]
- 9.Karr JR. Ecological integrity and ecological health are not the same. Engineering within ecological constraints. Washington DC, USA: National Academy of Engineering, 1996; 97:pp.109. [Google Scholar]
- 10.Smit B, Wandel J. Adaptation, adaptive capacity and vulnerability. Glob Environ Change 2006; 16: 282–292. [Google Scholar]
- 11.Barbour MT, Gerritsen J, Snyder BDet al. et al. Rapid Bioassessment Protocols for Use in Streams and Wadeable Rivers: Periphyton, Benthic Macroinvertebrates and Fish. Washington, DC: US Environmental Protection Agency, Office of Water, 1999. [Google Scholar]
- 12.Weißhuhn P, Müller F, Wiggering H. Ecosystem vulnerability review: proposal of an interdisciplinary ecosystem assessment approach. Environ Manag 2018; 61: 904–915. [DOI] [PubMed] [Google Scholar]
- 13.Hlohowskyj I, Brody MS, Lackey RT. Methods for assessing the vulnerability of African fisheries resources to climate change. Clim Res 1996; 6: 97–106. [Google Scholar]
- 14.Quiñones RM, Moyle PB. Climate change vulnerability of freshwater fishes of the San Francisco Bay area. San Francisco Estuary Watershed Sci 2014; 12: 1–9. [Google Scholar]
- 15.Olusanya HO, van Zyll de Jong M. Assessing the vulnerability of freshwater fishes to climate change in newfoundland and labrador. PLoS one 2018; 13: e0208182. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Olden JD, Vander Zanden MJ, Johnson PT. Assessing ecosystem vulnerability to invasive rusty crayfish (Orconectes rusticus). Ecol Appl 2011; 21: 2587–2599. [DOI] [PubMed] [Google Scholar]
- 17.Matsuzaki SIS, Takamura N, Arayama K, et al. Potential impacts of non-native channel catfish on commercially important species in a Japanese lake, as inferred from long-term monitoring data. Aquat Conserv 2011; 21: 348–357. [Google Scholar]
- 18.Liu C, Comte L, Olden JD. Heads you win, tails you lose: life-history traits predict invasion and extinction risk of the world's freshwater fishes. Aquat Conserv 2017; 27: 773–779. [Google Scholar]
- 19.He F, Langhans SD, Zarfl C, et al. Combined effects of life-history traits and human impact on extinction risk of freshwater megafauna. Conserv Biol 2021; 35: 643–653. [DOI] [PubMed] [Google Scholar]
- 20.Manzo S, Nicholson EG, Devereux Z, et al. Conservation of northwestern and southwestern pond turtles: threats, population size estimates, and population viability analysis. J Fish Wildl Manag 2021; 12: 485–501. [Google Scholar]
- 21.Davis WS, Simon TP. (eds) Biological assessment and criteria: tools for water resource planning and decision making. Boca Raton, FL: CRC Press, 1995, pp.432. [Google Scholar]
- 22.Kerans BL, Karr JR. A benthic index of biotic integrity (B-IBI) for rivers of the Tennessee valley. Ecol Appl 1994; 4: 768–785. [Google Scholar]
- 23.Smith MJ, Kay WR, Edward DH, et al. AusRivAS: using macroinvertebrates to assess ecological condition of rivers in Western Australia. Freshw Biol 1999; 41: 269–282. [Google Scholar]
- 24.AQEM. Manual for the Application of the AQEM System. A Comprehensive Method to Assess European Streams Using Benthic Macroinvertebrates, Developed for the Purpose of the Water Framework Directive. 2002. (Contract No: EVK1-CT1999-00027).
- 25.Hering D, Johnson RK, Kramm S, et al. Assessment of European streams with diatoms, macrophytes, macroinvertebrates and fish: a comparative metric-based analysis of organism response to stress. Freshw Biol 2006; 51: 1757–1785. [Google Scholar]
- 26.Stoddard JL, Herlihy AT, Peck DV, et al. A process for creating multimetric indices for large-scale aquatic surveys. J North Am Benthol Soc 2008; 27: 878–891. [Google Scholar]
- 27.Buss DF, Carlisle DM, Chon TS, et al. Stream biomonitoring using macroinvertebrates around the globe: a comparison of large-scale programs. Environ Monit Assess 2015 Jan; 187: 1–21. [DOI] [PubMed] [Google Scholar]
- 28.Davies PE, Harris JH, Hillman TJet al. et al. The sustainable rivers audit: assessing river ecosystem health in the Murray–Darling Basin, Australia. Mar Freshw Res 2010 Jul 23; 61: 764–777. [Google Scholar]
- 29.Reynoldson TB, Norris RH, Resh VH, et al. The reference condition: a comparison of multimetric and multivariate approaches to assess water-quality impairment using benthic macroinvertebrates. J North Am Benthol Soc 1997; 16: 833–852. [Google Scholar]
- 30.Ossyssek S, Hofmann AM, Geist Jet al. et al. Diatom red list species reveal high conservation value and vulnerability of mountain lakes. Diversity (Basel) 2022; 14: 389. [Google Scholar]
- 31.Bush A, Theischinger G, Nipperess D, et al. Dragonflies: climate canaries for river management. Divers Distrib 2013; 19: 86–97. [Google Scholar]
- 32.Rolls RJ, Sternberg D. Can species traits predict the susceptibility of riverine fish to water resource development? An Australian case study. Environ Manag 2015; 55: 1315–1326. [DOI] [PubMed] [Google Scholar]
- 33.Chessman BC. Identifying species at risk from climate change: traits predict the drought vulnerability of freshwater fishes. Biol Conserv 2013; 160: 40–49. [Google Scholar]
- 34.Milošević D, Medeiros AS, Cvijanović D, et al. Implications of local niche-and dispersal-based factors that may influence chironomid assemblages in bioassessment. Environ Sci Pollut Res 2022; 29: 51951–51963. [DOI] [PubMed] [Google Scholar]
- 35.Nyboer EA, Liang C Chapman LJ. Assessing the vulnerability of Africa's freshwater fishes to climate change: a continent-wide trait-based analysis. Biol Conserv 2019; 236: 505–520. [Google Scholar]
- 36.Medeiros AS, Williams A, Milošević D. Assessment of ecological impairment of Arctic streams: challenges and future directions. Ecol Evol 2021; 11: 9715–9727. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Dickson TR, Walker IR. Midge (Diptera: chironomidae and ceratopogonidae) emergence responses to temperature: experiments to assess midges’ capacity as paleotemperature indicators. J Paleolimnol 2015; 53: 165–176. [Google Scholar]
- 38.Humphries P, Winemiller KO. Historical impacts on river fauna, shifting baselines, and challenges for restoration. BioScience 2009; 59: 673–684. [Google Scholar]
- 39.Smol JP. Under the radar: long-term perspectives on ecological changes in lakes. Proc R Soc B 2019; 286: 20190834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.McGrane SJ. Impacts of urbanisation on hydrological and water quality dynamics, and urban water management: a review. Hydrol Sci J 2016; 61: 2295–2311. [Google Scholar]
- 41.Smol JP. Paleolimnology: an important tool for effective ecosystem management. J Aquat Ecosyst Health 1992; 1: 49–58. [Google Scholar]
- 42.Watson VT, Medeiros AS. The value of paleolimnology in reconstructing and managing ecosystem vulnerability: a systematic map. FACETS 2021; 6: 517–536. [Google Scholar]
- 43.Reavie ED. Paleolimnology supports aquatic management by providing early warnings of stressor impacts. Lake Reservoir Manag 2020; 36: 210–217. [Google Scholar]
- 44.Gell PA, Reid MA, Wilby RL. Management pathways for the floodplain wetlands of the southern Murray–Darling Basin: lessons from history. River Res Appl 2019; 35: 1291–1301. [Google Scholar]
- 45.Duarte CM, Conley DJ, Carstensen Jet al. et al. Return to Neverland: shifting baselines affect eutrophication restoration targets. Estuaries Coasts 2009; 32: 29–36. [Google Scholar]
- 46.Alahuhta J, Erős T, Kärnä OM, et al. Understanding environmental change through the lens of trait-based, functional, and phylogenetic biodiversity in freshwater ecosystems. Environ Rev 2019; 27: 263–273. [Google Scholar]
- 47.Brown LE, Khamis K, Wilkes M, et al. Functional diversity and community assembly of river invertebrates show globally consistent responses to decreasing glacier cover. Nat Ecol Evol 2018; 2: 325–333. [DOI] [PubMed] [Google Scholar]
- 48.Van den Brink PJ, Alexander AC, Desrosiers M, et al. Traits-based approaches in bioassessment and ecological risk assessment: strengths, weaknesses, opportunities and threats. Integr Environ Assess Manag 2011; 7: 198–208. [DOI] [PubMed] [Google Scholar]
- 49.Medeiros AS, Milošević Đ, Francis DR, et al. Arctic Chironomids of the northwest North Atlantic reflect environmental and biogeographic gradients. J Biogeogr 2021; 48: 511–525. [Google Scholar]
- 50.Schmera D, Heino J, Podani J, et al. Functional diversity: a review of methodology and current knowledge in freshwater macroinvertebrate research. Hydrobiologia 2017; 787: 27–44. [Google Scholar]
- 51.Sagouis A, Jabot F Argillier C. Taxonomic versus functional diversity metrics: how do fish communities respond to anthropogenic stressors in reservoirs? Ecol Freshw Fish 2017; 26: 621–635. [Google Scholar]
- 52.Vitule JR, Agostinho AA Azevedo-Santos VM, et al. We need better understanding about functional diversity and vulnerability of tropical freshwater fishes. Biodivers Conserv 2017; 26: 757–762. [Google Scholar]
- 53.Campbell WB, Novelo-Gutierrez R. Reduction in odonate phylogenetic diversity associated with dam impoundment is revealed using taxonomic distinctness. Fund Appl Limnol 2007; 168: 83–92. [Google Scholar]
- 54.Balasubramaniam AM, Medeiros AS, Turner KW, et al. Biotic responses to multiple aquatic and terrestrial gradients in shallow subarctic lakes (Old Crow Flats, Yukon, Canada). Arctic Science 2017; 3: 277–300. [Google Scholar]
- 55.Cid N, Bonada N, Heino J, et al. A metacommunity approach to improve biological assessments in highly dynamic freshwater ecosystems. Bioscience 2020; 70: 427–438. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 56.Verdonschot PFM. Evaluation of the use of water framework directive typology descriptors, reference sites, and spatial scale in macroinvertebrate stream typology. Hydrobiologia 2006; 566: 39–58. [Google Scholar]
- 57.Jones FC. Taxonomic sufficiency: the influence of taxonomic resolution on freshwater bioassessments using benthic macroinvertebrates. Environ Rev 2008; 16: 45–69. [Google Scholar]
- 58.Hopkins GW, Freckleton RP. Declines in the numbers of amateur and professional taxonomists: implications for conservation. Anim Conserv 2002; 5: 245–249. [Google Scholar]
- 59.Hutchings PA, . Major issues facing taxonomy—a personal perspective. Megataxa 2020; 1: 46–48. [Google Scholar]
- 60.Krell FT. Parataxonomy vs. taxonomy in biodiversity studies–pitfalls and applicability of ‘morphospecies’ sorting. Biodiversity Conserv 2004; 13: 795–812. [Google Scholar]
- 61.Elbrecht V, Vamos EE, Meissner K, et al. Assessing strengths and weaknesses of DNA metabarcoding-based macroinvertebrate identification for routine stream monitoring. Methods Ecol Evol 2017; 8: 1265–1275. [Google Scholar]
- 62.Gibson JF, Shokralla S, Curry C, et al. Large-scale biomonitoring of remote and threatened ecosystems via high-throughput sequencing. PLoS one 2015; 10: e0138432. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 63.Pawlowski J, Kelly-Quinn M, Altermatt F, et al. The future of biotic indices in the ecogenomic era: integrating (e) DNA metabarcoding in biological assessment of aquatic ecosystems. Sci Total Environ 2018; 637: 1295–1310. [DOI] [PubMed] [Google Scholar]
- 64.Milošević D, Milosavljević A, Predić B, et al. Application of deep learning in aquatic bioassessment: towards automated identification of non-biting midges. Sci Total Environ 2020; 711: 135160. [DOI] [PubMed] [Google Scholar]
- 65.Wäldchen J, Mäder P. Machine learning for image based species identification. Methods Ecol Evol 2018; 9: 2216–2225. [Google Scholar]
- 66.Høye TT, Ärje J, Bjerge K, et al. Deep learning and computer vision will transform entomology. Proc Natl Acad Sci U S A 2021; 118: e2002545117. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 67.Pile J, Gouramanis C, Switzer AD, et al. Can the risk of coastal hazards be better communicated? Int J Disaster Risk Reduct 2018; 27: 439–450. [Google Scholar]
- 68.Gallina V, Torresan S, Critto A, et al. A review of multi-risk methodologies for natural hazards: consequences and challenges for a climate change impact assessment. J Environ Manag 2016; 168(1): 123–132. [DOI] [PubMed] [Google Scholar]
- 69.Woodruff JM. Consequence and likelihood in risk estimation: a matter of balance in UK health and safety risk assessment practice. Saf Sci 2015; 43: 345–353. [Google Scholar]
- 70.Agrawal N. Disaster risk evaluation – qualitative methods. In: Natural disasters and risk management in Canada. Advances in Natural and Technological Hazards Research, vol 49. Dordrecht: Springer, 2018. [Google Scholar]
- 71.Gleeson J, Gray P, Douglas A, et al. A practitioner's guide to climate change adaptation in Ontario's ecosystems. Sudbury, Canada: Ontario Centre for Climate Impacts and Adaptation Resources, 2011, 74pp. [Google Scholar]
- 72.Venkateswaran K, MacClune K, Tincani Let al. et al. Using climate information for Climate-Resilient Water Management: Moving from science to action. In: ACT Learning Paper. 2018. [Google Scholar]


