Keywords: big data, citizen science, involvement, quantitative data, socio-ecological system
Abstract
Quantitative plant biology is a growing field, thanks to the substantial progress of models and artificial intelligence dealing with big data. However, collecting large enough datasets is not always straightforward. The citizen science approach can multiply the workforce, hence helping the researchers with data collection and analysis, while also facilitating the spread of scientific knowledge and methods to volunteers. The reciprocal benefits go far beyond the project community: By empowering volunteers and increasing the robustness of scientific results, the scientific method spreads to the socio-ecological scale. This review aims to demonstrate that citizen science has a huge potential (i) for science with the development of different tools to collect and analyse much larger datasets, (ii) for volunteers by increasing their involvement in the project governance and (iii) for the socio-ecological system by increasing the share of the knowledge, thanks to a cascade effect and the help of ‘facilitators’.
1. Introduction
Crowther et al. (2015) estimated that there are 3.04 trillion, or 3.04 × 1018 (± 0.096 × 1018), trees worldwide. Although this is an impressive number, it raises a question: How did the scientific team count all the trees on the planet? To better reflect reality, researchers need to collect and treat a huge amount of data sampled in contrasting ecosystems and environmental conditions, which is the role of quantitative plant science (Autran et al., 2021). However, a research team alone is limited in the amount of work necessary to reach a robust and valid result. International collaborations are part of the answer to overcome the lack of data, but this is insufficient and often not representative of the whole data and ecological diversity.
Citizen science (CS) is one way to cover large temporal and spatial scales for sampling. CS is a broad concept, and the definition is still debated (Heigl et al., 2019). We will merely refer to the general definition of Guerrini et al. (2018): CS gathers ‘scientific endeavours in which individuals without specific scientific training participate as volunteers in one or more activities relevant to the research process other than (or in addition to) allowing personal data or specimens to be collected from them’. Even if CS projects that are solely based on data collection may partially solve some quantitative plant science challenges (data collection on large areas, at high temporal resolution, higher number of collectors who may quantify variables more often than a scientific team alone), they also require important scientific input to improve their own modelling issues, such as accounting for bias in data collection and heterogeneity in plant species, sites and/or dates of measurements, and ensuring that the protocol was accurately followed. CS projects in plant sciences have bloomed for a decade, gathering huge volunteer communities around scientific questions (Fig. 1, grey points). The number of publications related to CS projects has increased even faster than the total number of publications in plant sciences (Fig. 1, green bars). In turn, this approach allows researchers to share their experience, method and the purpose of the experiment and to directly communicate them to participants. In that sense, CS projects can be seen as collaborative work with a purely scientific interest to answer a question and as an efficient outreach action where ‘non-researchers’ are truly active and have the opportunity to practice the sciences (Heigl et al., 2019).
Fig. 1.
Global trend of citizen science projects in the plant science literature from 2000 to 2020: The left grey y-axis (grey dots) represents the number of articles containing the mention ‘plant science’ AND ‘citizen science’ in their title, and the right green y-axis (green bars) represents the ratio of paper numbers with ‘plant science’ AND ‘citizen science’ and the paper numbers containing ‘plant science’ only. The number of papers was extracted from Google Scholar on 01/02/2022.
The benefits of these close and direct interactions between scientists and volunteers are not limited to the scientific sphere and/or the volunteers. Mixing scientists and volunteers, CS can be seen as a motor of complex socio-ecological systems, strengthening the interaction network between society and the environment. CS represents an efficient approach linking knowledge creation and transfer/co-construction with society (Rupprecht et al., 2020). The benefits of CS projects spread much further than the scientists–volunteers’ interactions, and they also reach the socio-ecological system if the project is built as a participatory action research project (Cooper et al., 2007). Quantitative plant ecology can play a major role in encouraging these collaborative sciences. We chose to broaden the scope of this review from plant science to plant ecology and its quantitative aspect.
The goal of this review is to highlight (i) the diversity of tools and networks enabling scientists to run CS projects, (ii) the reciprocal benefits of CS projects between citizens, the scientific community and beyond with the socio-ecosystem and (iii) some remaining obstacles, such as the need to include a ‘facilitator’ in volunteer–scientist relationships; finally, this review (iv) proposes some perspectives for upcoming CS projects.
2. Some CS tools encouraging participation in CS projects
2.1. Plant CS project, a mean to manipulate plant
Plant science is mainly based on trait measurement to explain plants’ trait response to a tested variable (Autran et al., 2021). The number of replicates is crucial to make the study quantitative and the lab facilities are often limiting as plant culture or field experiment needs space and time. Increasing the number of experimenters may help to solve this issue. Participating to this measurement campaign may be source of motivation for volunteers to engage in CS project and to bring their contribution to the study. Projects including trait measurements allow a direct contact with plant science tools and plant material, which represent a data collection activity very close to the scientific work in a lab. McDonough MacKenzie et al. (2020) described the great interest to engage volunteers in projects including traits’ measurement such as flower phenology; volunteers only need a pencil and a sheet to note their observation regularly. These data may be complementary to dataset at global scale gathering observations at larger scale and with experiments such as twig cutting to assess season effect on leafing-out time (McDonough MacKenzie et al., 2020; Primack et al., 2015). Moreover, herbaria data and metadata (from label) may also help to increase the phenology legacy of a species (Funk, 2003; Nualart et al., 2017). Extracting and implementing a database are very time consuming; therefore, herbarium may solicit the volunteer’s help to treat each specimen, which what Recolnat or Nature’s Notebook programs propose in France and in the USA, respectively, for instance.
Plant’s traits variation to environmental changes can be studied in a common garden where different species, genotype, cultivars are grown with the same condition. The number of common gardens limits the number of tested environments. The project ‘1000 gardens – the soybean experiment’ benefited from 1000 gardens of volunteers to grow 1710 soybean lines (Würschum et al., 2019). Participants received 10 lines or varieties and 16 traits were measured by participant until the harvest such as germination rate, plant height and start of flowering. This project led the scientist to know the most adapted lines for the different Germany regions for future soybean production (Würschum et al., 2019). Similarly, a CS project focused on carrot, solicited farmers to assess intraspecific foliar trait variation in Canada. Each farmer was in charge of five varieties of carrot and to collect and send dry leaf samples to the scientific teams for trait’s measurement. Even if farmers did not participate to trait measurements, they allow to test different environment to estimate the intraspecific variability of leaf trait (Isaac & Martin, 2019). This collaborative CS project leads to closer relationship between research and farms without excessive cost or particular technology.
However, the development of connected tool facilitates data sharing and data availability, which can help to democratize CS participation.
2.2. Make the CS project more global
The tool diversity in CS projects has increased with the number of projects developed. Smartphones are certainly the best example of making collaborative and quantitative sciences an almost ‘common’ activity (Adriaens et al., 2015; Newman et al., 2012; Teacher et al., 2013). The smartphone is useful and promising, especially for quantitative plant science, as it allows high-resolution phenotyping activity to supply deep learning techniques and monitor plants’ responses to stress and diseases (Mohanty et al., 2016; Singh et al., 2018). For instance, Adriaens et al. (2015) reported two applications RINSE and KORINA to record and monitor invasive plant species: volunteers can record the localisation of invasive species with their apps. Their data are then used by scientists and managers to monitor wetlands. However, volunteer participation in a CS program strongly depends on the ease of using the tools, since volunteers can become discouraged if the tools are too difficult to use. Once the tools are available, the research community can rely on a large pool of potential volunteers among social networks (Serret et al., 2019). The connected tools play an important role in creating a dynamic and virtuous loop among volunteers and an easy way to interact with scientists (Nov et al., 2014), especially if face-to-face interactions with the research team are organised concomitantly (Cappa et al., 2016). We acknowledge that it may be particularly difficult for the scientific team to interact directly with each volunteer, especially in projects involving hundreds or thousands of participants. This challenge clearly shows the need for intermediaries to avoid losing volunteer motivation and the quantitative benefit of volunteer work (Cappa et al., 2016). Some data, such as geolocation, can be updated and visualised by all the project participants directly after the data are collected and incremented. This may represent a tangible, encouraging reward for volunteers and may motivate them to continue working on the project. Moreover, from a research point of view, collected plant-related data may be used with other datasets, such as meteorological and climate data, increasing the power of the collected data. A recent study showed that from crowd-sourced flower identification data, it was possible to rebuild spatial macroecological gradients (Mahecha et al., 2021). This means that we can potentially extract more information than the app was initially designed to deliver.
The almost global internet access allows an instantaneous sharing of data and facilitates their verification by scientists or volunteers (Deguines et al., 2018); hence, it makes data quantity compatible with data quality. However, while the size of the available datasets is growing very fast (e.g., satellite images, video recording, pictures, for instance https://www.zooniverse.org/projects/zooniverse/floating-forests: 750,000 pictures of kelp forests were classified by over 7000 volunteers), the number of scientists available to analyse these data is not growing as fast. Depending on their expertise level, some volunteers may help the leading team check data gathered by other volunteers, a peer-to-peer cross-validation process (Deguines et al., 2018; Kosmala et al., 2016). Therefore, with the emergence of ‘big data’ and the development of machine learning methods and artificial intelligence, volunteer participation has become increasingly necessary to amplify and to refine the exponential progress in treatment and analysis methods (Ceccaroni et al., 2019). A successful example is the development of the ‘Leafsnap’ or ‘Pl@ntNet’ mobile app that identifies tree species from pictures of their leaves, fruits, flowers or barks (Joly et al., 2016; Kumar et al., 2012).
2.2.1. Topic
It is worth noting that big data from CS project raise some ethical questions such as the intellectual property of the data and the level of acknowledgement for the volunteers (Vohland et al., 2019): some authors propose to include volunteers in the authorship at least under a collective identity (Vayena & Tasioulas, 2015; Ward-Fear et al., 2020). These challenges would deserve a review per se, which is not the scope of this one.
2.3. Make a CS community
Online project platforms facilitate discussion between experts and volunteers to share results and questions about the project (Gouveia et al., 2004). Scientists can present preliminary or intermediate results based on the first collected data to inform participants about project progress. Concomitantly, it allows interactions through forums, chats or even video meetings, where volunteers are free to ask questions. These discussions bring scientists closer to the public, and vice versa, and make the relationships less hierarchical. This point is very important regardless of the scientific background of the participants: novices can feel more confident and progress rapidly, which is highly fulfilling (Deguines et al., 2018), whereas the more knowledgeable volunteers may be part of the discussion in the data analysis. Engaging volunteers in data analysis is, however, time-consuming if the scientific team aims to achieve volunteer empowerment. The task may be ensured by a ‘facilitator’, that is, someone dedicated to training or educating volunteers on a CS project (Lorke et al., 2019), but we propose to enlarge this role to align classes/teachers expectations and scientific objectives of the research team. The facilitator should not be substituted for the interactions between volunteers and scientists but instead be a hyphen between both, facilitating their interactions.
2.4. CS in the classrooms
An increasing number of CS projects involve schools (Kermish-Allen et al., 2019; Nistor et al., 2019; Van Haeften et al., 2021), even if they are often not specifically designed for students (Bopardikar et al., 2021; Williams et al., 2021). The scientific team can take advantage of the time dedicated by the class to the project to train students and improve data quality (Castagneyrol et al., 2020). This does not avoid the requirement for another check after data collection, but it also creates a time for discussion with pupils and teachers about scientific methods and epistemology. This aspect of CS is at least as important as the larger time and spatial scale of data collection because it allows students, and people in general, to be more aware of the world’s complexity (Morin, 2007). From a quantitative plant sciences perspective, it is important to clearly explain the benefits of acquiring a large amount of data for building a robust answer to the initial questions, stressing the importance of the variability at different levels of organisation.
Although developing CS with schools appears to be relevant, scientists need to factor in educational constraints that are often incompatible with the protocols. Indeed, teachers do not have an infinite amount of time to allocate to the project, which can have consequences on data validity or decrease the project’s relevance for students and teachers, despite the educational benefits of CS initiatives (Esch et al., 2020). Tools and protocols may have been thought to be easily used by non-scientific experts, and the classroom constraints may limit the involvement in a CS project. Moreover, cost, logistical tensions or effort to motivate students with ‘fun’ activities for instance are some knock-down barriers that still remain in addition to schedule constrains (Roche et al., 2020). Therefore, a ‘facilitator’ may allow, at the genesis of the project, to build a project that meets the requirements of all participants.
3. CS projects: Reciprocal benefits for citizens and academia
3.1. Main benefits for the scientific community
From the scientist point of view, CS projects represent an unprecedented opportunity to rely on an important number of volunteers collecting data (Fig. 2, orange arrow). The ‘many-eyes hypothesis’ has been developed to describe the efficiency of CS in generating, scrutinising and analysing data across vast spatiotemporal scales and multiple taxa (Dickinson et al., 2012; Earp & Liconti, 2020; Thomas et al., 2017). In the case of CS, the hypothesis demonstrates that a larger group of people increases the chance of detecting a species/phenomenon and can survey a vaster region. For instance, ‘The conker tree science’ project studied the effect of pest controllers on leaf-mining moths damaging leaf conker trees (http://www.conkertreescience.org.uk/). Researchers asked volunteers to collect infected leaves and count insects that had hatched out. The protocol was very simple, and 3500 citizens, covering all Great Britain, sent their results to the researchers (Pocock & Evans, 2014). The ‘Oak Bodyguard Citizen Science Project’ has also successfully estimated caterpillar herbivory on Quercus robur in Europe, thanks to an easy protocol, freely available, proposed to different European classes (Castagneyrol, 2019). These two examples highlight the larger area covered by participants: ‘The conker tree science’ project provides results at a national scale when the ‘Oak Bodyguard Citizen Science Project’, on a European scale, has increased the number of sampling points in different countries. It now includes new countries such as Latvia and Lithuania where no scientist works on the project (Castagneyrol et al., 2020). The large-scale response of Conker and Oak trees was obtained, thanks to local volunteers, which would have been unreachable with professional scientists only.
Fig. 2.
Conceptual framework of the reciprocal benefits from the CS project to the socio-ecological system. Circles represent participants of a CS project, and black arrows show how the scientific and epistemological benefit spreads beyond the project per se. The two dotted arrows represent the indirect added value of the facilitator to spread the CS results to the socio-ecological system.
The development of CS is also an efficient way to widely communicate the results from a research topic. Indeed, CS projects imply generally some side activities, which are not directly linked to the scientific experiment itself. These activities take place in the context of the scientific project, and it is then easier to develop outreach activities with the volunteers as they benefit of the same background. However, to be the most effective, it would judicious to plan it when project leaders build the project (Lakeman-Fraser et al., 2016).
An increasing number of funders (e.g., the European Union) ask to make the results of projects they supported publicly available. We strongly support the spread of scientific result, whatever the means (Poulet et al., 2021), but we recognise the holistic benefit from participating to a scientific project while learning about the scientific topic and research functioning. The implementation of CS in the research project makes this dissemination step easier, combining scientific knowledge production and outreach activities.
3.2. Important benefits for volunteers
The direct benefits for volunteers participating in CS projects consist first of increasing their own knowledge and/or scientific and technical skills. Practising science makes the learning process more efficient because volunteers face the same constraints as scientists, which makes more sense to the volunteers (Fig. 2, blue arrow, Bonney et al., 2016; Freitag, 2016; Kermish-Allen et al., 2019; Shirk et al., 2012). This praxeological approach may be seen as a much more stimulating method than passively listening to a lecture or conference (Barragan-Jason et al., 2021; Smith et al., 2021). The relationship between professional researchers and the public is often limited to conferences and questions to the researcher who ‘knows’ and the audience who ‘learns’. This method of knowledge transmission is important but should be completed by peer exchanges, that is, between non-professionals, when a volunteer belonging to the project community becomes the link between the project and the audience. The discussion among non-professionals allows the removal of the potential distance that the public can feel between themselves and the researcher (Burke et al., 2016; Watermeyer & Montgomery, 2018).
We think that transdisciplinary research programs may be more attractive, as they mix different fields. For example, the Growing Beyond Earth (based in the USA) project enables students to work on a transdisciplinary project where quantitative plant science meets microgravity and space exploration via a CS project led by the Fairchild Botanic Garden (Miami, FL) in partnership with NASA (https://fairchildgarden.org/gbe/). The objective is to identify resistant crops for spaceflight, and as a result, astronauts have grown Pak Choi on the ISS after it was identified as suitable by the large amount of data collected by students. The European Space Agency is pursuing the same objective as the Astroplant project, encouraging citizens and classrooms to gather data on plant growth using a DIY desktop greenhouse (https://www.esa.int/Science_Exploration/Human_and_Robotic_Exploration/AstroPlant_citizen_science_for_growing_plants_in_space).
The Space Chile Grow a Pepper Plant Challenge (https://five.epicollect.net/project/the-spacechilechallenge-cose) is another NASA CS project launched in preparation for an ISS experiment that engages citizens in collecting data on indoor chilli pepper cultivation to tackle some of its inherent challenges. The high valuation of space research in the media makes the task very exciting for volunteers, and it becomes easier for researchers to ‘reward’ participants with visible communication.
3.3. CS: A ways to link citizens with research projects
This deeper understanding of science would strongly support ecological preservation and restoration (Fig. 2). Ecological restoration and preservation programs have succeeded, thanks to the implication of volunteers in different steps of the project and in the decision-making process (Buldrini et al., 2015; Conrad & Hilchey, 2011; Kobori et al., 2016). Indeed, volunteers involved in CS projects can be seen as vectors of knowledge dissemination by speaking about the project and the results to people around them (Burke et al., 2016). In this way, volunteers become ‘advocates of environment conservation’, such as in the ‘Ansa e Valli del Mincio’ protected wetlands where volunteers have monitored invasive species (Buldrini et al., 2015). Similarly, a successful program was designed in Texas to monitor Arundo donax. The CS program reported an increase in the giant reed area distribution and can be a scientific resource for ecosystem management (Gallo & Waitt, 2011). In 5 years (2005–2010), volunteers reported 9004 observations, which represent 3416.75 h of work. The large-scale monitoring, during a long period, may be hard to set up and the assistance of volunteers helps make plant monitoring more sustainable in space and time. Another fulfilling aspect of CS projects consists of the more important involvement of volunteers in environmental protection agencies (Owen & Parker, 2018). Even if there are still some challenges with some CS projects regarding the inclusion of results in environmental policies despite the merits of the CS approach (see Section 3 and MacPhail & Colla, 2020), an increasing number of governments recognise the significant role of citizens in nature preservation and rely on CS projects to act and make decisions. Similarly, a recent global scale review has highlighted that involvement of Indigenous peoples and local communities in the management and decision making represents the primary pathway to effective long-term conservation of biodiversity (Dawson et al., 2021). Nascimento et al. (2018) recall that the Scottish government helped some CS projects with training and tools to improve their data collection. This action shows the confidence and value of citizen engagement in nature conservation. Governmental acceptance of CS projects in the formation of policy allows reciprocal benefits not only between volunteers and scientists, but it allows the benefits to spread across society, thanks to the higher citizen involvement in public policies, which is reflected by the increased financial support to CS (Schade et al., 2021).
CS projects would help to reconnect our society to nature (Barragan-Jason et al., 2021; Gaston & Soga, 2020) and increase public awareness of the current status of the environment and the threat that humans represent to ecosystem stability (Cerrano et al., 2017; Schläppy et al., 2017). In line with these authors, we want to show that the objectives of CS go far beyond helping research teams or educating the public about the sciences (Bonney et al., 2014; Vignola et al., 2009): In a global change context and a highly complex world, the involvement of citizens and researchers in a more socio-ecological democracy is critical to facing the dangerous global crisis in which we are currently living (Gardner & Wordley, 2019; Hagedorn et al., 2019; Steffen et al., 2015).
4. Remaining challenges to improve CS
4.1. Data quality
The suspicion about data quality often rises first in CS projects (Kosmala et al., 2016). Data quality is the outcome of several components (Pipino et al., 2002), but data accuracy emphasises most of the criticism, that is, the precision of the data relative to its real value. In other words, is the data reported by a volunteer correct or not? The concern may be legitimate because of the diversity of background, training and involvement of volunteers. However, this concern may also be true for professionals (Castagneyrol et al., 2020; McKinley et al., 2015; McKinley et al., 2017) and should not be an initial bias in the mind of editors and reviewers. Indeed, Kosmala et al. (2016) started their review about CS data quality by citing several projects that led to many publications (Fig. 1), which should make quantitative plant scientists and others more confident about their involvement in CS projects.
As it is not yet a common practice, researchers will need to design CS-dedicated experimental protocols (Burgess et al., 2017; Pocock & Evans, 2014), and sometimes researchers are challenged by short-term funding (Crall et al., 2010; Vasiliades et al., 2021). Therefore, the help of citizen organisations may first link researchers and volunteers by training and supporting volunteers during the process. However, we think that it is of great importance that researchers become involved in the process of sharing science (i.e., training, interacting with volunteers), which is part of their duties. It is not the role of NGOs or associations to remedy the malfunctioning of states or scientific financial institutions, especially in context of social, health, economic and environmental crises (Vohland et al., 2019). What is today a potential ‘waste of time’ in the mind of some researchers should become part of their daily work and will provide a high return on investment during data analysis. Similarly, the data check should be a necessary task, as is the case when professional scientists collect data (Castagneyrol et al., 2020; Cox et al., 2012). As researchers, we have to consider the great advantage of CS for quantifying variables of interest at a larger scale and then accept that we will have to spend more time cleaning the data and supporting volunteers.
4.2. Volunteer motivation
Cherry trees in Japan have been monitored for more than a thousand years (Kobori et al., 2016). This example highlights the critical aspect of volunteer motivation for the success of these research programs. The resilience of CS projects (i.e., their ability to keep running or restart despite obstacles) is an asset for medium-long-term data requirements (Couvet et al., 2008).
To increase volunteer motivation, we believe that the feeling of being a useful piece of the research program may strengthen the involvement of volunteers in the project and open it to new people, as volunteers devote their free, unpaid time (Conrad & Hilchey, 2011; Lakshminarayanan, 2007). Volunteer engagement increases if at least the subset of the data they collected may participate in answering local challenges (Freitag, 2016). Schools may represent a more reliable way to ensure student involvement, at least for 1 year. The CS project would benefit from dedicated time by the class to the project tasks but also to an educational time on science epistemology with the teacher and the researcher involved in the project (Castagneyrol et al., 2020; Poulet et al., 2021). We acknowledge that the project might be a mandatory part of the curriculum rather than a voluntary one, but we hope that students’ contributions to CS projects may open them to new topics and inspire them for future participation.
To involve more volunteers generally in the sciences through CS projects, it is also important to deconsecrate researchers in the eyes of the public. Without the volunteers’ contribution, the scientific project would not exist. Therefore, the project not only belongs to the research team but also to the volunteers who sometimes contribute to the easiest but essential and/or tedious tasks. The globalisation of research collaboration can be enhanced by CS and by considering volunteers worldwide. Currently, there is a high CS project concentration in the Northern Hemisphere, especially in Europe and North America (Earp & Liconti, 2020; Thiel et al., 2014). However, to multiply the positive feedback of CS projects, it would be necessary to extend the spatial localisation of these projects.
4.3. Connecting scientists and volunteers
Finally, to make science an efficient citizen tool, researchers must involve volunteers deeper into the project’s governance (Conrad & Hilchey, 2011; Heigl et al., 2019). The basic level of CS consists of collecting data, which per se has a significant impact in increasing the size of a dataset – which is particularly interesting in quantitative science. However, a transition from projects whereby participants mainly collect data to more collaborative and co-created approaches has started and needs to continue (Bonney et al., 2009; Teleki, 2012), with major socio-ecological benefits such as promoting environmental awareness and literacy and empowering citizens and communities. We acknowledge that it is not an easy task to build such a project (Eleta et al., 2019). Coordinating the group requires a lot of time and energy, a task that could be carried by facilitator. However, there are already some encouraging examples. ‘The gardenroots’ project worked on the role of soil contamination in edible plants and human health and it is driven by a non-expert group in collaboration with a researcher. The whole group participates in the experimental design, data collection, analysis, and decision-making process (Ramirez-Andreotta et al., 2015). Reis and Glithero (2015) showed that even at school, students participating in a CS project can go further than the scientific question, even raising some ecojustice considerations for the benefit of all. However, examples are rare and this holistic goal of CS deserves more research and discussion among stakeholders. The task is huge to democratise this approach but we hope that the scientists working with CS will mobilise in that sense in the future.
Different classifications exist in the literature (Table 1) to highlight a gradient of volunteers’ involvement in the project’s tasks. It is out of the scope of this review to clarify the possible overlap among the terms, but all recognised that the more that volunteers participate in the scientific process (from conception to solution application when the goal was to solve a local issue), the greater they are empowered. It has positive consequences on the citizenry because they become aware of how the data are collected and how data are used, they understand where the money comes from and how it is spent, and finally, they can participate in the decision-making process more easily. This can lead to substantial policy changes, thanks to an awareness of involvement in scientific and societal issues (Hagedorn et al., 2019). Therefore, a specific effort from research teams is needed to allow democratic shared governance (Watermeyer & Montgomery, 2018) regardless of the degree of involvement of volunteers.
Table 1.
Summary of citizen science governance types
To conclude, the strength and weakness of CS projects are the participant diversity in terms of scientific level, expectations and motivation. To avoid disappointment, we agree with Lorke et al. (2019), who encourage the participation of a facilitator early in the co-construction of the project.
4.4. We need more than guidelines for citizen science
Working on these different points can result in good practice guidelines and toolkits for the future of CS (Silvertown, 2009). Bonney et al. (2009) and Tweddle et al. (2012) offered a roadbook to efficiently start a biodiversity CS projects with some plant science precisions. The main points can be summarised as: (1) choose a scientific question; (2) form a scientist/educator/technologist/evaluator team; (3) develop, test and refine protocols, data forms and educational support materials; (4) recruit participants; (5) train participants; (6) accept, edit and display data; (7) analyse and interpret data; (8) disseminate results and (9) measure outcomes (Castagneyrol, 2019; Hill et al., 2012; Teacher et al., 2013). We advise readers to refer to the chapter written by García et al. (2021) for a more detailed review of the existing guidelines in the book directed by Vohland et al. (2021). Online platform sharing protocol is also a way to give or to check experimental instructions before engaging in a project as Castagneyrol (2019) did for the ‘Oak bodyguard Citizen Science project’ on https://www.protocols.io. However, as this review aims to demonstrate, a CS project is not as simple as a ‘recipe’ because each group of volunteers has its own features.
The potential of CS projects for spreading science and the scientific method to the socio-ecosystem may be enhanced if the objectives and limits of each group of participants are taken into account (Freitag & Pfeffer, 2013). A third party may ensure the match between each stakeholder: For global projects, finding a local interest for volunteers is important to reinforce their engagement and empower them scientifically and democratically (Esch et al., 2020; Golumbic et al., 2017; Lorke et al., 2019). In a classroom, teachers are limited in adapting the curriculum; therefore, the facilitator may help scientific project leaders adapt the protocol to academic constraints. More generally, the interest and skills of volunteers may evolve during the project, leading to changes in their motivations (Rotman et al., 2012). Anticipating the dynamics of volunteer involvement in the project design can enhance the expectations of all participants by stimulating volunteers. As suggested by Zoellick et al. (2012), the university may play this role of facilitator with students or a specialist of scientific mediation could also assume the role. Local organisations interested in a project may also make the link between scientific teams and the volunteers such as naturalist or environmentalist associations, or at a bigger scale, naturalist learned societies or NGOs.
5. Perspectives and conclusion
CS is currently at a crossroads of demonstrated successes, unresolved challenges and unrealised potential. In particular, the potential mutual benefits for researchers, volunteers and society are still undervalued. These mutual benefits occur at different scales: to solve the research question driving the project, the educational aspect towards the volunteers and the dissemination of knowledge through society. Depending on the involvement of the volunteers in the project, the outreach exchanges can be more or less integrative. Finally, the ongoing crises (health, economic, social and environmental) have highlighted the crucial role of science in explaining the world’s complexity and overcoming obstacles.
On the other hand, citizens are increasingly solicited in the decision-making process in society, and thus they need to have the strongest background possible to make decisions and change their behaviours (Eymard, 2020; Vignola et al., 2009). Ecology and especially plant ecology have used CS for a long time and are precursors in CS. Applications to identify plants are widely available to the public, and an increasing number of people have participated in global databases, such as those about plant phenology, sometimes for hundreds of years (Amano et al., 2010; Amano et al., 2014; Bopardikar et al., 2021). The long experience of CS projects has allowed to know the strengths and weaknesses of this approach and to propose tools to limit biases (Bird et al., 2014; Bonney et al., 2009; Kosmala et al., 2016). Still related to plants, the space field has also largely included CS projects, with exciting perspectives for space exploration (see the examples mentioned in Section 2.2). Thanks to this experience, it appears that CS requires changing the typical project construction approach by including, ideally, a facilitator, changing the typical way to make a protocol. This may be the strongest upheaval that some researchers have to face, especially in quantitative plant science but also in other disciplines. We hope this review provides exciting examples and a large body of literature to help quantitative plant biologists become more confident in this approach. The benefit may be significant from a scientific production point of view, but it can also have a crucial social role for public opinion of science and CS. Therefore, we encourage researchers and citizens to promote and launch a CS program for the essential benefit at the socio-ecological scale, spreading the benefits of CS to a more global scale (Fig. 2, Devictor et al., 2010; Hano et al., 2020; Lawson et al., 2019).
In our opinion, this may be the main point of CS: Science and knowledge result from a long and rigorous demonstrative process, which gives it a different status from beliefs, ideology or opinion, and this is what researchers should emphasise during their collaboration with volunteers (Poulet et al., 2021). The active participation of people in scientific research facilitates the transmission of this approach to world complexity and the associated processes. It helps people disentangle scientific arguments from other information and opinions during debates and fight against obscurantism (Eleta et al., 2019). Finally, it can help people build stronger critical thinking skills about our socio-ecological issues and influence the decision-making process (Fig. 2, Carolan, 2006; Heathcote et al., 2019; Shanley & López, 2009).
However, one point still deserves more attention: How can we honestly ‘reward’ volunteers for their contributions? The publication of articles is very rewarding for researchers. It contributes to the progress of their careers and helps to find new funding for projects. However, it is impossible to include all volunteers in the authorship (but see Ward-Fear et al., 2020), and they would not strongly benefit from this acknowledgement. The project we have launched, the outreach research journal DECODER, proposes publishing an outreach version of an article published in international scientific journals in collaboration with one of the authors and articles written by classes and reviewed by an expert (Poulet et al., 2020; Poulet et al., 2021). We acknowledge that this is not strictly a CS project, as it does not produce new scientific knowledge. However, it may be a way to value the work of a class or volunteers by producing and publishing a public-targeted version of their work. A similar initiative was created by Frontiers journal, https://kids.frontiersin.org/. Volunteers can use the whole dataset or only a subsample corresponding to the data they collected, and they can reformulate the question in the context of their environment (Ledley et al., 2011). Publishing results and manuscripts from volunteers and classes in open access give more value to their contribution (Burke et al., 2016). It can be a way to ‘reward’ them for their work. Then, a comparison with the published version of the research may constitute an interesting tool to address the role of big data in the impact of environmental conditions on the variables, for instance. Another approach would be to have the researcher or institution leading the project gives a certificate to volunteers. It would be interesting to build a standard nomenclature to recognise the work of the volunteers and allow them to use the training they received during the project for a new one, thanks to this standardised system of skills acquisition.
Acknowledgements
We want to thank all the teachers, students and researchers who have trusted us on the DECODER project. They have inspired us to engage in outreach science and to write this review. We also thank Geoffrey Volat for the interesting discussion about the praxeological approach and Pr Olivier Hamant for inviting us to write this review.
Financial support
This research received no specific grant from any funding agency or from commercial or not-for-profit sectors.
Conflict of interest
None.
Authorship contributions
A.R. and A.V. wrote the first draft of the manuscript. A.R. drew Fig. 2, and B.D. and A.R. drew Fig. 1. All authors contributed equally to improving the first version.
Data availability statement
This review does not rely on any data, code or other resources.
References
- Adriaens, T. , Sutton-Croft, M. , Owen, K. , Brosens, D. , van Valkenburg, J. , Kilbey, D. , Groom, Q. , Ehmig, C. , Thürkow, F. , & Van Hende, P. (2015). Trying to engage the crowd in recording invasive alien species in Europe: Experiences from two smartphone applications in northwest Europe. Management of Biological Invasions, 6(2), 215. [Google Scholar]
- Amano, T. , Freckleton, R. P. , Queenborough, S. A. , Doxford, S. W. , Smithers, R. J. , Sparks, T. H. , & Sutherland, W. J. (2014). Links between plant species’ spatial and temporal responses to a warming climate. Proceedings of the Royal Society B: Biological Sciences, 281(1779), 20133017. 10.1098/rspb.2013.3017 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Amano, T. , Smithers, R. J. , Sparks, T. H. , & Sutherland, W. J. (2010). A 250-year index of first flowering dates and its response to temperature changes. Proceedings of the Royal Society B: Biological Sciences, 277(1693), 2451–2457. 10.1098/rspb.2010.0291 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Autran, D. , Bassel, G. W. , Chae, E. , Ezer, D. , Ferjani, A. , Fleck, C. , Hamant, O. , Hartmann, F. P. , Jiao, Y. , Johnston, I. G. , Kwiatkowska, D. , Lim, B. L. , Mahönen, A. P. , Morris, R. J. , Mulder, B. M. , Nakayama, N. , Sozzani, R. , Strader, L. C. , Tusscher, K. ten , … Wolf, S. (2021). What is quantitative plant biology? Quantitative Plant Biology, 2, e10. 10.1017/qpb.2021.8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Barragan-Jason, G. , de Mazancourt, C. , Parmesan, C. , Singer, M. C. , & Loreau, M. (2021). Human–nature connectedness as a pathway to sustainability: A global meta-analysis. Conservation Letters, 15, e12852. 10.1111/conl.12852 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Bird, T. J. , Bates, A. E. , Lefcheck, J. S. , Hill, N. A. , Thomson, R. J. , Edgar, G. J. , Stuart-Smith, R. D. , Wotherspoon, S. , Krkosek, M. , Stuart-Smith, J. F. , Pecl, G. T. , Barrett, N. , & Frusher, S. (2014). Statistical solutions for error and bias in global citizen science datasets. Biological Conservation, 173, 144–154. 10.1016/j.biocon.2013.07.037 [DOI] [Google Scholar]
- Bonney, R. , Cooper, C. B. , Dickinson, J. , Kelling, S. , Phillips, T. , Rosenberg, K. V. , & Shirk, J. (2009). Citizen science: A developing tool for expanding science knowledge and scientific literacy. BioScience, 59(11), 977–984. [Google Scholar]
- Bonney, R. , Phillips, T. B. , Ballard, H. L. , & Enck, J. W. (2016). Can citizen science enhance public understanding of science? Public Understanding of Science, 25(1), 2–16. [DOI] [PubMed] [Google Scholar]
- Bonney, R. , Shirk, J. L. , Phillips, T. B. , Wiggins, A. , Ballard, H. L. , Miller-Rushing, A. J. , & Parrish, J. K. (2014). Next steps for citizen science. Science, 343(6178), 1436–1437. 10.1126/science.1251554 [DOI] [PubMed] [Google Scholar]
- Bopardikar, A. , Bernstein, D. , & McKenney, S. (2021). Designer considerations and processes in developing school-based citizen-science curricula for environmental education. Journal of Biological Education, 1–26. 10.1080/00219266.2021.1933134 [DOI] [Google Scholar]
- Buldrini, F. , Simoncelli, A. , Accordi, S. , Pezzi, G. , & Dallai, D. (2015). Ten years of citizen science data collection of wetland plants in an urban protected area. Acta Botanica Gallica, 162(4), 365–373. 10.1080/12538078.2015.1080187 [DOI] [Google Scholar]
- Burgess, H. K. , DeBey, L. B. , Froehlich, H. E. , Schmidt, N. , Theobald, E. J. , Ettinger, A. K. , HilleRisLambers, J. , Tewksbury, J. , & Parrish, J. K. (2017). The science of citizen science: Exploring barriers to use as a primary research tool. Biological Conservation, 208, 113–120. 10.1016/j.biocon.2016.05.014 [DOI] [Google Scholar]
- Burke, B. J. , Welch-Devine, M. , Gustafson, S. , Heynen, N. , Rice, J. L. , Gragson, T. L. , Evans, S. R. , & Nelson, D. R. (2016). Can science writing collectives overcome barriers to more democratic communication and collaboration? Lessons from environmental communication praxis in Southern Appalachia. Environmental Communication, 10(2), 169–186. 10.1080/17524032.2014.999695 [DOI] [Google Scholar]
- Cappa, F. , Laut, J. , Nov, O. , Giustiniano, L. , & Porfiri, M. (2016). Activating social strategies: Face-to-face interaction in technology-mediated citizen science. Journal of Environmental Management, 182, 374–384. 10.1016/j.jenvman.2016.07.092 [DOI] [PubMed] [Google Scholar]
- Carolan, M. S. (2006). Science, expertise, and the democratization of the decision-making process. Society & Natural Resources, 19(7), 661–668. 10.1080/08941920600742443 [DOI] [Google Scholar]
- Castagneyrol, B. (2019). Predation assessment on fake caterpillars and leaf sampling: Protocol for partner schools. 10.17504/protocols.io.42pgydn [DOI]
- Castagneyrol, B. , Valdés-Correcher, E. , Bourdin, A. , Barbaro, L. , Bouriaud, O. , Branco, M. , Centenaro, G. , Csóka, G. , Duduman, M.-L. , Dulaurent, A.-M. , Eötvös, C. B. , Faticov, M. , Ferrante, M. , Fürjes-Mikó, Á. , Galmán, A. , Gossner, M. M. , Harvey, D. , Howe, A. G. , Kaennel-Dobbertin, M. , … Tack, A. J. M. (2020). Can school children support ecological research? Lessons from the Oak Bodyguard Citizen Science Project. Citizen Science: Theory and Practice, 5(1), 1–11. 10.5334/cstp.267 [DOI] [Google Scholar]
- Ceccaroni, L. , Bibby, J. , Roger, E. , Flemons, P. , Michael, K. , Fagan, L. , & Oliver, J. L. (2019). Opportunities and risks for citizen science in the age of artificial intelligence. Citizen Science: Theory and Practice, 4(1), 29. 10.5334/cstp.241 [DOI] [Google Scholar]
- Cerrano, C. , Milanese, M. , & Ponti, M. (2017). Diving for science - science for diving: Volunteer scuba divers support science and conservation in the Mediterranean Sea. Aquatic Conservation: Marine and Freshwater Ecosystems, 27(2), 303–323. 10.1002/aqc.2663 [DOI] [Google Scholar]
- Conrad, C. C. , & Hilchey, K. G. (2011). A review of citizen science and community-based environmental monitoring: Issues and opportunities. Environmental Monitoring and Assessment, 176(1), 273–291. 10.1007/s10661-010-1582-5 [DOI] [PubMed] [Google Scholar]
- Cooper, C. B. , Dickinson, J. , Phillips, T. , & Bonney, R. (2007). Citizen science as a tool for conservation in residential ecosystems. Ecology and Society, 12(2), 11. http://www.jstor.org/stable/26267884 [Google Scholar]
- Couvet, D. , Jiguet, F. , Julliard, R. , Levrel, H. , & Teyssedre, A. (2008). Enhancing citizen contributions to biodiversity science and public policy. Interdisciplinary Science Reviews, 33(1), 95–103. 10.1179/030801808X260031 [DOI] [Google Scholar]
- Cox, T. , Philippoff, J. , Baumgartner, E. , & Smith, C. (2012). Expert variability provides perspective on the strengths and weaknesses of citizen-driven intertidal monitoring program. Ecological Applications, 22(4), 1201–1212. [DOI] [PubMed] [Google Scholar]
- Crall, A. W. , Newman, G. J. , Jarnevich, C. S. , Stohlgren, T. J. , Waller, D. M. , & Graham, J. (2010). Improving and integrating data on invasive species collected by citizen scientists. Biological Invasions, 12(10), 3419–3428. 10.1007/s10530-010-9740-9 [DOI] [Google Scholar]
- Crowther, T. W. , Glick, H. B. , Covey, K. R. , Bettigole, C. , Maynard, D. S. , Thomas, S. M. , Smith, J. R. , Hintler, G. , Duguid, M. C. , Amatulli, G. , Tuanmu, M. N. , Jetz, W. , Salas, C. , Stam, C. , Piotto, D. , Tavani, R. , Green, S. , Bruce, G. , Williams, S. J. , … Bradford, M. A. (2015). Mapping tree density at a global scale. Nature, 525(7568), 201. 10.1038/nature14967 [DOI] [PubMed] [Google Scholar]
- Dawson, N. , Coolsaet, B. , Sterling, E. , Loveridge, R. , Gross-Camp, N. , Wongbusarakum, S. , Sangha, K. , Scherl, L. , Phan, H. , Zafra-Calvo, N. , Lavey, W. , Byakagaba, P. , Idrobo, C. J. , Chenet, A. , Bennett, N. , Mansourian, S. , & Rosado-May, F. (2021). The role of Indigenous peoples and local communities in effective and equitable conservation. Ecology and Society, 26(3) 19. 10.5751/ES-12625-260319 [DOI] [Google Scholar]
- Deguines, N. , Flores, M. de , Loïs, G. , Julliard, R. , & Fontaine, C. (2018). Fostering close encounters of the entomological kind. Frontiers in Ecology and the Environment, 16(4), 202–203. 10.1002/fee.1795 [DOI] [Google Scholar]
- Devictor, V. , Whittaker, R. J. , & Beltrame, C. (2010). Beyond scarcity: Citizen science programmes as useful tools for conservation biogeography. Diversity and Distributions, 16(3), 354–362. 10.1111/j.1472-4642.2009.00615.x [DOI] [Google Scholar]
- Dickinson, J. L. , Shirk, J. , Bonter, D. , Bonney, R. , Crain, R. L. , Martin, J. , Phillips, T. , & Purcell, K. (2012). The current state of citizen science as a tool for ecological research and public engagement. Frontiers in Ecology and the Environment, 10(6), 291–297. 10.1890/110236 [DOI] [Google Scholar]
- Earp, H. S. , & Liconti, A. (2020). Science for the future: The use of citizen science in marine research and conservation. In Jungblut S., Liebich V., & Bode-Dalby M. (Éds.), YOUMARES 9—The oceans: our research, our future: Proceedings of the 2018 conference for young marine researcher in Oldenburg, Germany (pp. 1–19). Springer International Publishing. 10.1007/978-3-030-20389-4_1 [DOI] [Google Scholar]
- Eleta, I. , Clavell, G. G. , Righi, V. , & Balestrini, M. (2019). The promise of participation and decision-making power in citizen science. Citizen Science: Theory and Practice, 4(1), 8. 10.5334/cstp.171 [DOI] [Google Scholar]
- Esch, R. K. , Burbacher, E. , Dodrill, E. , Fussell, K. D. , Magdich, M. , Norris, H. , & Midden, W. R. (2020). Citizen science in schools: scientists’ perspectives on promise and pitfalls. Horizon Research, Inc. https://eric.ed.gov/?id=ED607598 [Google Scholar]
- Eymard, L. (2020). From the French citizens’ convention on climate to the conference on the future of Europe: A participatory science and democracy perspective. European Law Journal, 26(1–2), 136–140. 10.1111/eulj.12369 [DOI] [Google Scholar]
- Freitag, A. (2016). A typology for strategies to connect citizen science and management. Environmental Monitoring and Assessment, 188(9), 519. 10.1007/s10661-016-5513-y [DOI] [PubMed] [Google Scholar]
- Freitag, A. , & Pfeffer, M. J. (2013). Process, not product: Investigating recommendations for improving citizen science “success”. PLOS One, 8(5), e64079. 10.1371/journal.pone.0064079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Funk, V. A. (2003). 100 uses for an herbarium: Well at least 72. American Society of Plant Taxonomists Newsletter. [Google Scholar]
- Gallo, T. , & Waitt, D. (2011). Creating a successful citizen science model to detect and report invasive species. BioScience, 61(6), 459–465. 10.1525/bio.2011.61.6.8 [DOI] [Google Scholar]
- García, F. S. , Pelacho, M. , Woods, T. , Fraisl, D. , See, L. , Haklay, M. M. , & Arias, R. (2021). Finding what you need: A guide to citizen science guidelines. In The science of citizen science (pp. 419–435). Springer. [Google Scholar]
- Gardner, C. J. , & Wordley, C. F. R. (2019). Scientists must act on our own warnings to humanity. Nature Ecology & Evolution, 3, 1271–1272. 10.1038/s41559-019-0979-y [DOI] [PubMed] [Google Scholar]
- Gaston, K. J. , & Soga, M. (2020). Extinction of experience: The need to be more specific. People and Nature, 2(3), 575–581. 10.1002/pan3.10118 [DOI] [Google Scholar]
- Golumbic, Y. N. , Orr, D. , Baram-Tsabari, A. , & Fishbain, B. (2017). Between vision and reality: A study of scientists’ views on citizen science. Citizen Science: Theory and Practice, 2(1), 6. 10.5334/cstp.53 [DOI] [Google Scholar]
- Gouveia, C. , Fonseca, A. , Câmara, A. , & Ferreira, F. (2004). Promoting the use of environmental data collected by concerned citizens through information and communication technologies. Journal of Environmental Management, 71(2), 135–154. 10.1016/j.jenvman.2004.01.009 [DOI] [PubMed] [Google Scholar]
- Guerrini, C. J. , Majumder, M. A. , Lewellyn, M. J. , & McGuire, A. L. (2018). Citizen science, public policy. Science, 361(6398), 134–136. 10.1126/science.aar8379 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hagedorn, G. , Kalmus, P. , Mann, M. , Vicca, S. , Berge, J. V. den , Ypersele, J.-P. van , Bourg, D. , Rotmans, J. , Kaaronen, R. , Rahmstorf, S. , Kromp-Kolb, H. , Kirchengast, G. , Knutti, R. , Seneviratne, S. I. , Thalmann, P. , Cretney, R. , Green, A. , Anderson, K. , Hedberg, M. , … Hayhoe, K. (2019). Concerns of young protesters are justified. Science, 364(6436), 139–140. 10.1126/science.aax3807 [DOI] [PubMed] [Google Scholar]
- Hano, M. C. , Wei, L. , Hubbell, B. , & Rappold, A. G. (2020). Scaling up: Citizen science engagement and impacts beyond the individual. Citizen Science: Theory and Practice, 5(1), 1. 10.5334/cstp.244 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Heathcote, G. , Hobday, A. J. , Spaulding, M. , Gard, M. , & Irons, G. (2019). Citizen reporting of wildlife interactions can improve impact-reduction programs and support wildlife carers. Wildlife Research, 46(5), 415–428. 10.1071/WR18127 [DOI] [Google Scholar]
- Heigl, F. , Kieslinger, B. , Paul, K. T. , Uhlik, J. , & Dörler, D. (2019). Opinion: Toward an international definition of citizen science. Proceedings of the National Academy of Sciences, 116(17), 8089–8092. 10.1073/pnas.1903393116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Hill, A. , Guralnick, R. , Smith, A. , Sallans, A. , Gillespie, R. , Denslow, M. , Gross, J. , Murrell, Z. , Conyers, T. , Oboyski, P. , Ball, J. , Thomer, A. , Prys-Jones, R. , Torre, J. , de la Kociolek, P. , & Fortson, L. (2012). The notes from nature tool for unlocking biodiversity records from museum records through citizen science. ZooKeys, 209, 219–233. 10.3897/zookeys.209.3472 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Isaac, M. E. , & Martin, A. R. (2019). Accumulating crop functional trait data with citizen science. Scientific Reports, 9(1), 15715. 10.1038/s41598-019-51927-x [DOI] [PMC free article] [PubMed] [Google Scholar]
- Joly, A. , Bonnet, P. , Goëau, H. , Barbe, J. , Selmi, S. , Champ, J. , Dufour-Kowalski, S. , Affouard, A. , Carré, J. , Molino, J.-F. , Boujemaa, N. , & Barthélémy, D. (2016). A look inside the Pl@ntNet experience. Multimedia Systems, 22(6), 751–766. 10.1007/s00530-015-0462-9 [DOI] [Google Scholar]
- Kermish-Allen, R. , Peterman, K. , & Bevc, C. (2019). The utility of citizen science projects in K-5 schools: Measures of community engagement and student impacts. Cultural Studies of Science Education, 14(3), 627–641. 10.1007/s11422-017-9830-4 [DOI] [Google Scholar]
- Kobori, H. , Dickinson, J. L. , Washitani, I. , Sakurai, R. , Amano, T. , Komatsu, N. , Kitamura, W. , Takagawa, S. , Koyama, K. , & Ogawara, T. (2016). Citizen science: A new approach to advance ecology, education, and conservation. Ecological Research, 31(1), 1–19. [Google Scholar]
- Kosmala, M. , Wiggins, A. , Swanson, A. , & Simmons, B. (2016). Assessing data quality in citizen science. Frontiers in Ecology and the Environment, 14(10), 551–560. 10.1002/fee.1436 [DOI] [Google Scholar]
- Kumar, N. , Belhumeur, P. N. , Biswas, A. , Jacobs, D. W. , Kress, W. J. , Lopez, I. C. , & Soares, J. V. B. (2012). Leafsnap: A computer vision system for automatic plant species identification. In Fitzgibbon A., Lazebnik S., Perona P., Sato Y., & Schmid C. (Éds.), Computer vision – ECCV 2012 (pp. 502–516). Springer. 10.1007/978-3-642-33709-3_36 [DOI] [Google Scholar]
- Lakeman-Fraser, P. , Gosling, L. , Moffat, A. J. , West, S. E. , Fradera, R. , Davies, L. , Ayamba, M. A. , & van der Wal, R. (2016). To have your citizen science cake and eat it? Delivering research and outreach through Open Air Laboratories (OPAL). BMC Ecology, 16(1), 16. 10.1186/s12898-016-0065-0 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Lakshminarayanan, S. (2007). Using citizens to do science versus citizens as scientists. Ecology and Society, 12(2), r2. [Google Scholar]
- Lawrence, A. (2006). ‘No personal motive?’ Volunteers, biodiversity, and the false dichotomies of participation. Ethics, Place & Environment, 9(3), 279–298. 10.1080/13668790600893319 [DOI] [Google Scholar]
- Lawson, D. F. , Stevenson, K. T. , Peterson, M. N. , Carrier, S. J. , Strnad, R. L. , & Seekamp, E. (2019). Children can foster climate change concern among their parents. Nature Climate Change, 9, 458–462. 10.1038/s41558-019-0463-3 [DOI] [Google Scholar]
- Ledley, T. S. , Dahlman, L. , McAuliffe, C. , Haddad, N. , Taber, M. R. , Domenico, B. , Lynds, S. , & Grogan, M. (2011). Making Earth science data accessible and usable in education. Science, 333(6051), 1838–1839. 10.1126/science.1199348 [DOI] [PubMed] [Google Scholar]
- Lorke, J. , Golumbic, Y. N. , Ramjan, C. , & Atias, O. (2019). Training needs and recommendations for Citizen Science participants, facilitators and designers (AV.tp-01486). https://nhm.openrepository.com/handle/10141/622589.
- MacPhail, V. J. , & Colla, S. R. (2020). Power of the people: A review of citizen science programs for conservation. Biological Conservation, 249, 108739. 10.1016/j.biocon.2020.108739 [DOI] [Google Scholar]
- Mahecha, M. D. , Rzanny, M. , Kraemer, G. , Mäder, P. , Seeland, M. , & Wäldchen, J. (2021). Crowd-sourced plant occurrence data provide a reliable description of macroecological gradients. Ecography, 44, 1–12. 10.1111/ecog.05492 [DOI] [Google Scholar]
- McDonough MacKenzie, C. , Gallinat, A. S. , & Zipf, L. (2020). Low-cost observations and experiments return a high value in plant phenology research. Applications in Plant Sciences, 8(4), e11338. 10.1002/aps3.11338 [DOI] [PMC free article] [PubMed] [Google Scholar]
- McKinley, D. , Miller-Rushing, A. , Ballard, H. , Bonney, R. , Brown, H. , Evans, D. , French, R. , Parrish, J. , Phillips, T. , & Ryan, S. (2015). Can investing in citizen science improve natural resource management and environmental protection. Issues in Ecology, 19. [Google Scholar]
- McKinley, D. C. , Miller-Rushing, A. J. , Ballard, H. L. , Bonney, R. , Brown, H. , Cook-Patton, S. C. , Evans, D. M. , French, R. A. , Parrish, J. K. , Phillips, T. B. , Ryan, S. F. , Shanley, L. A. , Shirk, J. L. , Stepenuck, K. F. , Weltzin, J. F. , Wiggins, A. , Boyle, O. D. , Briggs, R. D. , Chapin, S. F. , … Soukup, M. A. (2017). Citizen science can improve conservation science, natural resource management, and environmental protection. Biological Conservation, 208, 15–28. 10.1016/j.biocon.2016.05.015 [DOI] [Google Scholar]
- Mohanty, S. P. , Hughes, D. P. , & Salathé, M. (2016). Using deep learning for image-based plant disease detection. Frontiers in Plant Science, 7, 1419. https://www.frontiersin.org/article/10.3389/fpls.2016.01419 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Morin, E. (2007). Restricted complexity, general complexity. In Science and us: philosophy and complexity (pp. 1–25). World Scientific. [Google Scholar]
- Nascimento, S. , Rubio Iglesias, J. , Owen, R. , Schade, S. , & Shanley, L. (2018). Citizen science for policy formulation and implementation (AV.tp-01474). UCL Press. [Google Scholar]
- Newman, G. , Wiggins, A. , Crall, A. , Graham, E. , Newman, S. , & Crowston, K. (2012). The future of citizen science: Emerging technologies and shifting paradigms. Frontiers in Ecology and the Environment, 10(6), 298–304. [Google Scholar]
- Nistor, A. , Clemente-Gallardo, J. , Angelopoulos, T. , Chodzinska, K. , Clemente Gallardo, M. , Gozdzik, A. , Gras-Velazquez, A. , Grizelj, A. , Kolenberg, K. , & Mitropoulou, D. (2019). Bringing Research into the Classroom–The Citizen Science approach in schools. Scientix Observatory.
- Nov, O. , Arazy, O. , & Anderson, D. (2014). Scientists@Home: What drives the quantity and quality of online citizen science participation? PLOS One, 9(4), e90375. 10.1371/journal.pone.0090375 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Nualart, N. , Ibáñez, N. , Soriano, I. , & López-Pujol, J. (2017). Assessing the relevance of herbarium collections as tools for conservation biology. The Botanical Review, 83(3), 303–325. 10.1007/s12229-017-9188-z [DOI] [Google Scholar]
- Owen, R. P. , & Parker, A. J. (2018). Citizen science in environmental protection agencies (AV.tp-01504). UCL Press. [Google Scholar]
- Pipino, L. L. , Lee, Y. W. , & Wang, R. Y. (2002). Data quality assessment. Communications of the ACM, 45(4), 211–218. [Google Scholar]
- Pocock, M. J. O. , & Evans, D. M. (2014). The success of the Horse–Chestnut leaf-miner, Cameraria Ohridella, in the UK revealed with hypothesis-led citizen science. PLOS One, 9(1), e86226. 10.1371/journal.pone.0086226 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Poulet, L. , Dalmas, B. , Goncalves, B. , Noûs, C. , & Vernay, A. (2021). As researchers, we need to engage more into public outreach towards children in the future. Journal of futures studies, 26(1), 75–82. 10.6531/JFS.202109_26(1).0006 [DOI] [Google Scholar]
- Poulet, L. , Vernay, A. , Goncalves, B. , Dalmas, B. , & Vernay, M. (2020). A multidisciplinary scientific outreach journal designed for and made by middle and high school students to bring research closer to the classroom (AV.tp-01104). https://ttu-ir.tdl.org/handle/2346/86423
- Primack, R. B. , Laube, J. , Gallinat, A. S. , & Menzel, A. (2015). From observations to experiments in phenology research: Investigating climate change impacts on trees and shrubs using dormant twigs. Annals of Botany, 116(6), 889–897. [DOI] [PMC free article] [PubMed] [Google Scholar]
- Ramirez-Andreotta, M. D. , Brusseau, M. L. , Artiola, J. , Maier, R. M. , & Gandolfi, A. J. (2015). Building a co-created citizen science program with gardeners neighboring a superfund site: The Gardenroots case study. International Public Health Journal, 7(1), 13. [PMC free article] [PubMed] [Google Scholar]
- Reis, G. , & Glithero, L. (2015). Provoking EcoJustice—Taking citizen science and youth activism beyond the school curriculum. In Ecojustice, citizen science and youth activism (pp. 39–61). Springer. [Google Scholar]
- Roche, J. , Bell, L. , Galvão, C. , Golumbic, Y. N. , Kloetzer, L. , Knoben, N. , Laakso, M. , Lorke, J. , Mannion, G. , Massetti, L. , Mauchline, A. , Pata, K. , Ruck, A. , Taraba, P. , & Winter, S. (2020). Citizen science, education, and learning: Challenges and opportunities. Frontiers in Sociology, 5, 110. 10.3389/fsoc.2020.613814 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Rotman, D. , Preece, J. , Hammock, J. , Procita, K. , Hansen, D. , Parr, C. , Lewis, D. , & Jacobs, D. (2012). Dynamic changes in motivation in collaborative citizen-science projects. In Proceedings of the ACM 2012 conference on computer supported cooperative work (pp. 217–226). ACM. 10.1145/2145204.2145238 [DOI] [Google Scholar]
- Rupprecht, C. D. D. , Vervoort, J. , Berthelsen, C. , Mangnus, A. , Osborne, N. , Thompson, K. , Urushima, A. Y. F. , Kóvskaya, M. , Spiegelberg, M. , Cristiano, S. , Springett, J. , Marschütz, B. , Flies, E. J. , McGreevy, S. R. , Droz, L. , Breed, M. F. , Gan, J. , Shinkai, R. , & Kawai, A. (2020). Multispecies sustainability. Global Sustainability, 3, e34. 10.1017/sus.2020.28 [DOI] [Google Scholar]
- Schade, S. , Pelacho, M. , van Noordwijk, T. (C. G. E.) , Vohland, K. , Hecker, S. , & Manzoni, M. (2021). Citizen science and policy. In Vohland K., Land-Zandstra A., Ceccaroni L., Lemmens R., Perelló J., Ponti M., Samson R., & Wagenknecht K. (Éds.), The science of citizen science (pp. 351–371). Springer International Publishing. 10.1007/978-3-030-58278-4_18 [DOI] [Google Scholar]
- Schläppy, M.-L. , Loder, J. , Salmond, J. , Lea, A. , Dean, A. J. , & Roelfsema, C. M. (2017). Making waves: Marine citizen science for impact. Frontiers in Marine Science, 4, 146. 10.3389/fmars.2017.00146 [DOI] [Google Scholar]
- Serret, H. , Deguines, N. , Jang, Y. , Lois, G. , & Julliard, R. (2019). Data quality and participant engagement in citizen science: Comparing two approaches for monitoring pollinators in France and South Korea. Citizen Science: Theory and Practice, 4(1), 22. [Google Scholar]
- Shanley, P. , & López, C. (2009). Out of the loop: Why research rarely reaches policy makers and the public and what can be done. Biotropica, 41(5), 535–544. 10.1111/j.1744-7429.2009.00561.x [DOI] [Google Scholar]
- Shirk, J. L. , Ballard, H. L. , Wilderman, C. C. , Phillips, T. , Wiggins, A. , Jordan, R. , McCallie, E. , Minarchek, M. , Lewenstein, B. V. , Krasny, M. E. , & Bonney, R. (2012). Public participation in scientific research: A framework for deliberate design. Ecology and Society, 17(2), 29–48. http://www.jstor.org/stable/26269051 [Google Scholar]
- Silvertown, J. (2009). A new dawn for citizen science. Trends in Ecology & Evolution, 24(9), 467–471. 10.1016/j.tree.2009.03.017 [DOI] [PubMed] [Google Scholar]
- Singh, A. K. , Ganapathysubramanian, B. , Sarkar, S. , & Singh, A. (2018). Deep learning for plant stress phenotyping: Trends and future perspectives. Trends in Plant Science, 23(10), 883–898. 10.1016/j.tplants.2018.07.004 [DOI] [PubMed] [Google Scholar]
- Smith, H. , Allf, B. , Larson, L. , Futch, S. , Lundgren, L. , Pacifici, L. , & Cooper, C. (2021). Leveraging citizen science in a college classroom to build interest and efficacy for science and the environment. Citizen Science: Theory and Practice, 6(1), 29. 10.5334/cstp.434 [DOI] [Google Scholar]
- Steffen, W. , Broadgate, W. , Deutsch, L. , Gaffney, O. , & Ludwig, C. (2015). The trajectory of the Anthropocene: The great acceleration. The Anthropocene Review, 2(1), 81–98. [Google Scholar]
- Teacher, A. G. F. , Griffiths, D. J. , Hodgson, D. J. , & Inger, R. (2013). Smartphones in ecology and evolution: A guide for the app-rehensive. Ecology and Evolution, 3(16), 5268–5278. 10.1002/ece3.888 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Teleki, K. A. (2012). Power of the people? Aquatic Conservation: Marine and Freshwater Ecosystems, 22(1), 1–6. 10.1002/aqc.2219 [DOI] [Google Scholar]
- Thiel, M. , Penna-Díaz, M. A. , Luna-Jorquera, G. , Salas, S. , Sellanes, J. , & Stotz, W. (2014). Citizen scientists and marine research: Volunteer participants, their contributions, and projection for the future. In Oceanography and marine biology (pp. 257–314). CRC Press. 10.1201/b17143-6 [DOI] [Google Scholar]
- Thomas, M. L. , Gunawardene, N. , Horton, K. , Williams, A. , O’Connor, S. , McKirdy, S. , & van der Merwe, J. (2017). Many eyes on the ground: Citizen science is an effective early detection tool for biosecurity. Biological Invasions, 19(9), 2751–2765. 10.1007/s10530-017-1481-6 [DOI] [Google Scholar]
- Tweddle, J. C. , Robinson, L. D. , Pocock, M. J. O. , & Roy, H. E. (2012). Guide to citizen science: Developing, implementing and evaluating citizen science to study biodiversity and the environment in the UK. NERC/Centre for Ecology & Hydrology. http://www.ukeof.org.uk/documents/guide-to-citizen-science.pdf
- Van Haeften, S. , Milic, A. , Addison-Smith, B. , Butcher, C. , & Davies, J. M. (2021). Grass Gazers: Using citizen science as a tool to facilitate practical and online science learning for secondary school students during the COVID-19 lockdown. Ecology and Evolution, 11(8), 3488–3500. 10.1002/ece3.6948 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Vasiliades, M. A. , Hadjichambis, A. C. , Paraskeva-Hadjichambi, D. , Adamou, A. , & Georgiou, Y. (2021). A systematic literature review on the participation aspects of environmental and nature-based citizen science initiatives. Sustainability, 13(13), 7457. 10.3390/su13137457 [DOI] [Google Scholar]
- Vayena, E. , & Tasioulas, J. (2015). “We the Scientists”: A human right to citizen science. Philosophy & Technology, 28(3), 479–485. 10.1007/s13347-015-0204-0 [DOI] [Google Scholar]
- Vignola, R. , Locatelli, B. , Martinez, C. , & Imbach, P. (2009). Ecosystem-based adaptation to climate change: What role for policy-makers, society and scientists? Mitigation and Adaptation Strategies for Global Change, 14(8), 691. 10.1007/s11027-009-9193-6 [DOI] [Google Scholar]
- Vohland, K. , Land-Zandstra, A. , Ceccaroni, L. , Lemmens, R. , Perelló, J. , Ponti, M. , Samson, R. , & Wagenknecht, K. (2021). The science of citizen science. Springer Nature. [Google Scholar]
- Vohland, K. , Weißpflug, M. , & Pettibone, L. (2019). Citizen science and the Neoliberal transformation of science—An ambivalent relationship. Citizen Science: Theory and Practice, 4(1), 25. 10.5334/cstp.186 [DOI] [Google Scholar]
- Ward-Fear, G. , Pauly, G. B. , Vendetti, J. E. , & Shine, R. (2020). Authorship protocols must change to credit citizen scientists. Trends in Ecology & Evolution, 35(3), 187–190. 10.1016/j.tree.2019.10.007 [DOI] [PubMed] [Google Scholar]
- Watermeyer, R. , & Montgomery, C. (2018). Public dialogue with science and development for teachers of STEM: Linking public dialogue with pedagogic praxis. Journal of Education for Teaching, 44(1), 90–106. 10.1080/02607476.2018.1422621 [DOI] [Google Scholar]
- Williams, K. A. , Hall, T. E. , & O’Connell, K. (2021). Classroom-based citizen science: Impacts on students’ science identity, nature connectedness, and curricular knowledge. Environmental Education Research, 27(7), 1037–1053. 10.1080/13504622.2021.1927990 [DOI] [Google Scholar]
- Würschum, T. , Leiser, W. L. , Jähne, F. , Bachteler, K. , Miersch, M. , & Hahn, V. (2019). The soybean experiment ‘1000 Gardens’: A case study of citizen science for research, education, and beyond. Theoretical and Applied Genetics, 132(3), 617–626. 10.1007/s00122-018-3134-2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- Zoellick, B. , Nelson, S. J. , & Schauffler, M. (2012). Participatory science and education: Bringing both views into focus. Frontiers in Ecology and the Environment, 10(6), 310–313. [Google Scholar]



