Skip to main content
Proceedings of the National Academy of Sciences of the United States of America logoLink to Proceedings of the National Academy of Sciences of the United States of America
letter
. 2019 Jul 30;116(31):15336–15337. doi: 10.1073/pnas.1909278116

The problem with delineating narrow criteria for citizen science

Jeremy Auerbach a,1, Erika L Barthelmess b, Darlene Cavalier c, Caren B Cooper d, Heather Fenyk e, Mordechai Haklay f, Joseph M Hulbert g, Christopher C M Kyba h,i, Lincoln R Larson j, Eva Lewandowski k, Lea Shanley l
PMCID: PMC6681715  PMID: 31363074

Heigl et al. (1) propose an international definition of citizen science based on quality criteria for projects. As an international group of scholars with extensive background in the theory and practice of citizen science, we find the Opinion by Heigl et al. (1) antithetical to the creativity, innovation, and bottom-up pathways to knowledge generation that are embodied by citizen science. The minimum quality standards Heigl et al. (1) propose do not represent the interdisciplinary consensus of the international citizen science community*, and we fear that such a definition would confine rather than define the field.

Many citizen science professionals, including some of the authors of this letter, have attempted to define citizen science in the past, only to discover later that their definition does not fully encompass the field (2). We also strongly believe that it is both unproductive and fraught to narrowly define citizen science based on a set of quality criteria for individual projects. In addition, we note that, practically speaking, a classification system for citizen science projects based on quality criteria is not equivalent to a definition.

Such an approach also excludes several types of citizen science. For example, Heigl et al. (1) restrict their concept of citizen science to include only projects in which groups of citizens gather data for a predefined scientific purpose, generally reflecting contributory-style projects that represent only one component of the larger citizen science landscape. As a result, many long-standing examples of citizen science are not included in their definition, such as amateur astronomers who independently make systematic observations of our universe (3).

Heigl et al. (1) propose criteria that they claim will “help the field flourish, and … encourage policymakers to take [citizen science] project data and results seriously.” While defining criteria for inclusion is entirely reasonable for many purposes (e.g., project funding), those criteria will depend strongly on the situation. For example, some existing agencies have already developed definitions that meet their needs (4), and as with other scientific data citizen science data, should of course be evaluated as to its fitness for purpose. It is important to recognize, however, that citizen science also extends well beyond development and testing of research hypotheses, including activities such as environmental monitoring, producing training data for supervised machine learning, data visualization and interpretation, and complex problem solving.

We argue that Heigl et al.’s (1) specified minimum quality criteria should not be used as “the basis for an international declaration” because any exclusionary approach will necessarily fail to address the “challenge of accommodating considerable heterogeneity” within the field of citizen science. Instead of focusing on specific criteria, we advocate for collaboration among all engaged actors to emphasize informed consent about project design features and transparency in data collection and handling practices (to indicate data quality and fitness for purpose). We encourage the citizen science community and associated collaborators (such as funding agencies) to determine the best design specifications for their own unique contexts, enabling citizen science to achieve its full potential.

Footnotes

The authors declare no conflict of interest.

*See https://www.researchgate.net/publication/333530451 for signatories of this letter.

References

  • 1.Heigl F., Kieslinger B., Paul K. T., Uhlik J., Dörler D., Opinion: Toward an international definition of citizen science. Proc. Natl. Acad. Sci. U.S.A. 116, 8089–8092 (2019). [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Schrögel P., Kolleck A., The many faces of participation in science: Literature review and proposal for a three dimensional framework. Sci. Technol. Stud. 32, 10.23987/sts.59519 (2018). [DOI] [Google Scholar]
  • 3.Castelvecchi D., Amateur astronomer catches first glimpses of birth of a supernova Nature (2018). https://www.nature.com/articles/d41586-018-02331-4. Accessed 28 May 2019.
  • 4.Shanley L., Hulbert J., Auerbach J., “Definitions of citizen science.” CitiSciDefinitions (2019). https://github.com/lshanley/CitSciDefinitions. Accessed 28 May 2019.

Articles from Proceedings of the National Academy of Sciences of the United States of America are provided here courtesy of National Academy of Sciences

RESOURCES