Abstract
The COVID-19 pandemic has underlined the need to partner with the community in pandemic preparedness and response in order to enable trust-building among stakeholders, which is key in pandemic management. Citizen science, defined here as a practice of public participation and collaboration in all aspects of scientific research to increase knowledge and build trust with governments and researchers, is a crucial approach to promoting community engagement. By harnessing the potential of digitally enabled citizen science, one could translate data into accessible, comprehensible and actionable outputs at the population level. The application of citizen science in health has grown over the years, but most of these approaches remain at the level of participatory data collection. This narrative review examines citizen science approaches in participatory data generation, modelling and visualisation, and calls for truly participatory and co-creation approaches across all domains of pandemic preparedness and response. Further research is needed to identify approaches that optimally generate short-term and long-term value for communities participating in population health. Feasible, sustainable and contextualised citizen science approaches that meaningfully engage affected communities for the long-term will need to be inclusive of all populations and their cultures, comprehensive of all domains, digitally enabled and viewed as a key component to allow trust-building among the stakeholders. The impact of COVID-19 on people’s lives has created an opportune time to advance people’s agency in science, particularly in pandemic preparedness and response.
Keywords: COVID-19; health systems; public health; infections, diseases, disorders, injuries
Summary box.
The ideal state of citizen science should see researchers, communities and policymakers collaborate, co-create and share ownership in all aspects of research, towards translating data into comprehensible and actionable outputs at the population level.
While data collection and mathematical models are on the rise in health decision making, there is a lack of effort to develop effective approaches to participatory modelling and community engagement in data visualisation and communication.
By empowering communities through shared knowledge-making and bidirectional communication, citizen science could be a bridge to build trust among communities, researchers and policymakers in a collective decision-making process.
Citizen science approaches enabled by digital technologies have the potential to go beyond data generation to improve transparency and accuracy of modelling, communications and collaborative policy development.
We need to be mindful of systemic barriers and social, economic and political inequities when implementing digitally enabled citizen science approaches, to avoid widening existing health disparities.
Introduction
The world struggled to respond to the COVID-19 pandemic in a timely and effective manner due to a lack of accurate, continuous real-time global primary data availability on outbreaks, and the absence of globally consistent evidence-based responses. WHO tasked the Independent Panel for Pandemic Preparedness and Response to conduct a review of the global health response to the pandemic, and in their final report, they called for a fundamental transformation of the international system to prevent a future pandemic.1 However, this must be done with care: the pandemic led many states to use the public health crisis to justify sweeping and intrusive surveillance powers, weakening public trust.2 A neutral and trusted global pandemic preparedness and response collective that is culturally and contextually informed, science-based, digitally enabled, respectful of human rights and works across the continuum of pandemic phases: namely preparedness, response, recovery and surveillance, needs to be created by engaging all stakeholders, including communities most affected by the infectious diseases in question.
A crucial research priority is trust-building among the stakeholders that are interdependent in the response to a pandemic and creating direct and efficient vehicles of communication with communities directly affected by the pandemic. An analysis has shown that higher levels of trust in the government and interpersonal trust had significant associations with lower COVID-19 infection rates and higher acceptance rates of the vaccine.3 It is evident that there is a lack of mutual trust and a common language among the public, researchers and policymakers particularly in the areas of development and implementation of public health interventions, as observed during the current and previous outbreaks.4 5 This has undermined public compliance with and effectiveness of mitigation strategies.6 7 Similarly, in the response to HIV, and other epidemics, community engagement has proven key to an effective response; in the response to HIV, tuberculosis and malaria, this recognition of the right to participation has extended to roles for community representatives at high levels of decision-making.8 One proven pathway to build and maintain public trust is through community engagement in the three steps of collective knowledge-making, namely problem definition and data generation, simulation and modelling, clear communication and decision-making informed by data-generated insights.9–11 In this analysis, we focus on the involvement of communities in an iterative process from participatory data generation and modelling to visualisation and communication as well as public validation and hypothesis generation, maximised through digital enablers, including artificial intelligence. Here, we define the ideal state of citizen science as a practice of public participation, collaboration and co-creation in all aspects of scientific research to increase knowledge, build trust, generate accurate and timely data, and develop strategies in pandemic preparedness and response (figure 1). Box 1 summarises our methodological approach.
Box 1. Summary of methodology and data sources.
A search was conducted in PubMed and the grey literature in February 2022, guided by the research question ‘Can current participatory approaches in health be used to achieve the ideal state of citizen science in pandemic preparedness and response?’ Search terms included: citizen science, participatory, surveillance, modeling, visualization, pandemic preparedness and response, COVID-19. Only English articles were included. Citations within articles were also searched if they appeared relevant to the research question. A final number of 58 articles were reviewed. Whenever communities were mentioned, information was extracted to formulate our understanding of current practices and definition of community engagement in health, particularly in pandemic preparedness and response. Findings were categorised into three sections: participatory data generation, participatory modelling and participatory visualisation. In each section, we provided a descriptive summary of existing evidence and explored the gaps that need to be filled to achieve the ideal state of citizen science in pandemic preparedness and response.
Key aspects of citizen science in pandemic preparedness and response
The literature revealed non-uniform and arguable definitions of community engagement. In this review, we included all mention of community engagement, from passive surveillance of the public to active collaboration with communities. Adapted from Arnstein’s original ladder of citizen participation,12 the five levels of citizen engagement, namely inform, consult, involve, co-create and empower, describe the iterative process and extent to which governments can engage the community in decision-making (figure 2). In the typology by Shirk et al,13 citizen science projects between researchers and communities can be classified into five main categories: (1) ‘contractual’, where communities request researchers to perform scientific investigations; (2) ‘contributory’, which are designed by researchers and for which communities primarily contribute data; (3) ‘collaborative’, which are designed by researchers and for which communities contribute data and help to refine project design, analyse data and disseminate findings; (4) ‘co-created’, which are designed by researchers and communities working together and for which public participants are actively engaged in the research process and (5) ‘collegial’, where non-credentialed individuals perform research independently with varying degrees of expected recognition by researchers. Using COVID-19 as the main use case, we highlighted the successes of and barriers to current participatory approaches used in infectious diseases outbreak and the priority research areas to realise the potential of citizen science to mount an effective response for future pandemics.
Citizen science approaches in participatory data generation
Community engagement in the field of participatory health data gathering has played an important role in public health, particularly in the field of infectious diseases.14 With the increased penetration of mobile phones and technology, digital-based participatory data generation systems are fast evolving.15 For example, ‘Mo-Buzz’ was launched in Sri Lanka to combat dengue by allowing the public to report dengue symptoms and potential dengue mosquito-breeding sites. Using global positioning system (GPS) technology, real-time dengue hotspot maps and targeted alerts can be sent to users and communities at risk.16 Similarly, “Flu Near You”, a real-time influenza symptom tracking system was developed in the USA for early detection and response to influenza by leveraging on voluntary symptom reporting from the public.17 When COVID-19 struck, this influenza surveillance system was rapidly adapted to “Outbreaks Near Me” for COVID-19 surveillance.18 Expanding beyond humans to animal diseases, the Participatory One Health Disease Detection project enables early detection of zoonotic diseases. This mobile application implemented in Thailand enabled volunteers to report suspected outbreaks, which contributed to a faster and more coordinated response among government officials, veterinarians and public health experts.19 By enabling the generation of large volumes of data over short timescales and extensive geographical areas, digital-based participatory systems can better support the early detection of outbreaks through reporting of early symptoms and health-seeking behaviours. With the increase in volumes of data so grows the complexity of information that needs to be extracted from the data. Where classical analytical techniques are unable to cope with the volume and complexity, machine learning and big data tools can be leveraged to better harness data resulting from multiple data sources.20 21
During the initial phases of the COVID-19 pandemic when case numbers were low, many countries adopted the shoe-leather epidemiology surveillance method. Collection of epidemiological data relevant to the investigation was done by community health volunteers physically visiting places to investigate a representative sample of the affected people.22 This was feasible when numbers were low. However, due to the rapid speed at which the pandemic unfolded, these traditional methods of outbreak investigation were insufficient to ensure timely data collection, and to accurately evaluate and contain situations on the ground. Sole reliance on this type of manpower-intensive surveillance method proved to be unsustainable, particularly in resource-limited settings and high-density populations. Advanced technology and existing digital infrastructure enabled countries to tap into new data sources for surveillance. A spectrum of approaches to collect data from the community, from involuntary mobility monitoring and social media surveillance to participatory syndromic data generation, has been adopted by countries.23 For example, South Korea uses electronic health records, credit card transactions, GPS data and closed-circuit television to address limitations in memory recall during contact tracing.24 Japan, Germany, Singapore, New Zealand and Norway, among others, have launched smartphone applications that use Bluetooth signals, GPS tracking or recording of location-specific QR codes to identify individuals who have come into close proximity with a patient with COVID-19.25 26 Numerous participatory surveillance applications have sprung up, including the ‘Zoe COVID-19 symptom study’, which collected voluntarily self-reported information from consenting participants on COVID-19 in Sweden, the UK and the USA. This allowed monitoring of the spread of COVID-19 when access to testing was limited, and also contributed to research questions such as the identification of anosmia as a key symptom of COVID-19 and delirium as a frequent symptom in older people.27
The above highlights a major gap in the current landscape for participatory data generation. Most of the community engagement efforts are limited to the ‘inform’ and ‘consult’ stages where communication is unidirectional, giving communities little or no meaningful input into decision-making about what kinds of data are gathered and how. This raises problems of power and voice: if communities are only low-paid data enumerators or passive producers of data over which they have no control, the result risks widening power imbalances and exploiting vulnerable groups through data mining for private profit. Future participatory approaches should engage communities in collaborative problem definition and corresponding data generation to enable them to play a more active and larger role that goes beyond data provision to empowerment. For example, the Digital Health and Rights Project engages transnational networks of people living with HIV, human rights lawyers and AIDS advocates in designing, implementing and analysing qualitative data in a multicountry study on how young adults use digital platforms to access health information and services, using the results to develop global health policy recommendations.28
Citizen science approaches in participatory modelling
Although participatory approaches in data generation have gained popularity over the years, there has not been significant progress in participatory modelling in health, especially in pandemic preparedness and response. Participatory modelling and simulation approaches have mostly been used in the field of natural resources and environmental research.29 30 However, given growing evidence of biases encoded in algorithms and models, and the challenges in quantifying structural factors that can shape health outcomes, it is crucial to engage communities in the review and audit of both the assumptions and data used in modelling.8
The equitable participation of stakeholders, including communities, scientists and policymakers, in the modelling process aims to achieve two outcomes. First, their expertise can help ensure the assumptions behind models are more attuned to the social, cultural and political context. From a technical perspective, participatory modelling provides an appropriate interaction setting for participants to co-produce models which make sense to them and generate useful discussions in framing, designing of settings, assumptions, elements and outputs.31 32 Second, their involvement fosters a collective learning environment resulting in a shared understanding of health issues as well as identification of data sources that can fit better into the models, or data gaps that may need to be addressed.33 34 Through collective reasoning and tools for scenario-based simulations, communities can evaluate the effects of implementing different policies and share policy recommendations, thus facilitating better decisions and improved trust, acceptance and ownership of the modelling outcomes and subsequent interventions.31 35
Participatory modelling has shown some successes in COVID-19, particularly in two domains. First, it was demonstrated that by engaging policymakers and public health professionals throughout all stages of the modelling process, under the guidance of modellers and researchers, modelling outputs can be translated to more tailored policy decision-making.36 37 Second, citizen scientists were deployed to help in simulations through their own personal digital devices. For example, in the online game ‘EVE Online’, a mini-game ‘Project Discovery’ doubles as a citizen science platform studying the human immune system’s response to COVID-19.38 Participants take on data analysis through gameplay that helps researchers isolate specific patterns as predictors of disease severity. In the ‘COVID-19 Moonshot’ project, >200 000 volunteers around the world are helping to find potential treatments for COVID-19 by running simulations on their home computers.39 However, there exists a gap in engaging all groups of stakeholders in the same participatory modelling process for consensus and trust-building, and the risk of only including people who have access to technology.
Although there are growing interests in participatory modelling for pandemic preparedness and response, more can be done to leverage this approach to address the disconnect between science, policy and implementation by uniting communities, modellers, researchers and policymakers towards a common goal and under a common platform. By bringing more transparency to the process of how insights are generated from data, participatory modelling could be the tool of engagement and the bridge to build trust in a collective decision-making process.
Citizen science approaches in data visualisation and communication
To drive actionable changes informed by data-generated insights, data visualisations need to be tailored to the accessibility and understanding of different stakeholders, from the public to policymakers. Through the co-design process and a human-centred approach, collective knowledge-making can then be possible to build consensus and drive decision-making through empowerment. One example of citizen science approaches involving the community is the design of the visualisations for the ‘Participatory Tracking Project’ in Tamil Nadu. To present the survey findings in a way that is understandable by even the least literate women in the districts, an iterative feedback mechanism was adopted to fine-tune the visualisation prototypes. By incorporating cultural and context-specific designs, the research team and villagers produced a final visualisation which the villagers could identify with, empowering them to make informed decisions through data.40 In the realm of pandemic preparedness and response, participatory visualisation is often an afterthought in which new visualisations are added or revised only after end users start using the systems.41 During the COVID-19 pandemic, most infographics and illustrations are designed by individual stakeholders with varying success.42 To truly facilitate the translation of data into applied knowledge and informed decision-making, more collaborative citizen science approaches need to be adopted among groups of stakeholders and at all levels of data and digital literacy to identify the best ways of representing data. Data should be presented in a way to allow community stakeholders to give feedback to its relevance and adequacy, thus validating the analysis and enabling an iterative cycle of reflection for action, as evidently adopted in participatory action research.43
In this era where social media dominates, public communication of science and policy decisions should be robust, yet understandable by the public, to address issues of misinformation and disinformation. Engaging the community in myth-busting campaigns requires more research on their format and delivery.44 Citizen science is one possible method to allow for the management of misinformation in the public and social media by facilitating an exchange of balanced information and the engagement of communities as necessary active participants in a complex health information environment. This creates an interactive and bidirectional dissemination of health information, raises awareness of public health issues and improves health literacy of communities. For example, sub-Saharan countries initiated public engagement communication to help the public understand about COVID-19 spread and precaution measures. This accelerated the implementation of acceptable community interventions such as the setting up of hand washing stations at locations convenient to the people.45 Through effective public engagement, there can be more targeted health messaging and communication, including valuable feedback loops.
Potential to maximise citizen science impact
Based on the reviewed literature, we noted that although citizen science approaches have been used for data generation during COVID-19, there are only a handful of examples for participatory modelling, and data visualisation and communication. By focusing on the gaps along the data-models-visualisations workflow, more clarity and transparency to how data inputs translate to actionable outputs will be made possible, thus enabling trust building among the various stakeholders (figure 3). Furthermore, COVID-19 has accelerated the development and application of digital technologies and innovation in health. Building on previous work in digital-based participatory systems, digitally enabled citizen science in pandemic preparedness and response has the potential to scale in both breadth and depth to overcome some of the challenges faced by traditional participatory approaches.46 However, one of the most systemic barriers is digital inequity, particularly, but not reserved to, low-to-middle-income countries. Digital inequities include barriers to access to digital tools, networks and communication channels, as well as conflicting life priorities, particularly among women, girls and vulnerable and marginalised populations.28 47 48 There exists a risk of digitally enabled citizen science approaches in widening existing health disparities by excluding those who do not have access to digital technologies. To truly tap the potential of digitally enabled citizen science in pandemic preparedness and response, countries and agencies should address these gaps through support for digital literacy and empowerment among the populations who need to engage in citizen science, as well as promoting affordable access to technology, internet and mobile data.
Capacity development efforts to improve the quality of data generated from citizen scientists is another area of importance highlighted by researchers. Researchers have voiced concerns about the quality of data generated from communities.49 However, with sufficient oversight, training and guidelines in place, a collaborative model of science with a balance between citizen-initiated and researcher-initiated projects can be possible with bidirectional trust established. Capacity development efforts are growing in this area, such as the citizen science project launched by the University of Illinois Chicago School of Public Health. Members of community-based organisations can participate in the school’s new citizen scientist certificate programme to build research skills, before being deployed to the community to explore public health issues such as that of vaccine hesitancy in the USA.50
Conclusion
The impact of COVID-19 on the lives of people has increased the public’s query into the process of policymaking and their attention on informed decision-making. It is an opportune time to advance people’s agency in science, particularly in the field of pandemic preparedness and response. To do that, we will need to first raise awareness among the community on their important role in the above-mentioned three steps of collective knowledge-making, as well as elucidate the acceptability and feasibility of participatory citizen science approaches. Active engagement of communities should be viewed as a pivotal, rather than an ancillary component in all research efforts to empower and build trust among the public, researchers and policymakers. Ultimately, this will hopefully convert to more timely and efficient evidence-based responses to future pandemic risks, reducing their impact on individuals, communities and countries.
Footnotes
Handling editor: Seye Abimbola
Twitter: @AnuragAgrawalMD, @rebeccakatz5, @saralmdavis, @ashvan08, @MohandesDean, @camcam_ca, @pey_canlas, @gershim_asiki, @harjyotkhosa, @JVLazarus, @choisy_marc, @marirecamonde, @keiserolivia, @okwen@ebaseafrica.org, @ReneEnglish20, @sergestinckwich, @skmuyingo, @tkutadza, @Tavpritesh, @gioasempre
Contributors: All authors contributed to the conception of this manuscript. Y-RT performed the analysis while Y-RT and PY drafted the paper, which was commented on by all authors prior to submission. All authors gave the final approval of the version to be published.
Funding: This project has been funded by Fondation Botnar.
Competing interests: None declared.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data availability statement
All data relevant to the study are included in the article.
Ethics statements
Patient consent for publication
Not applicable.
Ethics approval
Not applicable.
References
- 1.The independent panel for pandemic preparedness & response. Available: https://theindependentpanel.org/ [DOI] [PMC free article] [PubMed]
- 2.Intrusive, omnipresent surveillance growing during COVID-19 pandemic, un expert warns. Available: https://www.ohchr.org/en/NewsEvents/Pages/DisplayNews.aspx?NewsID=26446&LangID=E
- 3.COVID-19 National Preparedness Collaborators . Pandemic preparedness and COVID-19: an exploratory analysis of infection and fatality rates, and contextual factors associated with preparedness in 177 countries, from Jan 1, 2020, to Sept 30, 2021. Lancet 2022;399:1489-1512. 10.1016/S0140-6736(22)00172-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Glazik R, Moore H, Kennedy D, et al. A snapshot of the practicality and barriers to COVID-19 interventions: public health and healthcare workers' perceptions in high and low- and middle-income countries. PLoS One 2021;16:e0260041. 10.1371/journal.pone.0260041 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Bangerter A. Investigating and rebuilding public trust in preparation for the next pandemic. 19. Hogrefe Publishing, 2014: 1–3. 10.1027/1016-9040/a000173 [DOI] [Google Scholar]
- 6.van der Weerd W, Timmermans DR, Beaujean DJ, et al. Monitoring the level of government trust, risk perception and intention of the general public to adopt protective measures during the influenza A (H1N1) pandemic in the Netherlands. BMC Public Health 2011;11:575. 10.1186/1471-2458-11-575 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Bargain O, Aminjonov U. Trust and compliance to public health policies in times of COVID-19. J Public Econ 2020;192:104316. 10.1016/j.jpubeco.2020.104316 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Sara MD. The uncounted: politics of data in global health. New York Cambridge University Press, 2020. [Google Scholar]
- 9.Henderson J, Ward PR, Tonkin E, et al. Developing and maintaining public trust during and Post-COVID-19: can we apply a model developed for responding to food Scares? Front Public Health 2020;8:369. 10.3389/fpubh.2020.00369 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Adams S, Rhodes T, Lancaster K. New directions for participatory modelling in health: redistributing expertise in relation to localised matters of concern. Glob Public Health 2021:1–15. 10.1080/17441692.2021.1998575 [DOI] [PubMed] [Google Scholar]
- 11.Ozano K, Dean L, Adekeye O, et al. Guiding principles for quality, ethical standards and ongoing learning in implementation research: multicountry learnings from participatory action research to strengthen health systems. Health Policy Plan 2020;35:ii137–49. 10.1093/heapol/czaa123 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Arnstein SR. A ladder of citizen participation. J Am Inst Plann 1969;35:216–24. 10.1080/01944366908977225 [DOI] [Google Scholar]
- 13.Shirk JL, Ballard HL, Wilderman CC, et al. Public participation in scientific research: a framework for deliberate design. E&S 2012;17. 10.5751/ES-04705-170229 [DOI] [Google Scholar]
- 14.Wójcik OP, Brownstein JS, Chunara R, et al. Public health for the people: participatory infectious disease surveillance in the digital age. Emerg Themes Epidemiol 2014;11:7. 10.1186/1742-7622-11-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Smolinski MS, Crawley AW, Olsen JM, et al. Participatory disease surveillance: engaging communities directly in reporting, monitoring, and responding to health threats. JMIR Public Health Surveill 2017;3:e62. 10.2196/publichealth.7540 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Lwin MO, Jayasundar K, Sheldenkar A, et al. Lessons from the implementation of Mo-Buzz, a mobile pandemic surveillance system for dengue. JMIR Public Health Surveill 2017;3:e65. 10.2196/publichealth.7376 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Smolinski MS, Crawley AW, Baltrusaitis K, et al. Flu near you: Crowdsourced symptom reporting spanning 2 influenza seasons. Am J Public Health 2015;105:2124–30. 10.2105/AJPH.2015.302696 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Outbreaks near me. Available: https://outbreaksnearme.org/us/en-US/
- 19.Yano T, Phornwisetsirikun S, Susumpow P, et al. A participatory system for preventing pandemics of animal origins: pilot study of the participatory one health disease detection (PODD) system. JMIR Public Health Surveill 2018;4:e25. 10.2196/publichealth.7375 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Mellado B, Wu J, Kong JD, et al. Leveraging artificial intelligence and big data to optimize COVID-19 clinical public health and vaccination roll-out strategies in Africa. Int J Environ Res Public Health 2021;18. 10.3390/ijerph18157890. [Epub ahead of print: 26 07 2021]. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Tao S, Bragazzi NL, Wu J, et al. Harnessing artificial intelligence to assess the impact of nonpharmaceutical interventions on the second wave of the coronavirus disease 2019 pandemic across the world. Sci Rep 2022;12. 10.1038/s41598-021-04731-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Baum F, Freeman T, Musolino C, et al. Explaining covid-19 performance: what factors might predict national responses? BMJ 2021;372:n91. 10.1136/bmj.n91 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Zwitter A, Gstrein OJ, et al. Big data, privacy and COVID-19 – learning from humanitarian expertise in data protection. Int J Humanitarian Action 2020;5:4. 10.1186/s41018-020-00072-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 24.Han E, Tan MMJ, Turk E, et al. Lessons learnt from easing COVID-19 restrictions: an analysis of countries and regions in Asia Pacific and Europe. Lancet 2020;396:1525–34. 10.1016/S0140-6736(20)32007-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Legido-Quigley H, Asgari N, Teo YY, et al. Are high-performing health systems resilient against the COVID-19 epidemic? Lancet 2020;395:848–50. 10.1016/S0140-6736(20)30551-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 26.Summers J, Cheng H-Y, Lin H-H, et al. Potential lessons from the Taiwan and New Zealand health responses to the COVID-19 pandemic. Lancet Reg Health West Pac 2020;4:100044. 10.1016/j.lanwpc.2020.100044 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Birkin LJ, Vasileiou E, Stagg HR. Citizen science in the time of COVID-19. Thorax 2021;76:636–7. 10.1136/thoraxjnl-2020-216673 [DOI] [PubMed] [Google Scholar]
- 28.Sara MD, Nerima W, Tara I. Digital health rights: initial analysis. Global health centre 2021;27. [Google Scholar]
- 29.Dreyer M, Renn O. Participatory approaches to modelling for improved learning and decision-making in natural resource governance: an editorial. Environmental Policy and Governance 2011;21:379–85. 10.1002/eet.584 [DOI] [Google Scholar]
- 30.Voinov A, Kolagani N, McCall MK, et al. Modelling with stakeholders – next generation. Environmental Modelling & Software 2016;77:196–220. 10.1016/j.envsoft.2015.11.016 [DOI] [Google Scholar]
- 31.Zimmerman L, Lounsbury DW, Rosen CS, et al. Participatory system dynamics modeling: increasing Stakeholder engagement and precision to improve implementation planning in systems. Adm Policy Ment Health 2016;43:834–49. 10.1007/s10488-016-0754-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Rhodes T, Lancaster K, Lees S, et al. Modelling the pandemic: attuning models to their contexts. BMJ Glob Health 2020;5:e002914. 10.1136/bmjgh-2020-002914 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.Duboz R, Binot A. Animal and human health: tackling uncertainty through participatory modelling and simulation. CIRAD Perspective 2017;41. [Google Scholar]
- 34.Atkinson J-AM, Wells R, Page A, et al. Applications of system dynamics modelling to support health policy. Public Health Res Pract 2015;25:e2531531. 10.17061/phrp2531531 [DOI] [PubMed] [Google Scholar]
- 35.Royston G, Dost A, Townshend J, et al. Using system dynamics to help develop and implement policies and programmes in health care in England. Syst Dyn Rev 1999;15:293–313. [DOI] [Google Scholar]
- 36.Adib K, Hancock PA, Rahimli A, et al. A participatory modelling approach for investigating the spread of COVID-19 in countries of the eastern Mediterranean region to support public health decision-making. BMJ Glob Health 2021;6:e005207. 10.1136/bmjgh-2021-005207 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.Aguas R, White L, Hupert N, et al. Modelling the COVID-19 pandemic in context: an international participatory approach. BMJ Glob Health 2020;5:e003126. 10.1136/bmjgh-2020-003126 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 38.EVE online gamers role-play as COVID-19 researchers. Available: https://www.wired.com/story/eve-online-project-discovery-covid-19-citizen-science/
- 39.Your computer can help scientists find a cure for COVID-10. Here’s how. Available: https://www.weforum.org/agenda/2020/12/citizen-scientists-crowdsourcing-covid-19-cure/
- 40.Participatory tracking: Customizing visualizations. the world bank. Available: https://socialobservatory.worldbank.org/articles/participatory-tracking-customizing-visualizations
- 41.Ulahannan JP, Narayanan N, Thalhath N, et al. A citizen science initiative for open data and visualization of COVID-19 outbreak in Kerala, India. J Am Med Inform Assoc 2020;27:1913–20. 10.1093/jamia/ocaa203 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Bowe E, Simmons E, Mattern S. Learning from lines: critical COVID data visualizations and the quarantine quotidian. Big Data Soc 2020;7:205395172093923. 10.1177/2053951720939236 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 43.Baum F, MacDougall C, Smith D. Participatory action research. J Epidemiol Community Health 2006;60:854–7. 10.1136/jech.2004.028662 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Challenger A, Sumner P, Bott L. COVID-19 myth-busting: an experimental study. BMC Public Health 2022;22:131. 10.1186/s12889-021-12464-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Umviligihozo G, Mupfumi L, Sonela N, et al. Sub-Saharan Africa preparedness and response to the COVID-19 pandemic: a perspective of early career African scientists. Wellcome Open Res 2020;5:163. 10.12688/wellcomeopenres.16070.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Sattler C, Rommel J, Chen C, et al. Participatory research in times of COVID-19 and beyond: adjusting your methodological toolkits. One Earth 2022;5:62–73. 10.1016/j.oneear.2021.12.006 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.The mobile gender gap report, 2021. Available: https://www.gsma.com/r/gender-gap/
- 48.Alon T, Doepke M, Olmstead-Rumsey J. The impact of COVID-19 on gender equality. National Bureau of Economic Research 2020. [Google Scholar]
- 49.Bonney R, Shirk JL, Phillips TB, et al. Citizen science. next steps for citizen science. Science 2014;343:1436–7. 10.1126/science.1251554 [DOI] [PubMed] [Google Scholar]
- 50.Citizen science project explores causes, solutions to COVID-19 vaccine hesitancy. Available: https://today.uic.edu/citizen-science-project-explores-causes-solutions-to-covid-19-vaccine-hesitancy
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data relevant to the study are included in the article.