Abstract
Nina Finley and co-authors discuss public involvement in planning and reporting medical research.
Summary points
Many scientific research manuscripts are intended for other researchers and not the public. However, the public are involved in research as participants, taxpayers, and patients.
We discuss co-creation and how it can be used to enhance medical research.
Co-creation is an iterative, bidirectional collaboration between researchers and laypeople to create knowledge. This process can broaden public engagement in medical research.
Co-creation is related to theories of crowdsourcing, community-based participatory research, citizen science, and participatory action research.
Public online calls for input, crowdsourcing contests, hackathons, and participatory design sessions are all examples of activities to co-create with the public.
Infographics and videos are two tools that can be used to broaden public engagement in medical research.
How can you make your medical research jump off the page? Every year, 1.7 million peer-reviewed manuscripts are published, and many are never cited or shared [1]. These manuscripts are written by researchers for researchers. Paywalls, dense text, few illustrations, and complicated statistics prevent most of the public from seeing the end products of medical research. Yet the results of biomedical research are meant for the public. People living with diseases and other members of the public are often the ones who join (i.e., as research participants), fund (i.e., as taxpayers), and benefit from (i.e., as patients) medical studies. We propose using co-creation to broaden public engagement on medical research. Co-creation is an iterative, bidirectional collaboration between researchers and laypeople to create knowledge [2]. Public engagement is a mutually beneficial interaction between specialists and nonspecialists [3]. In medical research, public engagement occurs when a layperson reads, understands, and shares a publication. Public engagement could increase the number of people who read and understand medical research publications.
Public engagement benefits many groups. For researchers, public engagement can improve research quality [4], consolidate external support, enhance dissemination of results, expand readership, and boost impact [5]. For laypeople, engagement provides an opportunity to contribute to and learn about processes that affect their health. It gives patients more voice [6] and power [4] and holds researchers accountable to funders and beneficiaries. When done well, public engagement builds trust between researchers and the public. At its best, public engagement can spur systemic change in policy or practice.
Methods
We identified systematic reviews, randomized controlled trials, and observational studies that show how co-creation can be used to enhance public engagement in medical research. We searched three databases using the terms “co-creation,” “public engagement,” and “research manuscript.” The search was initially undertaken January 20, 2019, and updated June 19, 2020. Although we included some theoretical literature related to co-creation, the focus was on applications related to writing research manuscripts. In this narrative opinion piece, we introduce the conventional approach to public engagement and suggest co-creation as a tool to help medical researchers engage the public. As part of the piece, we issued a public online call to solicit feedback on an infographic on June 18, 2019 [7]. An infographic is an image that presents information in a manner easily understood by nonexperts. The open call noted that suggestions would be used to improve the infographic and that compiled open access resources would be shared.
The problem
The conventional approach to public engagement in medical research is one of benign neglect. A systematic review found that patient engagement was feasible in many medical research settings [8]. However, public engagement has generally been limited to the early phases of a study and not the final phases of creating a manuscript [8]. For example, engagement in clinical trials often takes the form of a community advisory board reviewing ways to optimize participant recruitment from the perspective of people living with the disease. While this input is useful for developing studies, it risks lapsing into tokenistic relationships between researchers and community members [8]. Fewer research studies engage the public in later research phases, such as developing a manuscript and sharing findings in a way that could be understood by the public.
Co-creation with the public
Co-creation is an iterative, bidirectional collaboration between researchers and laypeople to create knowledge. We focus on co-creation as it relates to writing medical research manuscripts. Co-creation could include making research results available to the public earlier, in the form of a preprint or other publicly accessible form. Co-creation provides a structured process for broadening public engagement in research. This process is related to several types of engagement models, including crowdsourcing [9], citizen science [10], community-based participatory research [11], youth participatory action research [12], and patient and public involvement [13]. Using co-creation in research introduces several questions about who should be involved, extent of participation, acknowledging and recognizing participation, and related ethical issues [14, 15]. Co-creation approaches include public online calls for input, crowdsourcing contests [15], hackathons [16], and participatory design sessions [17].
Public online calls for input are the simplest co-creation method. Social media platforms such as Facebook and Twitter allow researchers to post drafts of research content (e.g., infographics, preprints, videos) and receive real-time feedback from experts and nonexperts alike. For example, in creating this manuscript, we posted a draft infographic online (Fig 1) in order to solicit public feedback. The message resulted in 2,647 impressions (the number of times a tweet shows up in someone’s timeline) according to Twitter analytics, resulting in helpful feedback that improved the message (Fig 1). In addition, preprints allow the public free access to scientific research.
Crowdsourcing contests (also called innovation challenges, challenge contests, and prize contests) allow a group of individuals to tackle a problem and proposes solutions [9]. Contests have been used to create concepts, images, videos, and songs related to medical research. A recent systematic review identified 188 studies that used crowdsourcing in health and medical research [18]. The steps of conducting a crowdsourcing contest are typically to identify a steering group, solicit ideas from the public online, and select exceptional solutions to use or publish [15]. For example, a Chinese public health group used crowdsourcing to develop a campaign focused on increasing rates of testing for HIV (S1 Fig) [4]. This project had members of the public designing messages, images, and service models that were ultimately implemented in eight cities. Data from randomized controlled trials suggests that crowdsourcing contests are effective in creating sexual health messages [4, 19–21].
Hackathons (also known as hackfests, hack days, or designathons) are brief, sprint-like events in which individuals physically convene to focus on one topic for a short period [16]. Participants, judges, and steering committee members are often members of the public, and expert mentors are available to provide guidance. Although originally focused on developing computer software or hardware, hackathons are now used to spur innovation in both the content [22] and presentation [23] of medical research.
Participatory design sessions are in-person community gatherings organized by researchers. They can be used to brainstorm ideas, understand local perceptions of research, and elicit feedback on how results are presented. A team from Columbia University found that health-related infographics co-created with community members of diverse ages, languages, and health literacy levels were more informative, contextualized, and understandable for readers [17].
Co-creating infographics and videos
Two excellent tools for public engagement are infographics and videos [6, 24]. These complementary tools are commonly accepted at major medical journals and may be useful for engaging public audiences. Infographics are similar to journal figures in that they are compact, data-rich visuals. The difference is that infographics should be easier to read and focus on one key message [25] and can engage people with varying literacy capabilities [17, 26, 27]. Infographics can be created by hand, as in the technique of sketch-noting, or by computer software. The key questions that need to be considered when creating an infographic are the “who, what, why, when, how, and where” of the message (Table 1). The University of Leeds and Public Health England published an open-access guide to creating infographics (S1 Text). This guide provides clear, user-tested advice on how to define the audience, align key components, and arrange visual elements. Infographics can be disseminated in many places: social media, email newsletters, blogs, or the local university bulletin board. A study in Northern Ireland found that patients who viewed an infographic were more likely to understand cancer risk factors than those who read the same information as text [26]. Two small studies suggest that people are more likely to read the abstracts of research articles with infographics than of those without [28, 29]. One Croatian study found that readers of Cochrane systematic reviews interpreted infographic and text summaries with equal accuracy, but enjoyed the infographics more [30].
Table 1. Key questions to answer in preparing an infographic or video related to medical research.
Who? | Who is the intended audience of this infographic/video and what are their visual preferences? |
What? | What is the key message that needs to be conveyed? What can be simplified and what needs to retain complexity? |
Why? | Why should the viewer care about this medical research finding or topic? |
When? | What makes this topic urgent now? Why is now an important time to convey this infographic or video? |
How? | How will this message be delivered to viewers (e.g., print, social media)? |
Where? | Where is the group or groups that you intend to reach (e.g., geographic region, demographic group)? |
Videos have the advantage of reaching some audiences who may not read medical research journals, including individuals for whom English is a second language and those who face socioeconomic barriers [6, 31, 32]. Short videos co-created with the public suggest new ways to empower groups that are underrepresented in research [24, 31, 33]. Video formats include whiteboard time lapses, filmed interviews with investigators, and short animations. Creating a video to explain key research findings does not require specialist training or resources of a professional production, such as a TED Talk (S2 Text). We have developed a guide for how to make a time-lapse video using only a whiteboard, smartphone, and basic video-editing software available on most computers (S3 Text). Researchers in China used a crowdsourcing contest to co-create sexual health videos with the public [20, 34]. The results showed that crowdsourced videos worked equally well or better than videos produced by a commercial social media firm. An example of a co-created video is included (S4 Text).
Co-creation to enhance public engagement has some limitations that should be noted. Sharing of potentially identifiable research data online must adhere to the same guidelines for ensuring patient confidentiality that exist with any identifiable research data. In instances in which identifiable information is shared, specific consent for online sharing is important. Second, infographics and videos will not replace conventional figures and tables in medical research articles. However, they could be a useful adjunct to extend public engagement. Third, there may be disciplines or settings in which the public may not be able or willing to be engaged. For example, research on proprietary materials or potentially traumatic topics (e.g., child maltreatment, female genital mutilation) may be less suitable for public engagement [35].
We encourage researchers to think beyond academic audiences and co-create with the public. What projects are you working on now that could lend themselves to co-creation? Start simple: try sketching an infographic of the results from your latest project and posting it on social media for public feedback. Craft a visual abstract when you submit your next research manuscript. Present your preliminary results to local community partners and incorporate their insights and wisdom; you may be surprised at how much your team and the local partners can gain from this process. The co-creation process can ultimately create greater transparency and accountability in research. Co-creation of research and visual aids can be the difference between a dusty manuscript on the shelf and an article that sparks conversation.
Supporting information
Acknowledgments
We would like to thank the SESH (Social Entrepreneurship to Spur Health) team for administrative support.
Abbreviation
- SESH
Social Entrepreneurship to Spur Health
Funding Statement
This manuscript was supported in part by research grants from the US NIH (NICHD UG3HD096929, NIAID K24AI143471). This work also received support from TDR, the Special Programme for Research and Training in Tropical Diseases co-sponsored by UNICEF, UNDP, the World Bank, and WHO. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
References
- 1.Van Noorden R, Maher B, Nuzzo R. The top 100 papers. Nature. 2014;514:550–3. 10.1038/514550a [DOI] [PubMed] [Google Scholar]
- 2.Greenhalgh T, Jackson C, Shaw S, Janamian T. Achieving Research Impact Through Co-creation in Community-Based Health Services: Literature Review and Case Study. Milbank Q. 2016;94(2):392–429. Epub 2016/06/07. 10.1111/1468-0009.12197 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Jamieson KH. Reconceptualizing public engagement by land-grant university scientists. Proc Natl Acad Sci U S A. 2020;117(6):2734–6. Epub 2020/02/01. 10.1073/pnas.1922395117 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Tang W, Wei C, Cao B, Wu D, Li KT, Lu H, et al. Crowdsourcing to expand HIV testing among men who have sex with men in China: A closed cohort stepped wedge cluster randomized controlled trial. PLoS Med. 2018;15(8):e1002645 Epub 2018/08/29. 10.1371/journal.pmed.1002645 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Lavery JV. Building an evidence base for stakeholder engagement. Science. 2018;361(6402):554–6. Epub 2018/08/11. 10.1126/science.aat8429 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Day S, Mathews A, Blumberg M, Vu T, Rennie S, Tucker JD. Broadening community engagement in clinical research: Designing and assessing a pilot crowdsourcing project to obtain community feedback on an HIV clinical trial. Clin Trials. 2020;17(3):306–13. Epub 2020/02/06. 10.1177/1740774520902741 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Co-creation Twitter Open Call 2019. Available from: https://twitter.com/JosephTucker/status/1140863565576003587.
- 8.Domecq JP, Prutsky G, Elraiyah T, Wang Z, Nabhan M, Shippee N, et al. Patient engagement in research: a systematic review. BMC Health Serv Res. 2014;14:89 Epub 2014/02/27. 10.1186/1472-6963-14-89 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 9.Tucker JD, Day S, Tang W, Bayus B. Crowdsourcing in medical research: concepts and applications. PeerJ 2019;6:e6762. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 10.Follett R, Strezov V. An Analysis of Citizen Science Based Research: Usage and Publication Patterns. PLoS ONE. 2015;10(11):e0143687 Epub 2015/11/26. 10.1371/journal.pone.0143687 PubMed Central PMCID: PMC4658079. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 11.Minkler M, Wallerstein N. Community based participatory research for health. San Francisco, CA: Jossey-Bass; 2003. xxxiii, 490 p. p. [Google Scholar]
- 12.Ozer EJ. Youth-Led Participatory Action Research: Developmental and Equity Perspectives. Adv Child Dev Behav. 2016;50:189–207. 10.1016/bs.acdb.2015.11.006 . [DOI] [PubMed] [Google Scholar]
- 13.Mockford C, Staniszewska S, Griffiths F, Herron-Marx S. The impact of patient and public involvement on UK NHS health care: a systematic review. Int J Qual Health Care. 2012;24(1):28–38. Epub 2011/11/24. 10.1093/intqhc/mzr066 . [DOI] [PubMed] [Google Scholar]
- 14.Tucker JD, Pan SW, Mathews A, Stein G, Bayus B, Rennie S. Crowdsourcing Contests: A Scoping Review on Ethical Concerns And Risk Mitigation Strategies. Journal of Medical Internet Research. 2018. 10.2196/jmir.8226 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.WHO/TDR/SESH/SIHI. Crowdsourcing in Health and Health Research: A Practical Guide. Geneva: WHO/TDR, 2018. Available from: https://www.who.int/tdr/publications/year/2018/crowdsourcing-practical-guide/en/ [Google Scholar]
- 16.Tucker JD, Tang W, Li H, Liu C, Fu R, Tang S, et al. Crowdsourcing Designathon: A New Model for Multisectoral Collaboration. BMJ Innovations. 2018;4:46–50. 10.1136/bmjinnov-2017-000216 [DOI] [Google Scholar]
- 17.Arcia A, Suero-Tejeda N, Bales ME, Merrill JA, Yoon S, Woollen J, et al. Sometimes more is more: iterative participatory design of infographics for engagement of community members with varying levels of health literacy. J Am Med Inform Assoc. 2016;23(1):174–83. Epub 2015/07/16. 10.1093/jamia/ocv079 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Wang C, Han L, Stein G, Day S, Bien-Gund C, Mathews A, et al. Crowdsourcing in Health and Medical Research: A Systematic Review. Infectious Diseases of Poverty. 2020;9:8 10.1186/s40249-020-0622-9 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Tang W, Han L, Best J, Zhang Y, K. M, Kim J, et al. Crowdsourcing HIV Testing: A Pragmatic, Non-Inferiority Randomized Controlled Trial in China. Clinical Infectious Diseases. 2016;62:1436–42. 10.1093/cid/ciw171 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Tang W, Mao J, Liu C, Mollan K, Zhang Y, Tang S, et al. Reimagining Health Communication: A Non-Inferiority Randomized Controlled Trial of Crowdsourced intervention in China. Sex Transm Dis. 2019;46:172–8. Epub 2018/10/27. 10.1097/OLQ.0000000000000930 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Yang F, Zhang TP, Tang W, Ong JJ, Alexander M, Forastiere L, et al. Pay-it-Forward Gonorrhea and Chlamydia Testing Among Men Who Have Sex With Men in China: A Randomized Controlled Trial. Lancet Infect Dis. 2020. 10.1016/S1473-3099(20)30172-9 [DOI] [Google Scholar]
- 22.Ehteshami Bejnordi B, Veta M, Johannes van Diest P, van Ginneken B, Karssemeijer N, Litjens G, et al. Diagnostic Assessment of Deep Learning Algorithms for Detection of Lymph Node Metastases in Women With Breast Cancer. JAMA. 2017;318(22):2199–210. Epub 2017/12/14. 10.1001/jama.2017.14585 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Siefert AL, Cartiera MS, Khalid AN, Nantel MC, Loose CR, Schulam PG, et al. The Yale Center for Biomedical Innovation and Technology (CBIT): One Model to Accelerate Impact From Academic Health Care Innovation. Acad Med. 2019;94(4):528–34. Epub 2018/12/07. 10.1097/ACM.0000000000002542 . [DOI] [PubMed] [Google Scholar]
- 24.Monnard K, Benjamins MR, Hirschtick JL, Castro M, Roesch PT. Co-Creation of Knowledge: A Community-Based Approach to Multilevel Dissemination of Health Information. Health Promot Pract. 2019:1524839919865228. Epub 2019/09/01. 10.1177/1524839919865228 . [DOI] [PubMed] [Google Scholar]
- 25.Tufte ER. The visual display of quantitative information. 2nd ed Cheshire, Conn: Graphics Press; 2001. 197 p. p. [Google Scholar]
- 26.McCrorie AD, Chen JJ, Weller R, McGlade KJ, Donnelly C. Trial of infographics in Northern Ireland (TINI): Preliminary evaluation and results of a randomized controlled trial comparing infographics with text. Cogent Med. 2018;5(1):1483591 Epub 2018/06/26. 10.1080/2331205X.2018.1483591 ; PubMed Central PMCID: PMC6002148. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 27.Olfert MD, Hagedorn RL, Barr ML, Famodu OA, Rubino JM, White JA. eB4CAST: An Evidence-Based Tool to Promote Dissemination and Implementation in Community-Based, Public Health Research. Int J Environ Res Public Health. 2018;15(10). Epub 2018/10/03. 10.3390/ijerph15102142 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 28.Thoma B, Murray H, Huang SYM, Milne WK, Martin LJ, Bond CM, et al. The impact of social media promotion with infographics and podcasts on research dissemination and readership. CJEM. 2018;20(2):300–6. Epub 2017/09/14. 10.1017/cem.2017.394 . [DOI] [PubMed] [Google Scholar]
- 29.Ibrahim AM, Lillemoe KD, Klingensmith ME, Dimick JB. Visual Abstracts to Disseminate Research on Social Media: A Prospective, Case-control Crossover Study. Ann Surg. 2017;266(6):e46–e8. Epub 2017/04/28. 10.1097/SLA.0000000000002277 . [DOI] [PubMed] [Google Scholar]
- 30.Buljan I, Malicki M, Wager E, Puljak L, Hren D, Kellie F, et al. No difference in knowledge obtained from infographic or plain language summary of a Cochrane systematic review: three randomized controlled trials. J Clin Epidemiol. 2018;97:86–94. Epub 2017/12/23. 10.1016/j.jclinepi.2017.12.003 [DOI] [PubMed] [Google Scholar]
- 31.Day S, Mathews A, Blumberg M, Vu T, Mason H, Rennie S, et al. Expanding community engagement in HIV clinical trials: a pilot study using crowdsourcing. AIDS. 2020;34(8):1195–204. Epub 2020/04/15. 10.1097/QAD.0000000000002534 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 32.Tremblay C, Jayme B. Community knowledge co-creation through participatory video. Action Research. 2015;13:298–314. [Google Scholar]
- 33.Mansson L, Wiklund M, Öhberg F, Danielsson K, Sandlund M. Co-Creation with Older Adults to Improve User-Experience of a Smartphone Self-Test Application to Assess Balance Function. Int J Environ Res Public Health. 2020;17(11). Epub 2020/05/30. 10.3390/ijerph17113768 . [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Fitzpatrick T, Zhou K, Cheng Y, Chan PL, Cui F, Tang W, et al. A crowdsourced intervention to promote hepatitis B and C testing among men who have sex with men in China: study protocol for a nationwide online randomized controlled trial. BMC Infect Dis. 2018;18(1):489 Epub 2018/10/01. 10.1186/s12879-018-3403-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 35.Dickson D. The need to increase public engagement in science 2004. Available from: https://www.scidev.net/global/communication/editorials/the-need-to-increase-public-engagement-in-science.html?__cf_chl_jschl_tk__=6fb23dda2889bed96cb04f1604216c57d6dd69ff-1592548682-0-AeDil9K3LM_B1wduRK9x1-1NbDDvkEK8GYBdWH0NSYwdizOzJ4xetI5CP6KC28iBj6dZmOZSo6yqvgoK0JEWx-DUFSdhzFpnix1B1ed4sA7sPbUkLXl8qiFah0XKLY22OMJIkommhJXqSC2KD24835cXgH7N77oCM5sbeTfTkulDp_usS-A1-viVASliZ_L5Gcs87TBRsVr54P0IecRq0XJWz5w5BMxsHqhWzmFq_L8-4XWa6GYQvxDRRbkD59uDo5mWA3L11k-JPNQl9WKRl18ZwS7ckS3TDqEWc6M86PqKxr2PgS1OKe1SzkwDpEMozP1EkwEuwUgQOEDZRO7H7kugOZSSIU_X7eZuscJGhSdHz32SZ99mdPimqCSDMosWu4inepw5iscmM5vKEP6Qduc.
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.