Skip to main content
Acta Informatica Medica logoLink to Acta Informatica Medica
. 2019 Dec;27(5):348–354. doi: 10.5455/aim.2019.27.348-354

Disseminating Research Outputs: The CrowdHEALTH Project

Andriana Magdalinou 1, John Mantas 1, Lydia Montandon 2, Patrick Weber 1, Parisis Gallos 1
PMCID: PMC7085311  PMID: 32210503

Abstract

Introduction:

Dissemination benefits come from the outputs integration and implementation by the key audience, who will also determine the relevance and usability of the disseminated content.

Aim:

One of the CrowdHEALTH project’s objectives is the transition from patient health records towards the Holistic Health Records (HHRs) and Social HHR. The CrowdHEALTH project aims at integrating high volumes of health-related data collected from various sources to support policy-making decisions.

Methods:

The European Federation for Medical Informatics (EFMI) supports the development of an effective Communication and Collaboration Plan identifying the messages, the tools and channels in disseminating the project and its outcomes to the target audience based on the McGuire approach.

Results:

The process for defining the dissemination strategy is a cyclic one as shown in the following figure involving review of each step periodically The next step was to define the four dimension dissemination approach based on McGuire attributes of persuasive communication. The objectives, target groups, key messages, the tools and channels where defined at this stage.

Conclusion:

The CrowdHEALTH project and its outcomes were disseminated with a variety of tools and channels such as scientific journals, conferences, exhibitions and social media communication.

Keywords: Knowledge Dissemination, Diffusion

1. INTRODUCTION

CrowdHEALTH is an European Union (EU) funded project which offers an integrated platform that incorporates big data management mechanisms for data acquisition, cleaning, integration, modeling, analysis, information extraction, interpretation and visualization (1). More precisely, these mechanisms can be clustered across three main domains: (i) extended health records, (ii) collective health knowledge and (iii) big data techniques (2). CrowdHEALTH project aims at disseminating research outputs to the key groups (3). For this reason, the dissemination strategy wasdeveloped, implemented and presented in this article.

1.1. Dissemination theories

Dissemination benefits come from the outputs integration and implementation by the key audience, who will also determine the relevance and usability of the disseminated content. Therefore, target groups need to be considered early in the process of carrying out the research, the outputs of which they might use (4). According to a systematic scoping review of conceptual frameworks, twenty out of thirty-three frameworks were created in order to be used by researchers in an attempt to guide their dissemination plans and activities. Twenty-eight frameworks were influenced by one or more of the following different theoretical approaches, the persuasive communication, the diffusion of innovations theory, social marketing (5) and community organization model (6). William J. McGuire was one of the first in perceiving and explaining how mass media messages convince people (7). His communication/persuasion matrix (8) is one of the step-based models of persuasion. In more detail, it was proposed that persuasion is the result of a successful transition among different phases. The model defines inputs and outputs: the inputs are the different aspects of the persuasion attempts and outputs are the phases of persuasion, each of which can be measured. According to McGuire there are five inputs: The Source which is about the trustworthiness of the sender, the Message which covers the type, strength and language of the argument, the Channel which is the means of the message communication, the Receiver who belongs to the target group and has a specific attitude, beliefs, prior knowledge and habits and the Context including all the environmental factors that can influence positively or negatively the communication process. A number of versions of his model with varying number of steps was proposed, with the widely known six steps version including the exposure, attention, comprehension, yielding, retention, and behavior (9).

As far as the diffusion of innovations is concerned, literature presents a number of topics associated with the innovation diffusion theory such as needs, selective exposure, institutional/structural thresholds and personal thresholds. Hassinger (10) stated that actors’ need for an innovation is a prerequisite when seeking information to improve their awareness. If actors do not have a need for innovation then they won’t engage in awareness and influence processes. Selective exposure was used by Rogers (11) when discussing the actors’ agency in awareness and influence processes, suggesting that actors would avoid messages that are in conflict with their personal beliefs. However, actors’ perceptions can be influenced by the environment, their social networks and institutional and organizational forces. Hence, actors avoiding innovations is a more complex concept than Hassinger and Rogers initially suggested, especially if these innovations are supported by the contextual framework. Today, the expansion of social networks, the plethora of communicated messages through various forms of media and the advertising dynamics play an important role in shaping actor’s tendencies and needs (12). Such arguments align with the notions of ‘system thresholds’ (13) ‘structural equivalence’ (14) and even ‘groupthink’ (15) when considering the innovation diffusion process.

Another dissemination model found in literature is the social marketing theory of dissemination, which uses a consumer-oriented approach. Social marketing as defined by Kotler and Zaltman (16) implements marketing principles to influence a key audience to actively accept, reject, modify, or abandon a behavior. The social marketing model applies marketing principles to promote positive public health behaviors. The Core elements are based on product, price, place, and promotion. One of the lessons learned from social marketing campaigns is that message-based communication of knowledge alone is unlikely to lead to a long-term behavior change (17). According to Martin et al. (18) the four phases include the market analysis, the market segmentation, the market strategy and the evaluation. The market analysis phase involves which involves intensive participation of the individuals who will be involved in the dissemination. In this phase, the use of focus groups, surveys, and advisory boards are recommended. Themarket segmentation phase includes determining the domain into which the innovation should be introduced. The market strategy phase is concerned with the planning of the dissemination activities and with implementing the plan in a way that the communication strategies and techniques for a specific innovation are appropriate for the target audience. During this phase, an extended Kotler and Zaltman model (16) with six core-items: product, price, promotion, place, politics, and public opinion was introduced by Martin (18). Finally, the evaluation phase consists of the evaluation of the effectiveness of the innovation, as well as of clinician and client satisfaction with the innovation (6).

A last dissemination theory is the community organization model (19) which was developed for health promotion in the community setting. The theory has common ground with the diffusion and social marketing models, particularly in its evaluation phase, which focuses on assessing the resources, attitudes, and readiness for acceptance of the community. The model also incorporates adesign and implementation phase in which planning groups and organizational structures are identified, an implementation phase in which work plans are developed, implemented and monitored, a program maintenance phase in which the interventions are set into the community gaining a positive organizational climate and a dissemination and reassessment phase in which the effectiveness is assessed and the results are promoted (6).

1.2. Measuring impact

Different indicators to measure dissemination impact are used for practitioners, policy makers, academics/scientists and the general public. Journal metrics, for example Journal Impact Factor and h5-index, author metrics such as h-index or i10-index and article metrics as for instance the number of journal citations, article downloads, or views on academic social media sites are the most common indicators used for researchers and academics (19-21). However, the journal and author metrics outlined above have been criticized as a poor measure of quality or scientific impact (21) while others claim that downloads may be an additional way to measure research dissemination impact apart from the citations (22). Furthermore, none of the traditional metrics assess the dissemination of research to policymakers, the practice community, or the general public. As a result, researchers and publishers have turned to alternative metrics as for example the Altmetric score (23). Altmetric collects mentions in blogs and traditional online media, forums and discussion sites, social media such as Twitter and Facebook, and policy documents. Alternative metrics open a window for the opportunity to measure dissemination impact on other groups that are closer to implement the findings and transform them into policy and practice. However, up until now none of the alternative metric aggregating services are comprehensive (17). Other metrics that can be used in social media are insights, exposure, reach, and engagement. Insights refer to consumer feedback from social media applications that can be derived from practices such as sentiment analysis or data mining algorithms to extract consumer attitudes and other perspectives on a particular topic from social media pages. Exposure refers to the impressions or number of views of the content in a social media page and reach is the number of people who have contact with the social media application. Engagement is a metric that represents action on the content and can range from low to medium to high (21).

2. AIM

One of the CrowdHEALTH project’s objectives is the transition from patient health records towards the Holistic Health Records (HHRs) and Social HHR. CrowdHEALTH aims at integrating high volumes of health-related data collected from various sources to support policymaking decisions.

3. METHODS

The Dissemination strategy is defined through a cyclic process consisting of five components linked together. The development of the Collaboration and Communication plan was influenced by McGuire’s persuasive communication approach consisting of four pillars: the dissemination objective, the message to be communicated, the tools and channels of communication, and the target audience.

4. RESULTS

The The process for defining the dissemination strategy is a cyclic one as shown in the following figure involving a review of each step periodically (Figure 1). The first step for defining the dissemination strategy was to review relevant literature (17, 21, 24-26) and past or ongoing dissemination plans. Based on other public dissemination and communication deliverables of H2020 projects (27-30) the most common high impact dissemination activities and tools (31, 32) were the use of digital media (website, blog, social media), printed and digital materials (Flyers, Demos), publications in scientific journals, participation in exhibitions and conferences with oral presentations, posters and workshops and participation in initiatives with other EU projects to foster synergies. After reviewing the available resources, it was considered when the dissemination activitiesshould take place. For this reason it was prudent to identify and plan critical time points, consider external influences for direct feedback (creation of an Impact Creation Board consistingof experts in academia and industry), identify supporting groups (ex. EFMI working groups), and utilize existing opportunities such as upcoming conferences, other events and exhibitions. Building momentum throughout the entire project life-cycle was a point of departure, for example timings for sharing findings. The next step was to define the four-dimension dissemination approach based on McGuire attributes of persuasive communication (7). The objectives, target groups, key messages, the tools and channels where defined at this stage (33) (Figure 2).

Figure 1. Steps in Developing the dissemination strategy.

Figure 1.

Figure 2. Four dimensions of the Dissemination Strategy.

Figure 2.

4.1. The objectives

The main objective is to engage and inform the target audience (European Institutions, public bodies, broad business, research and medical communities, hospitals, and general public) about the CrowdHEALTH project and its outcomes (34). All efforts take the following into account: a) Assuring a strong cooperation among the consortium partners to guarantee an efficient communication inside the project and facilitate interaction with external stakeholders. b) Ensuring timely and appropriate communication of the research activities and outputs to industrial communities, including customers and business partners. c) Interacting with EU initiatives and other European funded projects to foster synergies. d) Establishing links for feedback in order to enrich the project content and its dissemination.

4.2. The target groups

The identified target groups are the Stakeholders who have a vested interest in the project or will be affected by its outcomes (relevant institutions, organizations, and individuals). CrowdHEALTH addresses a wide audience from various fields such as academia, research community, industry, EU institutions, healthcare sector, public bodies and general public. Each target group is addressed appropriately using different approaches: technical, pedagogical, commercial and political language is used according todifferent groups.

4.3. The Key messages

Key messages for big data analytics solutions, the development of extended health records and efficient policymaking in Europe is disseminated during the lifetime of the project. More precisely:

  • Solutions for innovative approaches and technologies in the field of data aggregation and exchange. In more detail, information on research and innovation activities (implemented by the project) and project results are provided. Regarding the scientific community, this system helps to studynon-homogeneous datasets. CrowdHEALTH is delivering a secure Information and Communication Technology (ICT) platform that seamlessly integrates Big Data technologies, providing Data as a Service (DaaS) and a Data Analysis Toolkit.

  • Benefits regarding the transition to HHR and Social HHR. During the project general awareness is raised about the benefits of the HHR and Social HHR. It captures both health-related facts (such as clinical data, diagnoses, medication, genomics, etc.) and additional information such as nutrition, lifestyle, environmental conditions, sensors information (home or wearables), or social information. This provides the ground for personalized medicine, disease prevention, and effectively leading to a reduction in readmission rates.

  • Efficient policy making across domains takes into consideration collective knowledge that emerges from multiple information sources fromusing Policy Development Toolkit.

4.4. The Dissemination channels and tools

Digital visibility is considered an efficient and reasonable way to publisizethe project and its results. For this reason, the first step was to design the official website with a Blog that includes abstracts of the public deliverables and tasks related to CrowdHEALTH project. CrowdHEALTH is promoted in exhibitions with flyers, demos and technical presentations and in external events and conferences with posters, presentations and workshops as the main participation techniques. Conferences are carefully selected to match the needs of the CrowdHEALTH project. The most relevant conferences are related to Policy making, Data management and Public Health. Publications to scientific journals are also proposed in order to enhance the dissemination of the project results to the scientific community in order to influence researchers and get feedback from peer review. Articles to newspapers and e-magazines were also promoted in order to engage an audience consisting of policymakers, professionals and the general public.

The final phase recommends monitoring the Key Performance Indicators (KPIs) in order to assess performance ofdissemination activities and readjust the strategy if there are any failures or to enhance the plan accordingly should success occur. In order to measure the impact, social media metrics such as shares, likes, insights, exposure, reach and engagement were monitored. Website metrics such as visits, visitors, hits and Search Engine Results Page (SERP) were also monitored to identify dissemination efficiency. Also conference and exhibition participations (number of visitors) were also measured and Article submissions in peer-reviewed journals and citations were recorded.

5. CONCLUSIONS

The CrowdHEALTH project is tackling a number of current trends in health informatics (35) that may influence health care delivery (36), health care professionals (37) and health sciences education (38-41). It is important that the target audience is addressed through appropriate means in order to be informed about the progress of the project and to raise their awareness about the project and its deliverable outcomes. The CrowdHEALTH project implemented a process for defining the dissemination strategy consisting of five steps in an attempt to better communicate the project’s findings. On the basis of McGuire’s approach the four pillars of the dissemination strategy were described: defining the dissemination objective, the message to be communicated, the tools and channels of communication and the target audience.. Scientific journals, conferences and exhibitions remain the core traditional means of disseminating research, although social media has become an important channel for disseminating research in CrowdHEALTH project. Each applied tool has different assets and drawbacks in reaching the audience and therefore by using more than one, the tools complement one another. Key performance indicators are also identified to measure impact in order to evaluate the dissemination activities and readjust plans if needed.

Acknowledgement:

CrowdHEALTH project is co-funded by the Horizon 2020 Programme of the European Commission Grant Agreement number: 727560 – Collective wisdom driving public health policies.

Author’s contribution:

Each author gave substantial contribution in acquisition, analysis and data interpretation. Each author had a part in preparing article for drafting and revising it critically for important intellectual content. Each author gave final approval of the version to be published and agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.

Conflict of interest:

None declared.

graphic file with name AIM-27-348-g003.jpg

REFERENCES

  • 1.Gallos P, Aso S, Autexier S, Brotons A, De Nigro A, Jurak G, et al. CrowdHEALTH: Big Data Analytics and Holistic Health Records. Stud Health Technol Inform. 2019;258:255–256. [PubMed] [Google Scholar]
  • 2.Kyriazis D, Autexier S, Brondino I, Boniface M, Donat L, Engen V, et al. CrowdHEALTH: Holistic Health Records and Big Data Analytics for Health Policy Making and Personalized Health. Stud Health Technol Inform. 2017:19–23. Magdalinou A, Mantas J, Gallos P, Montandon L. Disseminating research findings. The CrowdHealth paradigm. Stud Health Technol Inform. 2019; 264: 1542-1543. doi: 10.3233/SHTI190525. [PubMed] [Google Scholar]
  • 3.Green L, Ottoson J, Garcia C, Hiatt R. Diffusion Theory and knowledge dissemination, utilization and Integration in public health. Annu. Rev. Public Health. 2009;30:151–174. doi: 10.1146/annurev.publhealth.031308.100049. [DOI] [PubMed] [Google Scholar]
  • 4.Wilson P, Petticrew M, Calnan M, Nazareth I. Disseminating research findings: What should researchers do? A systematic scoping review for conceptual frameworks. Implementation Science. 2010;5(91) doi: 10.1186/1748-5908-5-91. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Stirman S, Crits-Christoph P, DeRubeis R. Achieving Successful Dissemination of Empirically Supported Psychotherapies: A Synthesis of Dissemination. Theory Clinical Psychology: Science and Practice. 2006;11(4) doi: 10.1093/clipsy/bph091. [DOI] [Google Scholar]
  • 6.McGuire W. Input and Output variables currenty promising for constructing persuasive communications. Public communications campaigns. 2001:22–48. [Google Scholar]
  • 7.McGuire WJ. The communication/persuasion matrix. In: Lipstein B, McGuire W.J, editors. Evaluating advertising: A bibliography of the communication process. New York Advertising Research Foundation; 1978. [Google Scholar]
  • 8.Cole DN, Hammond TP, McCool SF. Information Quantity and Communication Effectiveness: Low-Impact Messages on Wilderness Trailside Bulletin Boards. Leisure Sciences, Taylor & Francis. 1997 [Google Scholar]
  • 9.Hassinger E. Stages in the adoption process. Rural Sociology. 1959;24:52–53. [Google Scholar]
  • 10.Rogers EM. Diffusion of Innovations. Fifth. New York: Free Press; 2003. [Google Scholar]
  • 11.Larsen G. Understanding the early stages of the innovation diffusion process: awareness, influence and communication networks. Construction Management and Economics. 2011;29(10):987–1002. doi: 10.1080/01446193.2011.619994. [DOI] [Google Scholar]
  • 12.Valente T. Network Models of the Diffusion of Innovations. Computational and Mathematical Organization Theory. 1995;2(2):163–164. [Google Scholar]
  • 13.Burt Reischauer G. (1982): Toward a Structural Theory of Action. Schlüsselwerke der Netzwerkforschung. 2019. pp. 87–90. [DOI]
  • 14.Hart P, Irving L. Janis’ Victims of Groupthink. International Society of Political Psychology. 1991;12(2):247–278. doi: 10.2307/3791464. [DOI] [Google Scholar]
  • 15.Kotler P, Zaltman G. Social Marketing: An Approach to Planned Social Change. Journal of Marketing. 1971;35(3):3–12. doi: 10.2307/1249783. [DOI] [PubMed] [Google Scholar]
  • 16.Brownson R, Eyler A, Harris JK, Moore JB, Tabak RG. Getting the Word Out: New Approaches for Disseminating Public Health Science. J Public Health Manag Pract. 2018;24(2):102–111. doi: 10.1097/PHH.0000000000000673. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Martin B. The evolution of science policy and innovation studies. Research Policy. 2012;41:1219–1239. doi: 10.1016/j.respol.2012.03.012. [DOI] [Google Scholar]
  • 18.Bracht N. Health promotion at the community. USA: SAGE publications; 1999. pp. 29–45. [Google Scholar]
  • 19.Masic I. Medical Publication and Scientometrics. Journal of Research in Medical Sciences. 2013 Jun;18(6):624–630. [PMC free article] [PubMed] [Google Scholar]
  • 20.Masic I, Begic E. Scientometric Dilemma: Is H-index Adequate for Scientific Validity of Academic Work? Acta Inform Med. 2016 Aug;24(4):228–232. doi: 10.5455/aim.24.228-232. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Masic I, Begic E. Meta-Analysis as Statistical and Analytical Method of Journal’s Content Scientific Evaluation. Acta Inform Med. 2015 Feb;23(1):4–11. doi: 10.5455/aim.2015.23.4-11. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 22.Trueger S, Thoma B, Hsu C H, Sullivan D, Peters L, Lin M. The Altmetric Score: A New Measure for Article-Level Dissemination and Impact. UC San Francisco Previously Published Works. 2015 doi: 10.1016/j.annemergmed.2015.04.022. [DOI] [PubMed] [Google Scholar]
  • 23.World Health Organization. Disseminating the research findings. Geneva, Switzerland: WHO Document Production Services; [Google Scholar]
  • 24.European Commission. Social media guide for EU funded R&I projects. 2018.
  • 25.Ward V, House A, Hamer S. Developing a framework for transferring knowledge into action: a thematic analysis of the literature. J Health Serv Res Policy. 2009:156–164. doi: 10.1258/jhsrp.2009.008120. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Riley L, Jahn M, Chesi V, Ring S, Bagger B, Shiraishi J, et al. D.12.1 Communication and Dissemination Strategy. MONICA consortium. 2017 [Google Scholar]
  • 27.Barcelona M, Garcia L, Di Bona S, Guerri D, Tonellotto N, Herbold S, et al. Deliverable D9.1 Dissemination plan. MIDAS project consortium. 2013 [Google Scholar]
  • 28.Zalavra V, Belkacem K, Wandhoefer T, Allen B, Talantsev A, Larrson A. D.8.4 Dissemination plan. Sense4us Project consortium. 2014 [Google Scholar]
  • 29.Boile M, Sifacaki E, Toli E. Deliverable 2.1 Dissemination plan. OpenUp project consortium. 2016 [Google Scholar]
  • 30.Ryan G, Sfar-Gandoura H. Disseminating research information through Facebook and Twitter (DRIFT): Presenting an evidence-based framework. Nurse Reasearcher. 2018 doi: 10.7748/nr.2018.e1562. [DOI] [PubMed] [Google Scholar]
  • 31.Nicholas D, Rowlands I. Social media use in the research workflow. Information Services & Use. 2011:61–63. [Google Scholar]
  • 32.Lafrenière D, Menuz V, Hurlimann T, Godard B. Knowledge Dissemination Interventions: A Literature Review. SAGE Open. 2013:1–14. doi: 10.1177/2158244013498242. [DOI] [Google Scholar]
  • 33.Magdalinou A, Mantas J. D.7.7 Communication and Collaboration plan and activities. 2018. Available at: https://ec.europa.eu/research/participants/documents/downloadPublic?documentIds=080166e-5b8ec7594&appId=PPGMS.
  • 34.Mantas J. Future trends in Health Informatics – the – oretical and practical. Studies in health technology and informatics. 2004;109:114–127. [PubMed] [Google Scholar]
  • 35.Liaskos J, Frigas A, Antypas K, Zikos D, Diomidous M, Mantas J. Promoting interprofessional education in health sector within the European Interprofessional Education Network. International Journal of Medical Informatics. 2009;78:S43–S47. doi: 10.1016/j.ijmedinf.2008.08.001. [DOI] [PubMed] [Google Scholar]
  • 36.Plati C, Lemonidou C, Katostaras T, Mantas J, Lanara V. Nursing manpower development and strategic planning in Greece. Image: the Journal of Nursing Scholarship. 1998;30(4):329–333. doi: 10.1111/j.1547-5069.1998.tb01328.x. [DOI] [PubMed] [Google Scholar]
  • 37.Mantas J. Developing curriculum in nursing informatics in Europe. International journal of medical informatics. 1998;50(1-3):123–132. doi: 10.1016/s1386-5056(98)00059-8. [DOI] [PubMed] [Google Scholar]
  • 38.Hasman A, Mantas J. IMIA accreditation of health informatics programs. Healthcare informatics research. 2013;19(3):154–161. doi: 10.4258/hir.2013.19.3.154. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 39.Fiorini AR, Masic I. Managing Information in Medical Informatics. Acta Inrom Med. 2017 Sep;25(3):192–5. doi: 10.5455/aim.2017.25.192-195. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Masic I. Tele-education as a new method of medical education and Public Health education. In: Zaletel-Kragelj Lj, Bozikov J., editors. Methods and Tools in Public health. Lage: Hans Jacobs Publishing Company; 2010. pp. 959–974. [Google Scholar]
  • 41.Masic I, Ridjanovic Z, Pandza H, Masic Z. Medical informatics. Avicena: 2010. p. 544. ISBN: 978-9958-720-39-0. [Google Scholar]

Articles from Acta Informatica Medica are provided here courtesy of Academy of Medical Sciences of Bosnia and Herzegovina, Sarajevo, Bosnia and Herzegovina

RESOURCES