Skip to main content
Open Research Europe logoLink to Open Research Europe
. 2023 Nov 24;2:107. Originally published 2022 Sep 5. [Version 2] doi: 10.12688/openreseurope.15024.2

Developing the University of Tartu in Estonia into a well-networked Patient Safety Research Centre (PATSAFE): A study protocol

Kaja PÕLLUSTE 1,a, Hiske Calsbeek 2, Carola Orrego 3,4,5,6, Marta Ballester 3,4,5,6, Rosa Suñol 3,4,5,6, Helena Vall-Roqué 3,4,5,6, Mari Kangasniemi 7,8, Siim Läänelaid 1, Joel Starkopf 1,9, Anne van Tuijl 2, Hub Wollersheim 2, Tiina Freimann 1,10, Liisi Mägi 1, Joaquim Bañeres 3,4,5,6, María del Mar Fernández-Maillo 3,4,5,6, Yvette Emond 2, Margus Lember 1,9
PMCID: PMC11195608  PMID: 38915310

Version Changes

Revised. Amendments from Version 1

This revised version is shorter, with an explanation of the term "soft skills" and a reference to the source of the definition. The subsection describing the impact of the project has also been revised and reworded.

Abstract

Background

Patient safety (PS) is a serious global public health problem affecting all countries. Estimates show that around 10 percent of the patients are harmed during hospital care, resulting in 23 million disability-adjusted life years lost per year. Experts emphasize research advancements as a key precondition for safer care.

Aim

The Patient Safety Research Centre (PATSAFE) project enhances the Institute of Clinical Medicine of the University of Tartu’s (ICM-UT) research potential and capacities in PS in order to improve and strengthen knowledge and skills in methods, techniques and experience for PS research.

Methods

A strategic partnership with Avedis Donabedian Research Institute in Spain, and IQ Healthcare in the Netherlands, both international leaders in PS research, enables the development of a long-lasting knowledge exchange, allowing the ICM-UT to capitalise on its current achievements and to overcome gaps in scientific excellence in the field of PS research. These twining activities will strengthen and raise the research profile of the ICM-UT academic staff and early-stage researchers (ESRs), by implementing the hands-on training on methods, techniques, and experience in PS research. The project also encourages the active participation of ESRs in PS research by increasing their soft skills, to ensure the continuity and sustainability of PS research in ICM-UT. Finally, development of the research strategy on PS contributes to the long-term sustainability of PS research in Estonia. To implement these activities, PATSAFE foresees a comprehensive strategy consisting of knowledge exchange, soft research skills capacity building, strategic planning, and strong dissemination and exploitation efforts.

Expected results

As a result of the project, ICM-UT will have the capacity to carry out PS research using the appropriate methodology and the competences to apply state-of-the-art evidence-based strategies for PS research.

Keywords: Patient safety, research competences, early-stage researchers, research strategy, knowledge exchange.

Introduction

Patient safety (PS) represents a serious global public health problem which affects all countries worldwide. Estimates show that there are 421 million hospitalisations in the world annually, and approximately 42.7 million adverse events, i.e., one in 10 patients is harmed while receiving hospital care. These adverse events result in 23 million disability-adjusted life years lost per year, thus, adverse events due to clinical care could be considered a relevant source of morbidity and mortality globally 1 .

The publication of ‘To Err is Human’ 2 by the American Institute of Medicine in 2000 helped launch the field of PS: an issue of growing professional awareness was converted to one of public concern. Shortly after this report, PS research became an international priority 3 .

Research is an essential cornerstone for tackling the alarming situation in PS, and a key precondition for safer care. As well as helping to understand the magnitude and nature of patient harm and focus on critical improvement areas, it also contributes to devising evidence-based strategies and evaluating the effectiveness of potential solutions. Thus, using different research methods and approaches, research initiatives in PS focus on three different stages: identification of risks and hazards; design, implementation, and evaluation of PS practices; and maintaining a safe environment and PS culture 4 .

In 2008, WHO Patient Safety published the global priorities for PS research 5 , followed by a set of core competencies for PS research 6 , and a guide for developing training programmes in PS research 7 . To complement the WHO’s PS initiatives, in June 2009 the Council of the European Union (EU) published recommendations on PS 8 , calling on Member States to support the establishment and development of national policies and programmes on PS, and develop and promote research on PS. Moreover, the most recent definition of patient safety refers to the importance of an evidence-based approach: “Patient safety is a framework of organized activities that creates cultures, processes, procedures, behaviours, technologies, and environments in health care that consistently and sustainably: lower risks, reduce the occurrence of avoidable harm, make error less likely and reduce its impact when it does occur.” 9

Provision of safe and high-quality health services was one of the priorities in the National Health Plan of Estonia 2009–2020 10 , and the importance of PS in the Estonian health system is also significantly emphasized in the National Health Plan 2021–2030 11 . Quality efforts started in Estonia in the second half of the 1990s with a focus on patients and professionals’ satisfaction. A motive for the further development was the Quality Policy for Estonian Health Care, which was published in 1998 12 . In 2002, a set of legislative acts came into force supporting the further development of healthcare quality – basic requirements for the quality and accessibility of health services, minimum standards for health care staff, equipment and rooms to establish the quality of the structure, and some procedural requirements. To adjust to these requirements, most health organizations have introduced and continually developed quality management systems. In general, a lot of attention has been paid to organizational management, occupational safety, and risk management in working environments, and to the patient-centred approach: assessment and documentation of patient health risks, and the implementation of patient satisfaction surveys and complaint management 13, 14 . However, as suggested by World Bank experts in 2015 15 “a much more fundamental change may be needed in Estonia to create a culture that is open to acknowledging errors and failures, and willing to make the necessary modifications in practice to achieve quality improvement.” Technological improvements alone, without this fundamental behavioural change, will do very little to assure and improve quality. This kind of change could be achieved if healthcare professionals are well trained in the principles of performance measurement, quality improvement, and especially in PS and risk management that are specific to their practice specialties. Research on PS and implementation of evidence-based approaches will be key to enhance clinicians’ interest and involvement and can also make a difference in practical health care.

Even though the Estonian PS strategy is still not formulated at the national level, a number of initiatives dealing with PS have already been launched, e.g., incident reporting systems in hospitals and pilot record reviews 16 . Still, there are no common standards for incident reporting in Estonia, and the collected information is hardly methodically analysed and used for safety improvement. Successful implementation of planned initiatives will require evidence-based information about PS events to assess the existing situation, identify risks to patients, and find the most effective solutions to improve PS and safety culture in general. Therefore, development of research capacity is envisaged as the key driver for enhancing Estonia’s capacity to develop PS.

The Faculty of Medicine of the University of Tartu is Estonia’s only medical school. Within the Faculty, the Institute of Clinical Medicine (ICM-UT) is responsible for most of the clinical subjects of the Medicine programmes (except family medicine and dentistry) and has a leading role in clinical research. Currently, research on health care quality and safety covers a variety of topics, including nosocomial infections, antibiotic usage and resistance, complications in surgery and anaesthesiology, and health outcomes. Moreover, the ICM-UT has experience in the research of quality of care from patient perspectives as well as on the system and provider levels. PS research is currently in an early stage, but due to its position in Estonian health care, the ICM-UT is expected to have a leading role in this research area. ICM-UT offers excellent opportunities for research and innovation in PS because of its unique position in Estonia, although taking advantage of these opportunities is currently hindered by gaps in scientific excellence in the fields of specific methods and techniques for PS research.

We started the preparatory work for the Patient Safety Research Centre (PATSAFE) project by conducting a thorough SWOT analysis to identify the gaps in the scientific excellence in PS research methodology at ICM-UT. The SWOT analysis ( Table 1) demonstrated that ICM-UT has high scientific excellence in clinical research methodology and good collaboration with stakeholders (providers of health services, the health ministry, and national health insurance), but that its knowledge in PS research methodology should be improved. Moreover, the intensity of networking in PS between the researchers and providers of health services, as well as motivation among practicing clinicians and health care managers to support PS research needed to be strengthened.

Table 1. SWOT analysis – identification of gaps in scientific excellence at Institute of Clinical Medicine of the University of Tartu (ICM-UT).

Strengths Weaknesses
1. Unique position of ICM-UT in the Estonian medical
education and research system.
2. Multidisciplinary early-stage and experienced research staff
with excellent clinical competence.
3. Scientific excellence in clinical research methodology,
internationally known and experienced researchers.
4. Excellent new infrastructure.
5. Positive attitude from the leading staff of the faculty and
institute.
6. Close collaboration with the two leading hospitals – Tartu
University Hospital and North Estonia Medical Centre as well
with professional associations.
7. Innovative eHealth environment of Estonia.
1. Limited knowledge and skills in patient safety research
methodology.
2. Lack of international visibility in the field of patient safety research.
3. Limited number of medical doctors and nurses who have enough
knowledge and skills in patient safety research.
4. Scepticism towards the patient safety research and data collection
about the risks and hazards of patient safety among practicing
clinicians.
5. Low involvement of patients in health care safety research.
Opportunities Threats
1. Well-trained early-stage researchers willing to contribute to
patient safety research.
2. Variety of knowledge and expertise existing in the EU and
globally.
3. Close collaboration with and support from the Ministry of
Social Affairs and National Health Insurance Fund.
4. Alignment with EC recommendation (2009/C 151/01).
5. High quality health services and patient safety are priorities
of the national health strategy.
6. Needs of society (pressure from patients).
7. Unique possibility to link the national eHealth system and
data about the risks and hazards of patient safety.
1. Insufficient funding to further develop existing research
competence and strengthen the collaboration between scientists and
the medical community.
2. Insufficient/unfavourable legislative framework for the
implementation of patient safety research in practice.
3. Poor safety culture and resistance from practicing physicians and
nurses concerning risk and hazard data collection.

Considering the SWOT analysis, we designed the PATSAFE project to improve and strengthen the ICM-UT’s research excellence in the field of PS research among early-stage researchers (ESRs) and academic staff. We focused especially on the improvement of knowledge and skills in methods, techniques, and experience for PS research. The project was planned to guide and improve ICM-UT’s research efforts, support closer cooperation with leading European institutions, and foster the participation of Estonian researchers, healthcare professionals and policy advisors in international research cooperation and development.

To achieve the project’s main goal, the following specific objectives were defined:

  • 1.

    To strengthen the scientific and technological capacity of ICM-UT and raise ESRs and staff research profiles for identifying and measuring risks and hazards in PS.

  • 2.

    To increase research capacity and to ensure the continuity and sustainability of PS research at ICM-UT by focusing on patient safety culture and patient empowerment regarding their safety.

  • 3.

    To increase the soft skills of ESRs. Soft skills are the elementary management, personal, and interpersonal abilities that are vital for an individual to be efficient at workplace or in their personal life 17 . In this project, soft skills are defined as skills that provide additional competencies and improve existing skills in research methods, as well as in research management, including proposal writing, research ethics, intellectual property rights and commercialization, and clinical human resources management.

  • 4.

    To increase the visibility of ICM-UT’s excellence in PS research and its potential as a partner with internationally leading European and global research and policy counterparts, as well to strengthen ICM-UT´s networking capacity and credibility at the national and international levels.

Methods

Ethics policies

The PATSAFE project activities do not raise any ethical issues. As the H2020 WIDESPREAD Twinning call does not cover research and associated costs (which may require various ethics permits) as eligible, such costs and activities have not been applied to the PATSAFE project. On the contrary, through training activities supported by the PATSAFE project, we are raising awareness among project target groups (students on all levels and research, clinical and teaching staff) on how to conduct ethical research and provide for PS. In case partners identify the need for an ethics permit at any time during the PATSAFE implementation, the permit will be applied for and implementing related actions will be postponed until the permit is granted.

Project concept

The concept of this project is based on the core competencies for PS research as well as on the guide for developing training programmes in PS research defined by the WHO’s PS branch. The core competencies for PS research, such as fundamental concepts of PS, designing and conducting PS research, and putting research evidence into practice, – are proposed as a foundation for strengthening research capacity by guiding the development of training programmes for researchers in PS. PS researchers should be able to describe the fundamental concepts of the science of PS in their specific social, cultural, and economic context, design and conduct PS research, and be part of the process of translating research evidence to improve the safe care of patients. This project mainly focuses on developing competencies in methods, techniques, and experience for PS research among the ICM-UT’s ESRs and staff. To ensure that the participants in the research training have the same level of knowledge, some basic concepts of PS are introduced as well. To ensure the sustainability and continuity of PS research in the future, the competencies for the successful translation of evidence into practice and crucial research aspects (e.g., intellectual property rights of research results, human resources, and change management in clinical settings) are included in the training program. These objectives are achieved through training and research strategy development. The increased level of soft skills promotes the participation of ESRs in further PS research and thereby contributes to the achievement of the long-term impact of the PATSAFE project ( Figure 1). All project activities are divided into five work packages (WPs).

Figure 1. Conception of the Patient Safety Research Centre (PATSAFE) project.

Figure 1.

Considering the SWOT analysis results, the PATSAFE twinning partnership activities involve continuous peer-to-peer collaboration, training academic staff and ESRs, and networking and coordination activities. Looking ahead, the active involvement of ESRs in the project, the development of the national research strategy on PS, and establishment of the Estonian Patient Safety Research Network will ensure the long-term sustainability of PS research in ICM-UT and Estonia as a whole.

Overall methodology

PATSAFE is based on a dynamic and interactive process with iterative improvement cycles and feedback, ongoing communication, incorporation of new ideas and insight and peer-to-peer exchange and focuses on increasing capacities and achieving impact goals ( Figure 2).

Figure 2. The overall methodology of the Patient Safety Research Centre (PATSAFE) project.

Figure 2.

Advanced cooperation between two international leading research centres – the Avedis Donabedian Foundation at the UAB in Barcelona (FAD), and IQ healthcare at the Radboud Institute for Health Sciences, Radboud university medical center (IQ-HC) – and the research organization of the wider region –helps ICM-UT address the gaps in PS research via knowledge and experience transfer, ( Figure 3), from 2019 to 2022. Identifying common research interests and exploring synergies and knowhow to address specific research questions paves the way for achieving the ICM-UT’s sustainable development.

Figure 3. Improvement of research excellence of ICM-UT in patient safety research methodology.

Figure 3.

Project activities

PATSAFE project includes four activities, which are planned according to the SWOT analysis findings, to deliver maximum impact on ICM-UT's scientific excellence and contribute to ICM-UT’s long-term research sustainability.

1. Identification and definition of the main priorities in short-, medium-, and long-term PS research. These activities are planned to increase the research capacity and visibility of the ICM-UT in PS research, and directly address the need for international visibility in PS and low involvement of patients in healthcare safety research. In the short term, staff exchanges of two to three researchers from the ICM-UT will visit FAD and IQ-healthcare to identify and envisage research topics that are currently addressed at these institutions and the international level and how they are implemented. We identify the researchers who are interested in doing PS research or are already involved in PS research. Identification of research topics is based on the national and international priorities in PS research, by involving national and international level experts, i.e. representatives of researchers, practitioners, patients and policymakers. To prioritize the research topics, we use the Delphi technique. Additionally, a multidisciplinary workshop is organized to reach a consensus on prioritization of research topics, including qualitative techniques and a prioritization matrix to find the primary short-, medium-, and long-term research needs and challenges. The results include a list of specific topics, care levels, and most important methodologies, appropriated and adapted to the ICM-UT and Estonia. In this process, patients are involved, to integrate their perspective into the priority's definition of research topics that primarily focus on the procedures and outcomes most important for them. We involve the patients through their representative organizations by inviting the patient representatives to take part in the priority setting for patient safety research. We contact the potential participants using the publicly available contact information; the participation is voluntary for all participants, including the patients’ representatives. The prioritization process leads to the development of the national PS research strategy.

2. Implementation of the training program in PS research methodology. The PATSAFE training program structure features two pathways. Path one focuses on methods for analysis and improvement, such as measuring and analysing risks and hazards, PS improvement interventions, and implementation research. Path two involves methods for researching PS awareness: patient safety culture and patient safety empowerment. This research methodology training program integrates the ‘learning by doing’ approach, using traditional training lectures, with more interactive and participatory activities, combined with mentoring and peer-to-peer exchange, to work in parallel with the development of specific scientific outputs (proposal, projects, publications, etc.).

The training program development is based on a constructivist learning theory and principles from adult learning. A flipped classroom approach is used to develop the learning materials and activities. These principles lead to the following structure of the training program:

  • All courses consist of a basic and an advanced version. Participants can choose which version to follow based on their learning goals or prior experience, supporting their self-directed learning.

  • The program includes activities and assignments closely linked to participants’ workplace and interests.

  • Activities and assignments are performed in collaboration with colleagues or peers.

  • The feedback on the assignments is provided by PATSAFE teachers and peer participants (peer feedback).

The training program is developed in several steps. First, a needs assessment is undertaken to get insight into potential participants' learning needs and preferences regarding the content and learning activities. Based on this assessment, the transnational curriculum development team formulates general learning goals regarding the main themes. This team comprises experts on various topics concerning PS and healthcare quality, researchers, a research ethicist, an educational advisor and technical administrators from the universities involved in the PATSAFE project.

Based on the general learning goals, the program is structured into three modules, each consisting over several courses:

  • fundamentals of PS, including the methods for analysis and improvement, such as measuring and analysing risks and hazards, PS improvement interventions, and implementation research;safety culture and patient involvement, also including validation techniques of measurement tools to study the safety culture in healthcare settings;soft skills development such as writing the research proposal, research ethics, commercialization in research and intellectual property rights, human resources and change management in clinical settings, qualitative research as well the introduction on literature reviews.

The courses in the program have different educational formats based on the overall learning goals. Some are full online courses in an online learning platform with no live interaction with teachers. Others include multiple workshops in small groups. Multiple learning methods are used, such as reading literature, watching webinars from experts, performing practical and research assignments, doing knowledge tests and being active on forums. All teachers in courses are experts related to a topic on PS: academic staff members from FAD, IQ-HC, and ICM-UT but also international leading experts and PS research leaders from other European academic institutions

In order to spread the information about the training program and to recruit the participants, we organize an introductory workshop at the beginning of the project. Additionally, for every course a flyer is developed and spread amongst potential participants: academic staff ESRs, and healthcare practitioners, using mailing lists in the Faculty of Medicine of the University of Tartu and Faculty’s information letter, the project webpage and university’s continuous education program.

Theoretical topics from paths one and two are addressed by face-to-face interactive seminars, including case studies and discussions. For the virtual training, all the materials prepared are organized via modules and pathways using a Moodle e-learning platform of the University of Tartu. This e-learning platform is also used to promote exchange and facilitate work between face-to-face activities. The described activities focus on strengthening the scientific and technological capacity to identify and measure risks and hazards in PS, PS culture, and empowering patients to improve their own safety. They address the weaknesses revealed in the SWOT analysis: limited knowledge in PS research methodology among the ICM-UT research staff and ESRs, and a limited number of medical doctors and nurses with enough knowledge and skills in patient safety research. To assess the improvement of knowledge and skills regarding PS research among participants, various assessments are undertaken, such as knowledge tests, practical activities or written assignments.

The training program is implemented over a two-year period starting from 2020 to 2022

3. Development of a joint research proposal and publications. Poor safety culture might be a serious obstacle for PS research, as the quality of research results depends to a great extent on the readiness of clinicians to support the research process. Thus, research in safety culture indicates obstacles to the willingness of staff to participate in research processes or opportunities to improve safety culture and thus promote patient safety research.

Research activities are guided by the WHO PS research priorities and competencies as well by the research priorities defined in Estonia and directly address weaknesses like scepticism towards PS research and data collection, and limited knowledge in PS research methodology among the ICM-UT research staff and ESRs.

Using topics prioritized in phase one and implemented in parallel with phase two, face-to-face interactive training seminars are organized in phase three to address different soft skills needed to ensure that research topics are correctly translated into specific outputs. The participants of these training seminars are the members of the academic staff as well the ESRs who participated in the training program and are interested to write the research proposal. Researchers are encouraged to prepare proposals to fund their own research, but the aim of the consortium is to prepare proposals for the continuation of the collaboration after the end of this project, too. Depending on relevant international or national calls for proposals, up to three proposals are planned during the life span of the project, with one consortium member as lead partner in each proposal.

Writing the scientific papers is also a mean to integrate training, mentoring, and exchange into specific scientific output. With this, different types of skills can be practiced. These activities address weaknesses like low involvement of patients in health care safety research and limited knowledge in PS research methodology among the ICM-UT research staff and ESRs but also weaknesses such as.

lack of international visibility in PS research, scepticism towards PS research and data collection about the risks and hazards of PS among practicing clinicians, and the low involvement of patients in health care safety research. To assess improvement, we define the indicators that are described in detail in the Impact section of this protocol.

4. Stakeholder engagement, dissemination, and exploitation. This activity coordinates the engagement of relevant stakeholders and implements an ambitious plan of innovative activities to increase the impact of the project research. These activities directly address weaknesses like the lack of international visibility and scepticism towards PS research and data collection.

During this activity the integration of PS research into the development plans of the ICM-UT, the Faculty of Medicine of the University of Tartu, and the Estonian National Health Plan is covered. By elaborating the long-term strategic development plan, and involving relevant stakeholders, the effects of structural funds are maximised, and research and innovation resources attainment to critical mass is ensured. Moreover, the strategy will increase the visibility of ICM-UT’s scientific excellence and its potential as an equal partner within European academia and health politics. At the end of the project, we organize a national conference on PS and PS research. As an exploitation strategy, the consortium takes advantage of the material, methodology, and experience developed during phases one, two, and three and organizes a virtual training course on PS research open to other potential interested professionals in Europe. To carry out the course implementation, we perform a business case study, combining marketing, diffusion, and launching.

Impact

The PATSAFE project substantially and measurably improves scientific and innovation capabilities and the performance of ICM-UT in PS research methodology. Thus, it also improves Estonia’s PS research and innovation, and overall health care quality ( Figure 3). The current data suggest that about one in 10 patients is harmed while receiving hospital care, and about 15% of hospital expenditure and activity in Organisation for Economic Co-operation and Development (OECD) countries can be attributed to treating safety failures 18 . Currently, there are no reliable data about the prevalence of healthcare-related patient harm in Estonia, but adjustment of the international data to Estonian health system demonstrates that in 2016 about 21,675 patients or 1,647 per 100,000 inhabitants could potentially have been harmed during their hospital stays, and that about 98,850,000 Euros were spent treating these failures. These calculations are based on the data provided by Estonian Health Statistic and HEalth REsearch Database : https://statistika.tai.ee/pxweb/en/Andmebaas/Andmebaas__04THressursid/

Increasing Estonian PS research capabilities and performance enables researchers to investigate the magnitude and nature of patient harm in Estonia and, ultimately, promote the development of evidence-based strategies and evaluate the effectiveness of potential solutions. This approach can eventually decrease the high burden on healthcare-caused harm to the loss of capacity and productivity of patients being harmed, and to the loss of trust in the health system, and lead to additional available resources within the health system 19 .

The impact of the project can be seen in different areas: research, education, clinical field, society, and policy.

The research impact is expressed in increased research excellence, improved scientific and innovation capabilities, and better performance by the ICM-UT and is revealed through the following indicators:

  • increased number of peer reviewed publications in the field of PS and citations,

  • increased visibility such as number of submitted, accepted and invited presentations in international events,

  • new research topics and proposals which emerge from the project,

  • successful participation in new national or EU level competitive research and innovation programs

The educational impact of the project is expressed new and improved courses with new educational methods available in person or online and integrated in the curricula of partner universities.

The expected long-term impacts of the project are seen as clinical, societal and policy impacts. The clinical impact is seen when PS practices are applied in clinical environment: patients will be treated by healthcare professionals who are trained in PS. Improvement of PS reporting and learning systems and implementation of evidence-based safety practices is expected to result in fewer adverse events and patient harm. The expected societal impact is expressed first of all in increased PS as a result of improvements following PATSAFE training. More information will be available on PS research, and this leads to deeper understanding of the role of patients in PS as well.

The project's policy impact is expressed in successful collaboration with stakeholders – providers of health services, the Estonian Health Insurance Fund, and the Ministry of Social Affairs, but also promoted by the national PS research strategy in Estonia. Moreover, this project provides an opportunity for researchers to partner with consumers to co-design patient safety research and healthcare services.

Conclusion

As a result of the project, the ICM-UT will apply state-of-the-art evidence-based strategies to PS research. The ICM-UT has better capacity to conduct PS research using appropriate methodology, promote PS research among ESRs and healthcare staff, and involve patients in PS research, thus contributing to Estonia’s overall healthcare quality and PS performance. For partner institutions, participation in this project provides new opportunities for networking and expanding their research methods to a new culture and setting. Therefore, this innovative project will have the impact on the overall healthcare quality and safety. Bringing together national and international experts to exchange knowledge and experience will maximise the impact of the research for the benefit of the patients and clients of health system not only in Estonia but provides new knowledge and skill that could be implemented in other European countries as well.

Funding Statement

This research was financially supported by the European Union Horizon 2020 research and innovation programme under grant agreement No 857359 (Developing the University of Tartu to a well-networked PATient SAFEty research center in Estonia [PATSAFE]).

The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

[version 2; peer review: 1 approved, 4 approved with reservations]

Data availability

Underlying data

No data are associated with this article.

References

  • 1. Makary MA, Daniel M: Medical error-the third leading cause of death in the US. BMJ. 2016;353: i2139. 10.1136/bmj.i2139 [DOI] [PubMed] [Google Scholar]
  • 2. Institute of Medicine (US) Committee on Quality of Health Care in America, Kohn LT Corrigan J et al. : To err is human: building a safer health system.Washington DC: National Academy Press;2000. 10.17226/9728 [DOI] [PubMed] [Google Scholar]
  • 3. Battles JB: Patient safety: research methods for a new field. Qual Saf Health Care. 2003;12(Suppl II):ii1. 10.1136/qhc.12.suppl_2.ii1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4. Battles JB, Lilford RJ: Organizing patient safety research to identify risks and hazards. Qual Saf Health Care. 2003;12(Suppl II):ii2–ii7. 10.1136/qhc.12.suppl_2.ii2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5. Global Priorities for Research in Patient Safety (first edition).WHO,2008; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 6. Andermann A, Ginsburg L, Norton P, et al. : Core competencies for patient safety research: a cornerstone for global capacity strengthening. BMJ Qual Saf. 2011;20(1):96–101. 10.1136/bmjqs.2010.041814 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7. Patient Safety Research: A Guide for Developing Training Programmes.WHO,2012; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 8. Council Recommendation of 9 June 2009 on patient safety, including the prevention and control of healthcare associated infections.OJ C, C/151, CELEX;2009;1. Reference Source [Google Scholar]
  • 9. Patient safety incident reporting and learning systems: technical report and guidance.Geneva: World Health Organization;2020. Reference Source [Google Scholar]
  • 10. National Health Plan 2009-2020. Tallinn: Government of Estonia;2008; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 11. Rahvastiku tervise arengukava 2020–2030 (in Estonian).Tallinn: Sotsiaalministeerium;2020; (accessed July 19 2022). Reference Source [Google Scholar]
  • 12. Ministry of Social Affairs (MoSA): Quality Policy of Estonian Health Care.Tallinn: MoSA of Estonia,1998. [Google Scholar]
  • 13. Põlluste K, Habicht J, Kalda R, et al. : Quality improvement in the Estonian health system--assessment of progress using an international tool. Int J Qual Health Care. 2006;18(6):403–13. 10.1093/intqhc/mzl055 [DOI] [PubMed] [Google Scholar]
  • 14. Põlluste K, Alop J, Groene O, et al. : Health-promoting hospitals in Estonia: what are they doing differently? Health Promot Int. 2007;22(4):327–36. 10.1093/heapro/dam032 [DOI] [PubMed] [Google Scholar]
  • 15. A Review of Estonia’s Quality Assurance System for Health Care.The World Bank Group,2015; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 16. Best Practices in Patient Safety. 2nd Global Ministerial Summit on Patient Safety.Bonn: Federal Ministry of Health;2017; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 17. Acharya S, Preda MB, Papatheodorou I, et al. : The science behind soft skills: Do’s and Don’ts for early career researchers and beyond. A review paper from the EU-CardioRNA COST Action CA17129 [version 2; peer review: 1 approved, 1 approved with reservations]. Open Res Europe. 2023;3:55. 10.12688/openreseurope.15746.2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18. Slawomirski L, Auraaen A, Klazinga N: The Economics of Patient Safety: Strengthening a value-based approach to reducing patient harm at national level.OECD,2017; (accessed July 19, 2022). Reference Source [Google Scholar]
  • 19. Patient safety and healthcare-associated infections: Report from the Commission to the Council, June 2014 ( The Commission’s Second Report to the Council on the implementation of Council Recommendation 2009/C 151/01 on patient safety, including the prevention and control of healthcare associated infections). Brussels: European Commission;2014; (accessed July 19,2022). Reference Source [Google Scholar]
Open Res Eur. 2024 Jul 11. doi: 10.21956/openreseurope.18244.r41167

Reviewer response for version 2

Gianluca Catania 1

Thank you for asking me to review the PATSAFE study protocol. The protocol aimed at improving and strengthening patient safety research initiatives addresses a relevant topic in healthcare systems. However there are some issues to be addressed. 

Particularly the method section needs to be more expanded on how the objectives will be measured, also the authors should specify which outcome measures will be used for each outcome of the project.

I would like to see a table with 3 columns:  left column the outcomes, central column the outcome measures, right column references for each measure (either original measure or adaptation of measure). It could be worth designing the table according to the four-level impact area defined by the authors (eg. research impact, educational impact,...).

In the project concept section on page 6 it misses reference for the WHO guide for developing training programs in patient safety research.

Data analyses section is missing.

More than half of the references are more than 10 years old.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

No

Are the datasets clearly presented in a useable and accessible format?

No

Reviewer Expertise:

Nursing care organization

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Open Res Eur. 2024 Jun 29. doi: 10.21956/openreseurope.18244.r41163

Reviewer response for version 2

Esther Van Poel 1

Thank you for the opportunity to review this article. It presents the PATSAFE project within the Institute of Clinical Medicine of the University of Tartu (ICM-UT) as a leading institute for patient safety research and training in Estonia. A detailed SWOT analysis was conducted as a starting point for the project. A well-structured collaborative network is set up with international partners. Well-thought-out activities are mentioned. The project will have an impact on different fields, including research, education, clinical field, society, and policy. I agree with the project's importance, which could be inspiring for other countries.

Suggestions for improvement

1. " Estimates show that there are 421 million hospitalisations in the world annually, and approximately 42.7 million adverse events, i.e., one in 10 patients is harmed while receiving hospital care [...]." Are there any numbers on the European situation given the context of the Patient Safety Research Centre (PATSAFE) project? Please add more information on the consequences of unsafe care for different stakeholders (eg patients, healthcare providers,...)

2. "The Faculty of Medicine of the University of Tartu is Estonia's only medical school. Within the Faculty, the Institute of Clinical Medicine (ICM-UT) is responsible for most of the clinical subjects of the Medicine programmes (except family medicine and dentistry) and has a leading role in clinical research [...]: Please add some references about your research etc.

3."PS research is currently in an early stage, [...]": What do you mean?

4. "We started the preparatory work for the Patient Safety Research Centre (PATSAFE) project by conducting a thorough SWOT analysis to identify the gaps in the scientific excellence in PS research methodology at ICM-UT.: " Who is 'we'?"

5.Am I right that the project is solely focused on secondary care? Please make sure this is clear throughout the text and explain why.

6. Please explain how you set up the collaboration with IQ Healthcare and UAB in Barcelona. Briefly introduce both institutions.

7."In the short term, staff exchanges of two to three researchers from the ICM-UT will visit FAD and IQ-healthcare to identify and envisage research topics that are currently addressed at these institutions and the international level and how they are implemented. We identify the researchers who are interested in doing PS research or are already involved in PS research. Identification of research topics is based on the national and international priorities in PS research, by involving national and international level experts, i.e. representatives of researchers, practitioners, patients and policymakers. " Please add more information on the methodology you will use to identify international research priorities. How are you going to involve international experts etc.?"

8. "3. Development of a joint research proposal and publications". Not only does the perception and readiness of clinicians seem important, but so does the care management team?

9. "3. Development of a joint research proposal and publications." What about developing position statements with recommendations for policymakers etc?

10. "As an exploitation strategy, the consortium takes advantage of the material, methodology, and experience developed during phases one, two, and three and organizes a virtual training course on PS research open to other potential interested professionals in Europe". Very useful initiative.

11. "Conclusions": Who do you refer to by mentioning 'partnering institutions'?

X.Please double-check typos and English grammar (e.g., one in ten patients are harmed...).

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Partly

Are sufficient details of the methods provided to allow replication by others?

Partly

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Patient safety - quality of healthcare

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Open Res Eur. 2024 Jun 18. doi: 10.21956/openreseurope.18244.r41165

Reviewer response for version 2

Sofi Fristedt 1

The protocol goes beyond a specific study to describe rather the development of a center. The introduction is relevant for the purpose of developing a center.

The objectives are rather broad and cover a range of activities, and it will be difficult to assess whether they have been accomplished or not. They are more on a visionary level (enhancing, strengthening etc.) that will be hard to quantify or qualify. Bullet points in the SWOT analysis could perhaps be used as/to identify baselines - that will help in assessing fulfillment of the objectives.

The design or rather the activities are rather overall described in relation to the activities. However, the protocol includes many activities and it is hard to describe them all in detail. The description is sufficient to see what they intend to do, but the description does not really support replication of the project. Maybe this format of a study protocol is not the best for such a large initiative as developing a center.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Partly

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Former director of a research centre in quality improvement

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Open Res Eur. 2023 Dec 8. doi: 10.21956/openreseurope.18244.r36420

Reviewer response for version 2

Anne Hogden 1

The revised version appears to address the issues identified in version 1. I am happy for version 2 to be accepted for indexing.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

NA

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard.

Open Res Eur. 2023 Jul 10. doi: 10.21956/openreseurope.16245.r32955

Reviewer response for version 1

Alexandra Peters 1

The authors address an important topic by looking to address the issue of patient safety in Estonia, especially in the context of the World Bank report which stated that Estonia needs to change its reporting culture to being open to acknowledging errors (p.4).

I would recommend that the paper is revised before being Approved.

Overall, the interventions remain vague and quite repetitive. I think the idea for identification of topics is good: staff exchanges, identification of topics, workshop for consensus of research topics and then a list of topics and methodologies. That said, the implementation of a training program is unclear. Is it just going to be advertised in the hospital generally where for “every course a flyer is developed and spread among potential participants : academic staff, ESRs, healthcare practitioners”. It seems that ICM-UT does not have the in house capacity to develop a course, and some staff exchanges is not going to give them the knowledge for course development. Will this be done with the other universities that they will collaborate with? All we know about the teachers is that they are “experts related to a topic in PS” (p9). There is no mention of the topics, types of experts that will teach, how to guarantee that people will attend, whether there is some kind of accreditation of mandatory participation to the courses, how long they will last, their scope, etc. Although the authors don’t have the topics yet, they could have gotten some of the broad topics for patient safety improvement form the literature.

The three modules of the course on p9 mention three modules which include the fundamentals of PS, although on p6 it is specifically stated that the fundamental concepts of PS will not be focused on as they are discussed during the training of health professionals. (Although their course is not only targeting health professionals).

The second half of the proposal has a number of grammatical errors (p.7 speaks about 2019-2022 being in the future (“will help ICM-UT address”), the last sentence on p8 is not a sentence, p9 “this team comprises of experts”, and “each module consists over several courses”.

When speaking about improvement in the research number of papers and citations, it is very unclear how the 3 research proposals will be written, why there are 3, and what kind of proposals they are. There is no mention of implementing any types of interventions or anything. Although from what I understand, the main goal at this point is “to investigate the magnitude and nature of patient harm in Estonia and, ultimately promote the development of evidence-based strategies and evaluating the effectiveness of potential solutions” (sic), there is no concrete information about how their project will do this. I think that the authors should do a lot more research in patient safety in order to have a more solid project proposal. At the very least, they could identify very general categories such as reducing HAIs or reducing medical errors, etc and then begin to propose a more concrete project.

Minor comments - although it is repeated that “knowledge of PS research methodology needs to be improved” in Estonia (p.4), there is often mention of “increasing visibility of ICM-UT’s excellence in PS research” (p4, p8, p9).

Is the study design appropriate for the research question?

Partly

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

No

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Infection prevention and control, healthcare environmental hygiene, hand hygiene

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Open Res Eur. 2023 Jul 10. doi: 10.21956/openreseurope.16245.r32952

Reviewer response for version 1

Anne Hogden 1

The authors have provided a comprehensive protocol for the intended improvements to patient safety research. My comments are mostly about how this is communicated in the manuscript.

  • The figures are excellent - very clear and to the point. They make the objectives very explicit, and link these well to the methodology.

  • To improve the writing, some editing is required to reduce repetition and confusion within the text.

  • The term 'soft skills' is used 7 times in the manuscript, but no definition is given. Please provide this explicitly on first use of the term.

  • The acronym 'WP' is used in Figs 1 and 2, but not explained. Is it 'workshop'? There are several mentions of workshops in the text, but these need to be more overtly linked to the diagrams.

  • Some questions - what will Estonia be able to teach the world through this project? What do you see as the implications for patients' safety and quality of care? You touch on this in the Long-term Impact section of Fig 3, but it would be good to see this taken a step further - how will patients benefit from this improved research? The benefits to researchers are clear, less so the benefits to patients.

  • Participation in research is mentioned, but please consider this a wonderful opportunity for researchers to partner with consumers to co-design patient safety research and healthcare services.

Is the study design appropriate for the research question?

Yes

Is the rationale for, and objectives of, the study clearly described?

Yes

Are sufficient details of the methods provided to allow replication by others?

Yes

Are the datasets clearly presented in a useable and accessible format?

Not applicable

Reviewer Expertise:

Patient-centred care and co-design of research with patients and families; co-designed decision-making tools; lecturer in safety and quality in healthcare.

I confirm that I have read this submission and believe that I have an appropriate level of expertise to confirm that it is of an acceptable scientific standard, however I have significant reservations, as outlined above.

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Data Availability Statement

    Underlying data

    No data are associated with this article.


    Articles from Open Research Europe are provided here courtesy of European Commission, Directorate General for Research and Innovation

    RESOURCES