Skip to main content
PLOS One logoLink to PLOS One
. 2023 Mar 1;18(3):e0280475. doi: 10.1371/journal.pone.0280475

Difference in prioritization of patient safety interventions between experts and patient safety managers in Japan

Ryosuke Hayashi 1, Yosuke Hatakeyama 2, Ryo Onishi 2, Kanako Seto 2, Kunichika Matsumoto 2, Tomonori Hasegawa 2,*
Editor: Keiko Nakamura3
PMCID: PMC9977033  PMID: 36857366

Abstract

Although a variety of patient safety interventions have been implemented, prioritizing them in a limited resource environment is important. The intervention priorities of patient safety managers may differ from those of patient safety experts. This study aimed to clarify the difference in prioritization of interventions between experts and safety managers to better identify interventions that should be promoted in Japan. We performed a secondary data analysis of two surveys: the Delphi survey for Japanese experts and a nationwide questionnaire survey for safety managers in hospitals. Regarding the 32 interventions constituting 14 organizational-level and 18 clinical-level interventions examined in the previous studies, we assessed three correlations to examine the difference in prioritization between experts and safety managers: correlations between experts and safety managers in the three perspectives (contribution, dissemination, and priority), those between priorities of experts and safety managers at the clinical and organizational level, and those among the three perspectives in experts and safety managers. Contribution (r = 0.768) and dissemination (r = 0.689) of patient safety interventions evaluated by experts and safety managers were positively correlated, but priorities were not. Interventions with priorities that differed between experts and safety managers were identified. In experts, there was no significant correlation between contribution and priority or between dissemination and priority. For safety managers, contributions (r = 0.812) and dissemination (r = 0.691) were positively correlated with priority. Our results suggest that patient safety managers evaluated future priority based on past contributions and current dissemination, whereas experts evaluated future priority based on other factors, such as expected impacts in the future, as mentioned in the previous study. In health policymaking, promotion of patient safety interventions that were given high priority by experts, but low priority by safety managers, should be considered with possible incentives.

Introduction

Since the late 1990s, various activities have been introduced by governments, medical/specialty societies, accreditation bodies, and healthcare organizations in many countries to improve patient safety [13]. Previous studies have examined whether a certain patient safety intervention contributed to improving patient safety [413]. Implementing patient safety interventions requires considerable investment in resources and costs [14]. Although it is important to prioritize them in a limited resource environment [1518], there is insufficient evidence regarding the cost of patient safety interventions [19].

The Organization for Economic Co-operation and Development (OECD) published a report titled “The Economics of Patient Safety: Strengthening a Value-Based Approach to Reducing Patient Harm at National Level” in 2017 [14]. In this report, the OECD chose patient safety experts and asked them for their “best estimate” of the cost and impact of each patient safety intervention using the Delphi method. These estimates could be based on evidence, observations, experience, difficulty in organizing, prediction of mortality, and morbidity reduction. Based on the experts’ ratings of the impact and cost of patient safety interventions, the OECD extracted prioritized interventions to improve patient safety from 42 interventions at the system, organizational, and clinical levels.

By conducting a Delphi survey of Japanese patient safety experts, Hatakeyama et al. extracted patient safety interventions that should be prioritized in Japan [20]. In this study, the questionnaire consisted of 42 interventions based on the OECD report, and 6 perspectives for assessing the importance of interventions in the past (contribution), current (dissemination), and future (impact, cost, urgency, and priority). They reported that the priority of patient safety interventions had a positive relationship with the future impact and a negative relationship with current dissemination. These results suggested that experts gave high priority to interventions that were expected to be effective in the future and low priority to interventions that were already disseminated. It seemed to be important for policymakers and hospital administrators to consider the status of the medical system, the medical policies that had been taken thus far, and the circumstances that were important in setting the priority of patient safety interventions. These OECD report and previous study suggested that future priorities for interventions might be influenced not only by expected future impact, but also by past contribution and current dissemination.

Practitioners and patient safety managers are likely to provide patient safety interventions based on the needs and resources on their clinical and organizational settings. Patient safety experts might assess the priority interventions from the perspective of a healthcare system and policy. Therefore, the intervention priorities of safety managers might be different from those of experts. Previous studies have reported the priorities and determinants of patient safety interventions at the clinical level [21,22]. However, few studies have shown differences in intervention priorities between experts and safety managers. By clarifying the differences in prioritization and influential factors, we could identify interventions to be promoted through the support of healthcare system and policies.

This study aimed to investigate the differences in prioritization of patient safety interventions between experts and safety managers in Japan, focusing on the priority-setting mechanism of each group.

Materials and methods

We performed a secondary data analysis of two surveys: the Delphi survey for Japanese experts [20] and a nationwide questionnaire survey for patient safety managers in hospitals [23]. Parts of both questionnaire items used in this study were shown in S1 and S2 Tables. All participants of both surveys were informed about the research objective and the policy of data confidentiality and anonymity. Taking part in both surveys was voluntary, not mandatory. Therefore, we considered responses to surveys as consent to participate in the survey. Ethical approval for this secondary data analysis was obtained from the Ethics Committee of Toho University School of Medicine (No. A21063).

Delphi survey for experts

The Delphi technique is a forecasting method that involves repeatedly asking experts to summarize their opinions [24,25]. This technique has been used to solve an array of healthcare problems ranging from those of an individual hospital or department to those of a statewide agency or state [26] and has also been used in the survey of the OECD report [14].

In the Delphi survey, the criteria for experts were to be actively involved in academic activities such as academic conferences or writing papers of patient safety. the respondents were 24 experts, including two representatives of nationwide organizations related to patient safety, five hospital administrators, seven in-hospital patient safety managers, eight researchers of patient safety, and two others in the field of patient safety. The survey was conducted over three rounds by mail (round 1) and e-mail (rounds 2 and 3), from July to October 2017. During these rounds, the results of the previous round were presented to the participants. According to the OECD report [14], the questionnaire consisted of 42 interventions at three levels in total, the system level (10 interventions), organizational level (14 interventions), and clinical level (18 interventions), and three perspectives: past contribution, current dissemination, and priority for future implementation. In each round, participants were asked to rate all 42 interventions on a 5-point Likert scale from two perspectives: dissemination (1: low to 5: high) and priority (1: low to 5: high). Ratings of past contributions were asked in round 1 only (1: small to 5: large) [20].

Questionnaire survey for safety managers

The questionnaire survey of in-hospital patient safety managers responsible for patient safety management at each hospital was conducted to reveal the management systems and activities for improving patient safety in hospitals.

The anonymous nationwide mail survey was conducted in Japan from October to November 2017. The hospitals were selected by stratified random sampling according to the number of beds: 25% of hospitals with < 100 beds, 50% of hospitals with 100–299 beds, and 100% of hospitals with ≥ 300 beds were selected. Consequently, a questionnaire was sent to 3,215 hospitals, representing 38% (3,215/8,448) of all the hospitals in Japan.

Using the same wording as the Delphi survey for experts, respondents were asked to rate 42 interventions on a 5-point scale from two perspectives: past contribution to patient safety (contribution: 1: small to 5: large) and priority for future implementation (priority: 1: low to 5: high). They were also asked whether 14 interventions at the organizational level and 18 at the clinical level (totaling 32 interventions) were implemented in their hospitals with the wording of “at your hospital”. The rate of implementation was used for the current dissemination in the questionnaire survey.

Data analysis

We assessed the mean values of 32 interventions (Table 1), consisting of 14 organizational-level interventions and 18 clinical-level interventions in past contribution, current dissemination, and priority for future implementation. The 10 system-level interventions were not included in the questionnaire for safety managers because these interventions involved the entire national healthcare system and could not be implemented in each hospital. The scores of interventions from the three perspectives were standardized into z-scores for adjusting the variables in the evaluation by experts and safety managers. As data of experts for current dissemination and future priority, we used the results of round three converged through the Delphi process for analyzing the representative perspectives of patient safety experts in Japan. We included the results of round one on past contribution, as they were only asked at round one. The perspectives of safety managers were varied depending on their own circumstances, there was no need to converge them for the analysis.

Table 1. Patient safety interventions.

Level Intervention
Organizational
    O-1 Clinical governance frameworks and systems for patient safety
    O-2 Clinical incident reporting and management system
    O-3 Integrated patient complaint and incident reporting
    O-4 Monitoring and feedback of patient safety indicators
    O-5 Patient-engagement initiatives
    O-6 Clinical communication protocols and training
    O-7 Digital technology solutions to improve safety
    O-8 Human resources interventions
    O-9 Building a positive safety culture
    O-10 Infection detection, reporting, and surveillance systems
    O-11 Hand hygiene initiatives
    O-12 Antimicrobial stewardship
    O-13 Blood and blood product management protocols
    O-14 Medical equipment sterilization protocols
Clinical
    C-1 Medication management / reconciliation protocols
    C-2 Transcribing error systems and protocols
    C-3 Smart infusion pumps and drug administration systems
    C-4 Aseptic technique protocols and barrier precautions
    C-5 Urinary catheter use and insertion protocols
    C-6 Central venous catheter insertion protocols
    C-7 Ventilator-associated pneumonia minimisation protocols
    C-8 Procedural / surgical checklists
    C-9 Operating room integration and display technology
    C-10 Peri-operative medication protocols
    C-11 Venous thromboembolism (VTE) prevention protocols
    C-12 Clinical care standards
    C-13 Pressure injury (ulcer) prevention protocols
    C-14 Falls prevention initiatives
    C-15 Acute delirium & cognitive impairment management initiatives
    C-16 Response to clinical deterioration
    C-17 Patient hydration and nutrition standards
    C-18 Patient identification and procedure matching protocols

Three analyses were conducted using these scores. First, we calculated Pearson’s correlation coefficients of the scores evaluated by experts and safety managers from the three perspectives. Second, we assessed the correlation between the priority scores of experts and safety managers using scatter plots. Finally, we calculated the correlations among the three perspective scores of experts and safety managers using Pearson’s correlation coefficients to clarify the factors that determine priority.

All data were analyzed using IBM SPSS Statistics version 19, and a p-value of < 0.05 was considered statistically significant.

Results

Characteristics of respondents

The respondents’ characteristics are listed in Table 2. In the Delphi survey of experts, all 24 experts responded in all three rounds (Table 2A). The response rate was 18.8% (603/3,215) in the questionnaire survey of the safety managers. Safety managers from acute care hospitals accounted for 78.1%, and those from large hospital (beds > 300) for 37.3% (Table 2).

Table 2.

a. Baseline characteristics (Experts).
n %
Experts 24
    Domain
        Representative of nationwide organization related to patient safety 2 8.3
        Hospital administrator 5 20.8
        Patient safety manager 7 29.2
        Researcher of patient safety 8 33.3
        Other 2 8.3
    Profession
        Doctor 15 62.5
        Nurse 4 16.7
        Pharmacist 2 8.3
        Others 3 12.5
b. Baseline characteristics (Safety managers).
n %
Safety managers 603
    Acute care hospital
        < 100 beds 68 11.3
        100–299 beds 178 29.5
        ≥ 300 beds 225 37.3
    Chronic care hospital
        < 100 beds 29 4.8
        ≥ 100 beds 48 8.0
    Psychiatric hospital 46 7.6
    Other hospitals 9 1.5

Correlations between perspective scores evaluated by experts and safety managers

The correlations between the perspective scores evaluated by experts and safety managers are shown in Table 3. There were positive correlations in the score of past contribution (r = 0.768, p < 0.001) and current dissemination (r = 0.689, p < 0.001) evaluated by experts and safety managers. However, there was no significant correlation in the score of future priority (r = 0.231, p = 0.203), suggesting that experts and safety managers have different views on future priorities.

Table 3. Correlations between perspective scores assessed by experts and safety managers.

r p value
Contribution 0.768 p<0.001
Dissemination 0.689 p<0.001
Priority 0.231 0.203

Abbreviation: r = Pearson’s correlation coefficients.

Differences in the priority on patient safety intervention between experts and safety managers

We present scatter plots of scores for intervention priorities at the organizational level (Fig 1A) and those at the clinical level (Fig 1B). There was no significant correlation in the scores of priorities evaluated by experts and safety managers at either the organizational level (r = 0.212, p = 0.467) or clinical level (r = 0.352, p = 0.152).

Fig 1.

Fig 1

a. Priority of patient safety interventions (Organizational level). b. Priority of patient safety interventions (Clinical level).

The mean values of 32 interventions, consisting of 14 organizational-level interventions and 18 clinical-level interventions in the past contribution, current dissemination, and priority for future implementation, are shown in Table 4A and 4B. There were some interventions with different evaluations between the experts and safety managers. We defined scores > 0 as ’high’ and < 0 as ’low’. The interventions that were given high priority by experts, but low priority by safety managers, were “Clinical governance frameworks and systems for patient safety” (O-1), “Patient-engagement initiatives” (O-5), and “Clinical communication protocols and training” (O-6); the interventions that were given high priority by experts, but low priority by safety managers, were “Clinical incident reporting and management system” (O-2), “Building a positive safety culture” (O-9), and “Medical equipment sterilization protocols” (O-14) in the organization level. At the clinical level, the interventions that were given high priority by safety managers, but low priority by experts, were “Central venous catheter insertion protocols” (C-6), “Procedural / surgical checklists” (C-8), “Peri-operative medication protocols” (C-10), and “Clinical care standards” (C-12); the interventions that were given high priority by safety managers, but low priority by experts were “Aseptic technique protocols and barrier precautions” (C-4), “Pressure injury (ulcer) prevention protocols” (C-13), and “Falls prevention initiatives” (C-14).

Table 4.

a. The mean values of 14 organizational-level interventions.
n Contribution* Dissemination* Priority*
O-1 Clinical governance frameworks and systems for patient safety Experts 24 -0.76 -0.72 0.12
Safety managers 490 -1.55 -1.43 -1.07
O-2 Clinical incident reporting and management system Experts 24 1.41 1.69 -1.00
Safety managers 517 1.56 1.60 1.90
O-3 Integrated patient complaint- and incident-reporting Experts 23 -1.02 -0.91 -2.51
Safety managers 515 -0.56 1.33 -0.69
O-4 Monitoring and feedback of patient safety indicators Experts 23 -1.27 -1.18 -0.44
Safety managers 509 -1.11 -0.55 -1.02
O-5 Patient-engagement initiatives Experts 23 -1.79 -1.82 0.06
Safety managers 501 -2.03 -1.26 -1.79
O-6 Clinical communication protocols and training Experts 23 -0.78 -1.18 0.83
Safety managers 506 -1.27 -1.41 -0.36
O-7 Digital technology solutions to improve safety Experts 24 -0.52 -0.04 1.21
Safety managers 508 -0.60 -0.30 -0.03
O-8 Human resources interventions Experts 24 -1.13 -1.95 1.83
Safety managers 501 -0.76 -0.66 0.19
O-9 Building a positive safety culture Experts 24 -0.64 -0.39 -0.15
Safety managers 514 -0.60 -0.80 0.25
O-10 Infection detection, reporting, and surveillance systems Experts 24 1.52 1.08 0.24
Safety managers 502 0.88 0.98 0.69
O-11 Hand hygiene initiatives Experts 24 0.80 0.75 1.09
Safety managers 512 1.52 1.49 1.46
O-12 Antimicrobial stewardship Experts 24 -0.41 -0.47 0.47
Safety managers 499 0.68 0.88 0.69
O-13 Blood and blood product management protocols Experts 23 1.47 1.33 -0.44
Safety managers 494 0.84 1.02 -0.14
O-14 Medical equipment sterilization protocols Experts 24 1.26 1.44 -1.24
Safety managers 509 0.88 1.10 0.03
b. The mean values of 18 clinical-level interventions.
Interventions n Contribution* Dissemination* Priority*
C-1 Medication management / reconciliation protocols Experts 23 -1.27 -0.64 1.74
Safety managers 507 0.20 -0.22 1.02
C-2 Transcribing error systems and protocols Experts 24 0.08 0.04 0.97
Safety managers 510 0.64 0.02 0.80
C-3 Smart infusion pumps and drug administration systems Experts 24 -0.29 -0.72 -0.15
Safety managers 493 0.00 -0.38 -0.69
C-4 Aseptic technique protocols and barrier precautions Experts 24 1.84 1.08 -0.03
Safety managers 502 1.79 1.43 1.40
C-5 Urinary catheter use and insertion protocols Experts 23 0.23 0.90 -1.74
Safety managers 503 0.60 0.89 -0.19
C-6 Central venous catheter insertion protocols Experts 24 1.15 0.48 0.24
Safety managers 477 -0.12 -0.34 -0.36
C-7 Ventilator-associated pneumonia minimisation protocols Experts 23 0.08 -0.02 -0.32
Safety managers 467 -0.28 -0.54 -0.85
C-8 Procedural / surgical checklists Experts 24 0.98 0.83 0.47
Safety managers 439 -0.08 -0.48 -0.69
C-9 Operating room integration and display technology Experts 24 -0.64 -0.91 -0.50
Safety managers 409 -1.11 -1.21 -1.73
C-10 Peri-operative medication protocols Experts 23 -0.03 -0.20 0.32
Safety managers 417 -0.72 -1.16 -1.18
C-11 Venous thromboembolism (VTE) prevention protocols Experts 23 0.72 0.90 0.44
Safety managers 478 0.12 0.07 0.08
C-12 Clinical care standards Experts 23 0.23 -0.02 0.06
Safety managers 422 -0.76 -1.33 -1.18
C-13 Pressure injury (ulcer) prevention protocols Experts 23 0.60 0.90 -1.36
Safety managers 510 1.36 1.41 0.91
C-14 Falls prevention initiatives Experts 23 -0.01 0.63 -0.59
Safety managers 519 1.28 1.28 1.62
C-15 Acute delirium & cognitive impairment management initiatives Experts 23 -1.07 -1.18 0.83
Safety managers 492 -0.48 -0.66 0.80
C-16 Response to clinical deterioration Experts 23 -0.81 -0.83 0.83
Safety managers 487 -0.32 -0.64 0.74
C-17 Patient hydration and nutrition standards Experts 23 -1.07 -0.29 -1.74
Safety managers 481 -1.07 -0.66 -1.35
C-18 Patient identification and procedure matching protocols Experts 24 1.18 1.44 0.47
Safety managers 476 1.08 0.52 0.74

*: The scores were standardized into z-scores for adjusting the variables in the evaluation by experts and safety managers.

Correlations between three perspectives in experts/safety managers

The correlations between the three perspectives of the experts are shown in Table 5A. There was a positive correlation between past contribution and current dissemination (r = 0.920, p < 0.001); however, there was no significant correlation between past contribution and future priority (r = -0.131, p = 0.474) or current dissemination and future priority (r = -0.273, p = 0.131).

Table 5.

a. Correlations between three perspective scores in experts.
Contribution Dissemination Priority
    Contribution r 1.000
p
    Dissemination r 0.920 1.000
p p<0.001
    Priority r -0.131 -0.273 1.000
p p = 0.474 p = 0.131
b. Correlations between three perspective scores in safety managers.
Contribution Dissemination Priority
    Contribution r 1.000
p
    Dissemination r 0.885 1.000
p p<0.001
    Priority r 0.812 0.691 1.000
p p<0.001 p<0.001

Abbreviation: r = Pearson’s correlation coefficients.

The correlations for the safety managers are presented in Table 5B. Positive correlations were found between past contribution and future priority (r = 0.812, p < 0.001), current dissemination and future priority (r = 0.691, p < 0.001), and past contribution and current dissemination (r = 0.885, p < 0.001).

Discussion

Conducting a secondary data analysis of the Delphi survey for Japanese experts and a nationwide questionnaire survey for safety managers in hospitals, we revealed the priority interventions for patient safety, together with the difference between the priority of safety managers and those of experts, and the relationship of future priority with past contribution and current dissemination.

In this study, as for the correlation of assessment for 32 patient safety interventions between experts and safety managers, positive correlations were observed in past contribution and current dissemination, but not in future priority. In experts, no significant correlation was observed between past contribution and future priority or between current dissemination and future priority. For safety managers, the evaluations of past contribution, current dissemination, and future priority were in the same direction. These results suggest that safety managers are likely to evaluate future priority based on past contribution and current dissemination; however, experts are likely to evaluate future priority based on other factors.

The interventions that were given high priority by safety managers, but low priority by experts were shown in the left column of Table 6. These interventions are relatively easy to conduct at the hospital or clinical level with ingenuity in the clinical setting because their evaluations of past contribution and current dissemination are high. “Building a positive safety culture” (O-9) has a lower evaluation of past contribution and current dissemination by patient safety managers. The importance of safety culture has been emphasized in other industries [27] and was also specified in the General Policy for Medical Safety published by the Ministry of Health, Labour, and Welfare, which defined the main framework of patient safety policies in Japan [28]. A previous study translated a hospital survey on patient safety culture (HSOPS) developed by the Agency for Healthcare Research and Quality in the United States into Japanese and evaluated its validity and applicability [29]. The Japan Council for Quality Health Care, which is a hospital accreditation body in Japan, started the benchmarking project using the Japanese version of the HSOPS to support hospitals in assessing their patient safety culture in 2020, and about 70 hospitals are participating in the project [30]. Experts might consider safety culture as a goal rather than an intervention, since the General Policy for Medical Safety stipulates that the ultimate goal of patient safety measures is to foster a patient safety culture. Interest in the survey on patient safety culture has been increasing and is becoming widely accepted, and the priority of “building a positive safety culture” might be highly evaluated by safety managers.

Table 6. A summary list of interventions according to the priorities given by experts and safety managers.

High priority by safety managers / Low priority by experts High priority by experts / Low priority by safety manages
Organizational level Organizational level
O-2 Clinical incident reporting and management system O-1 Clinical governance frameworks and systems for patient safety
O-9 Building a positive safety culture O-5 Patient-engagement initiatives
O-14 Medical equipment sterilization protocols O-6 Clinical communication protocols and training
Clinical level Clinical level
C-4 Aseptic technique protocols and barrier precautions C-6 Central venous catheter insertion protocols
C-13 Pressure injury (ulcer) prevention protocols C-8 Procedural / surgical checklists
C-14 Falls prevention initiatives C-10 Peri-operative medication protocols
C-12 Clinical care standards

The interventions that were given high priority by experts, but low priority by safety managers were shown in the right column of Table 6. All these interventions had low scores for past contribution and current dissemination, as evaluated by safety managers. Our previous study on Japanese patient safety experts suggested that experts are likely to evaluate the priority of patient safety interventions with the expected impact in the future [20]. These results suggest that safety managers were likely to evaluate the priority of patient safety interventions in terms of which interventions were effective and important in the past, while experts were likely to evaluate what was lacking now for further improvement in patient safety. This difference seemed to be caused by that expert’s assessment might include a healthcare system and policy perspective, while safety manager’s assessment might be based on the needs and resources on their clinical and organizational settings. Measures in healthcare systems and policies, such as providing incentives or education for these interventions that were given high priority by experts, but low priority by safety managers, should be investigated to facilitate their implementation.

In this study, we clarified high-priority interventions based on two surveys. However, it is unclear what kind of hospital can implement these interventions. Examining the relationship between hospital characteristics and reporting culture, a previous study revealed that large acute care hospitals with critical care centers had more voluntary in-hospital reports [23]. Clarifying the characteristics of hospitals that could implement interventions that were evaluated as high priority in this study would facilitate the dissemination of high-priority interventions.

Limitations of this study

This study had some limitations. Only 32 patient safety interventions among many interventions were evaluated because comparability with other studies, including the OECD report, was emphasized. Safety managers in hospitals who were active in patient safety activities could more likely respond to the questionnaire survey, and the survey data might lack representativeness. Whether the safety managers’ evaluation and priority setting of interventions may vary according to the activity of hospitals is unknown. The results of this study should be applied to other countries and regions with caution because this study was based on the results of surveys of patient safety experts and patient safety managers in Japan, and past contribution and current dissemination of each intervention may be different. However, this method of assessing intervention priorities and investigating influencing factors may also be applicable to future surveys in other countries and regions.

Conclusion

We found that there were positive correlations in the score of past contribution and current dissemination of patient safety interventions evaluated by experts and safety managers, but future priorities were different. In experts, there was no significant correlation between past contribution and future priority or between current dissemination and future priority. For safety managers, the evaluations of past contribution, current dissemination, and future priority were in the same direction. The results of this study suggest that experts are likely to evaluate priority based on what is lacking now and would be needed in the future, although safety managers are likely to evaluate priority based on past contribution and current dissemination. In health policymaking, promotion of patient safety interventions that were given high priority by experts, but low priority by safety managers should be considered with possible incentives.

Supporting information

S1 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the Delphi survey.

(PDF)

S2 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the nationwide survey of patient safety managers in hospitals.

(PDF)

Data Availability

Data cannot be shared publicly, because we have been approved to conduct secondary data analyses, but not to share the data used by the ethics committee. These restrictions have been enforced by The Ethics Committee of Toho University School of Medicine. The external researchers can contact the Ethics Committee of Toho University School of Medicine regarding the use of the data but the committee does not accept applications other than Japanese language (med.rinri@ext.toho-u.ac.jp, +81-3-3762-4151). If an external researcher contacts the research team directly (tommie@med.toho-u.ac.jp (personal address of corresponding author), md20015h@st.toho-u.ac.jp (first author), health@med.toho-u.ac.jp (Department of Social Medicine, Toho University School of Medicine)), the research team members will submit reviews of external provision of data to the Ethics Committee on behalf of external researchers.

Funding Statement

Initials of the authors who received each award: Hasegawa T Grant numbers awarded to each author: Health and Labour Sciences Research Grants (grant number:H29-Iryo-Ippan-004) The full name of each funder:the Japanese Ministry of Health, Labour and Welfare URL of each funder website:https://www.mhlw.go.jp/index.html The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Institute of Medicine. (US) Committee on Quality of Health Care in America. In: Kohn LT, Corrigan JM, Donaldson MS, editors. To err is human: building a safer health system. Washington: National Academies Press; 2000. [PubMed] [Google Scholar]
  • 2.McCannon J, Berwick DM. A new frontier in patient safety. JAMA. 2011;305: 2221–2222. doi: 10.1001/jama.2011.742 [DOI] [PubMed] [Google Scholar]
  • 3.Hasegawa T, Fujita S. Patient safety policies: experiences, effects and priorities; lessons from OECD Member States. Tokyo: Ministry of Health, Labour and Welfare; 2018. [Google Scholar]
  • 4.Gandhi TK, Berwick DM, Shojania KG. Patient safety at the crossroads. JAMA. 2016;315: 1829–1830. doi: 10.1001/jama.2016.1759 [DOI] [PubMed] [Google Scholar]
  • 5.Bourne RS, Jennings JK, Panagioti M, Hodkinson A, Sutton A, Ashcroft DM. Medication-related interventions to improve medication safety and patient outcomes on transition from adult intensive care settings: a systematic review and meta-analysis. BMJ Qual Saf. 2022;0: 1–14. doi: 10.1136/bmjqs-2021-013760 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Ciapponi A, Fernandez Nievas SEF, Seijo M, Rodríguez MB, Vietto V, García-Perdomo HA, et al. Reducing medication errors for adults in hospital settings. Cochrane Database Syst Rev. 2021;11: CD009985. doi: 10.1002/14651858.CD009985.pub2 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 7.Manias E, Kusljic S, Wu A. Interventions to reduce medication errors in adult medical and surgical settings: a systematic review. Ther Adv Drug Saf. 2020;11: 2042098620968309. doi: 10.1177/2042098620968309 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Müller M, Jürgens J, Redaèlli M, Klingberg K, Hautz WE, Stock S. Impact of the communication and patient hand-off tool SBAR on patient safety: a systematic review. BMJ Open. 2018;8: e022202. doi: 10.1136/bmjopen-2018-022202 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Franklin BJ, Gandhi TK, Bates DW, Huancahuari N, Morris CA, Pearson M, et al. Impact of multidisciplinary team huddles on patient safety: a systematic review and proposed taxonomy. BMJ Qual Saf. 2020;29: 1–2. doi: 10.1136/bmjqs-2019-009911 [DOI] [PubMed] [Google Scholar]
  • 10.Driscoll A, Grant MJ, Carroll D, Dalton S, Deaton C, Jones I, et al. The effect of nurse-to-patient ratios on nurse-sensitive patient outcomes in acute specialist units: a systematic review and meta-analysis. Eur J Cardiovasc Nurs. 2018;17: 6–22. doi: 10.1177/1474515117721561 [DOI] [PubMed] [Google Scholar]
  • 11.Abbott TEF, Ahmad T, Phull MK, Fowler AJ, Hewson R, Biccard BM, et al. The surgical safety checklist and patient outcomes after surgery: a prospective observational cohort study, systematic review and meta-analysis. Br J Anaesth. 2018;120: 146–155. doi: 10.1016/j.bja.2017.08.002 [DOI] [PubMed] [Google Scholar]
  • 12.Gaspar S, Peralta M, Marques A, Budri A, Gaspar de Matos M. Effectiveness on hospital-acquired pressure ulcers prevention: a systematic review. Int Wound J. 2019;16: 1087–1102. doi: 10.1111/iwj.13147 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 13.Bukoh MX, Siah CR. A systematic review on the structured handover interventions between nurses in improving patient safety outcomes. J Nurs Manag. 2020;28: 744–755. doi: 10.1111/jonm.12936 [DOI] [PubMed] [Google Scholar]
  • 14.Slawomirski L, Auraaen A, Klazinga N. The economics of patient safety: strengthening a value-based approach to reducing patient harm at the national level. Paris: OECD; 2017. [Google Scholar]
  • 15.Pelzang R. Promoting patient safety in Bhutan: challenges and priority strategies for accelerating progress. Int J Health Plann Manage. 2019;34: 1469–1476. doi: 10.1002/hpm.2794 [DOI] [PubMed] [Google Scholar]
  • 16.Bates DW, Singh H. Two decades since to err is human: an assessment of progress and emerging priorities in patient safety. Health Aff (Millwood). 2018;37: 1736–1743. doi: 10.1377/hlthaff.2018.0738 [DOI] [PubMed] [Google Scholar]
  • 17.Elmontsri M, Banarsee R, Majeed A. Key priority areas for patient safety improvement strategy in Libya: a protocol for a modified Delphi study. BMJ Open. 2017;7: e014770. doi: 10.1136/bmjopen-2016-014770 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Pronovost PJ, Faden RR. Setting priorities for patient safety: ethics, accountability, and public engagement. JAMA. 2009;302: 890–891. doi: 10.1001/jama.2009.1177 [DOI] [PubMed] [Google Scholar]
  • 19.Zsifkovits J, Zuba M, Geißler W, Lepuschütz L, Pertl D, Kernstock E, et al. Costs of unsafe care and cost-effectiveness of patient safety programmes. Brussel: European Union; 2016. [Google Scholar]
  • 20.Hatakeyama Y, Fujita S, Iida S, Nagai Y, Shimamori Y, Ayuzawa J, et al. Prioritization of patient safety health policies: Delphi survey using patient safety experts in Japan. PLOS ONE. 2020;15: e0239179. doi: 10.1371/journal.pone.0239179 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Steelman VM, Graling PR, Perkhounkova Y. Priority patient safety issues identified by perioperative nurses. AORN J. 2013;97: 402–418. doi: 10.1016/j.aorn.2012.06.016 [DOI] [PubMed] [Google Scholar]
  • 22.Steelman VM, Graling PR. Top 10 patient safety issues: what more can we do? AORN J. 2013;97: 679–98, quiz 699. doi: 10.1016/j.aorn.2013.04.012 [DOI] [PubMed] [Google Scholar]
  • 23.Fujita S, Seto K, Hatakeyama Y, Onishi R, Matsumoto K, Nagai Y, et al. Patient safety management systems and activities related to promoting voluntary in-hospital reporting and mandatory national-level reporting for patient safety issues: A cross-sectional study. PLOS ONE. 2021;16: e0255329. doi: 10.1371/journal.pone.0255329 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Dalkey N, Helmer O. An experimental application of the Delphi method to the use of experts. Manag Sci. 1963;9: 458–467. doi: 10.1287/mnsc.9.3.458 [DOI] [Google Scholar]
  • 25.Gordon T, Helmer O. Report on a long-range forecasting study. California: The Rand Corporation; 1964. [Google Scholar]
  • 26.Fink A, Kosecoff J, Chassin M, Brook RH. Consensus methods: characteristics and guidelines for use. Am J Public Health. 1984;74: 979–983. doi: 10.2105/ajph.74.9.979 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 27.Summary report on the post-accident review meeting on the Chernobyl accident. International Atomic Energy Agency: International Safety Advisory Group, safety, Series 75-INSAG-1. 1986.
  • 28.Ministry of Health, Labour and Welfare; 2002. [Cited 2022 Jan 10]. Available from: https://www.mhlw.go.jp/topics/2001/0110/tp1030-1f.html.
  • 29.Ito S, Seto K, Kigawa M, Fujita S, Hasegawa T, Hasegawa T. Development and applicability of hospital survey on patient safety culture (HSOPS) in Japan. BMC Health Serv Res. 2011;11: 28. doi: 10.1186/1472-6963-11-28 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Japan Council for Quality Health Care. Support for utilizing patient safety culture survey; 2016. [Cited 2022 Feb 1]. Available from: https://www.jq-hyouka.jcqhc.or.jp/support/psc.

Decision Letter 0

Jibril Mohammed

8 Aug 2022

PONE-D-22-13129Difference in prioritization of patient safety interventions between experts and patient safety managers in JapanPLOS ONE

Dear Dr. Hasegawa,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please ensure that your decision is justified on PLOS ONE’s publication criteria and not, for example, on novelty or perceived impact.

Please submit your revised manuscript by 17th September 2022. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Jibril Mohammed, BSc, MSc, PhD

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf and 

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please provide additional details regarding participant consent. In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed). If your study included minors, state whether you obtained consent from parents or guardians. If the need for consent was waived by the ethics committee, please include this information.

3. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

"Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

Additional Editor Comments (if provided):

This paper has some potential for publication. However, there is a need to improve on the writing style as well as statistical analyses. Please pay a careful attention to the comments of reviewer 1.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Yes

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: I Don't Know

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Thank you for the opportunity to review this manuscript which is a secondary analysis of two datasets looking at the patient safety interventions prioritised by experts and patient safety managers. The paper is mostly very well-written and presents an interesting opportunity to compare two influential groups in patient safety, considering the nuances and explanations for differences and similarities. Despite this potential, I do have some major concerns regarding the manuscript that need to be addressed by the authors. These are provided below.

1. Enhance the rationale for the study to further justify 1. Why these groups may differ in priorities, and 2. What the significance of this is.

2. Develop theoretically and empirically the concepts under investigation particularly the notion of the three perspectives: past contribution, present dissemination, and future priority. These need to be defined (including in the abstract) to be meaningful as well as providing more detail on the wording of questions about these perspectives. Ideally, and touching on previous comment related to rationale, these concepts would be considered in the introduction since there is an implicit assumption in this study that past contribution might affect future priority etc. I’d suggest exploring these concepts and their relationship to each other theoretically in addition to describing in the methods how they were defined/assessed, e.g., consider past literature to support these ideas, make hypotheses.

I have a few other concerns about the comparison of these two datasets

3. In methods, explain what makes someone an expert, especially given this group also contains safety managers.

4. Also clarify whether the study was positioned differently for these different groups or whether the wording of questions was slightly different e.g., “for your hospital” for patient safety managers, vs. “national priorities” for patient safety experts. I’d suggest including both survey forms as appendices.

5. Use of a Delphi alongside a traditional survey for comparison throws up a number of issues that need to be addressed: 1. What round of the Delphi responses are the authors using in the analysis? 2. If they are using round three, the authors should consider whether they are comparing experts vs. managers – arguably they are comparing a group that has refined their responses in light of controlled feedback toward a consensus, as compared with another group who has responded to a one off survey.

Although well-written, there are few instances where wording is overly complicated. For example:

1. Saying “high and low priority by experts and safety managers, respectively” is more complicated than saying “high priority by experts, but low priority by safety managers” and this is a recurrent issue. In addition to revising this wording throughout, it might be useful to create a box or table that summarises the differences e.g., low priority by experts/high priority by managers in one column and high priority by experts/low priority by managers in another. Doing so would also allow some trimming in the Discussion, where these Results are currently repeated. I’d suggest also being explicit on cut offs for when something is deemed low vs high priority.

Reviewer #2: This paper was well organized and clearly articulated the similarities and differences between experts and patient safety managers in regard to prioritization.

Here are a few points for consideration:

1. Dissemination and prioritization can be interpreted differently by various respondents. Were those that participated in the Delphi panel provided definitions of dissemination and prioritization?

2. In the analysis the authors state that "Except for the 10 system-level interventions not asked about dissemination in the questionnaire survey of safety managers..." Is there a rationale for why these 10 system level interventions were not included?

3. In the discussion, it would be helpful to more clearly articulate what the potential reasons and implications are for differences in prioritization among experts and patient safety managers.

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

**********

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Mar 1;18(3):e0280475. doi: 10.1371/journal.pone.0280475.r002

Author response to Decision Letter 0


12 Sep 2022

11/09/2022

Dear Jibril Mohammed, BSc, MSc, PhD

Academic Editor, PLOS ONE

We thank you for the careful evaluation of our manuscript and allowing us to revise. We appreciate your valuable comments and we would like to respond as following:

Journal requirements:

1

Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming.

The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf

and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

Answer:

We checked the format samples and made some corrections to meet PLOS ONE's style requirements, including those for file naming.

2

Please provide additional details regarding participant consent.

In the ethics statement in the Methods and online submission information, please ensure that you have specified what type you obtained (for instance, written or verbal, and if verbal, how it was documented and witnessed).

If your study included minors, state whether you obtained consent from parents or guardians.

If the need for consent was waived by the ethics committee, please include this information.

Answer:

Both surveys did not include minors. We added following explanations.

> P. 6, L. 97-98

All participants of both surveys were informed about the research objective and the policy of data confidentiality and anonymity.

3

In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found.

PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety.

All PLOS journals require that the minimal data set be made fully available.

For more information about our data policy, please see

http://journals.plos.org/plosone/s/data-availability.

Answer:

We performed a secondary data analysis of two past surveys. Data were provided for secondary analysis but were not permitted to be published. The aggregated results of the data used for analysis are shown in Table 4 in the paper.

Reviewer 1:

Comment 1

Enhance the rationale for the study to further justify 1. Why these groups may differ in priorities, and 2. What the significance of this is.

Answer:

We corrected and added following explanations.

> P. 5, L. 77-87

Practitioners and patient safety managers are likely to provide patient safety interventions based on the needs and resources on their clinical and organizational settings. Patient safety experts might assess the priority interventions from the perspective of a healthcare system and policy. Therefore, the intervention priorities of safety managers might be different from those of experts. Previous studies have reported the priorities and determinants of patient safety interventions at the clinical level [21,22]. However, few studies have shown differences in intervention priorities between experts and safety managers. By clarifying the differences in prioritization and influential factors, we could identify interventions to be promoted through the support of healthcare system and policies.

Also, we corrected the words related to this point.

> P. 7, L. 118

> P. 8, L. 139

> P. 13, L. 204

> P. 22, L. 249

current present

Comment 2

Develop theoretically and empirically the concepts under investigation particularly the notion of the three perspectives: past contribution, present dissemination, and future priority.

These need to be defined (including in the abstract) to be meaningful as well as providing more detail on the wording of questions about these perspectives.

Ideally, and touching on previous comment related to rationale, these concepts would be considered in the introduction since there is an implicit assumption in this study that past contribution might affect future priority etc.

I’d suggest exploring these concepts and their relationship to each other theoretically in addition to describing in the methods how they were defined/assessed, e.g., consider past literature to support these ideas, make hypotheses.

Answer:

We prepared both survey forms focusing on items used in this study as supporting information to provide more detail on the wording of questions about these perspectives.

S1 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the Delphi survey.

S2 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the nationwide survey of patient safety managers in hospitals.

And we added following explanations.

> P. 6, L. 96-97

Parts of both questionnaire items used in this study were shown in S1 and S2 Tables.

Additionally, we corrected and added following explanations.

> P. 4-5, L. 63-76

In this study, the questionnaire consisted of 42 interventions based on the OECD report, and 6 perspectives for assessing the importance of interventions in the past (contribution), current (dissemination), and future (impact, cost, urgency, and priority). They reported that the priority of patient safety interventions had a positive relationship with the future impact and a negative relationship with current dissemination. These results suggested that experts gave high priority to interventions that were expected to be effective in the future and low priority to interventions that were already disseminated. It seemed to be important for policymakers and hospital administrators to consider the status of the medical system, the medical policies that had been taken thus far, and the circumstances that were important in setting the priority of patient safety interventions. These OECD report and previous study suggested that future priorities for interventions might be influenced not only by expected future impact, but also by past contribution and current dissemination.

Comment 3

In methods, explain what makes someone an expert, especially given this group also contains safety managers.

Answer:

To clarify the meaning of this matter, we added following explanations.

> P. 6, L. 108-109

In the Delphi survey, the criteria for experts were to be actively involved in academic activities such as academic conferences or writing papers of patient safety.

Comment 4

Also clarify whether the study was positioned differently for these different groups or whether the wording of questions was slightly different e.g., “for your hospital” for patient safety managers, vs. “national priorities” for patient safety experts. I’d suggest including both survey forms as appendices.

Answer:

We prepared both survey forms focusing on items used in this study as supporting information to provide more detail on the wording of questions about these perspectives.

S1 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the Delphi survey.

S2 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the nationwide survey of patient safety managers in hospitals.

And we added following explanations.

> P. 6, L. 96-97

Parts of both questionnaire items used in this study were shown in S1 and S2 Tables.

Additionally, we added the explanation of wording of the questionnaires.

> P. 7-8, L. 133-138

Using the same wording as the Delphi survey for experts, respondents were asked to rate 42 interventions on a 5-point scale from two perspectives: past contribution to patient safety (contribution: 1: small to 5: large) and priority for future implementation (priority: 1: low to 5: high). They were also asked whether 14 interventions at the organizational level and 18 at the clinical level (totaling 32 interventions) were implemented in their hospitals with the wording of “at your hospital”.

Comment 5

Use of a Delphi alongside a traditional survey for comparison throws up a number of issues that need to be addressed: 1. What round of the Delphi responses are the authors using in the analysis? 2. If they are using round three, the authors should consider whether they are comparing experts vs. managers – arguably they are comparing a group that has refined their responses in light of controlled feedback toward a consensus, as compared with another group who has responded to a one off survey.

Answer:

We added following explanations.

> P. 8-9, L. 155-160

As data of experts for current dissemination and future priority, we used the results of round three converged through the Delphi process for analyzing the representative perspectives of patient safety experts in Japan. We included the results of round one on past contribution, as they were only asked at round one. The perspectives of safety managers were varied depending on their own circumstances, there was no need to converge them for the analysis.

Comment 6

Although well-written, there are few instances where wording is overly complicated. For example:

1. Saying “high and low priority by experts and safety managers, respectively” is more complicated than saying “high priority by experts, but low priority by safety managers” and this is a recurrent issue. In addition to revising this wording throughout, it might be useful to create a box or table that summarises the differences e.g., low priority by experts/high priority by managers in one column and high priority by experts/low priority by managers in another. Doing so would also allow some trimming in the Discussion, where these Results are currently repeated. I’d suggest also being explicit on cut offs for when something is deemed low vs high priority.

Answer:

To simplify the expression, the expressions regarding the priority in "Results" are modified as follows.

> P. 3, L. 40-41

> P. 14, L. 208

> P. 14, L. 211-212

high priority by experts, but low priority by safety managers

> P. 14, L. 216

> P. 14, L. 220

high priority by safety managers, but low priority by experts

We added two tables and corrected following explanations.

Table 6. The interventions that were given high priority by safety managers, but low priority by experts

Table 7. The interventions that were given high priority by experts, but low priority by safety managers

> P. 23, L. 259-260

The interventions that were given high priority by safety managers, but low priority by experts were shown in Table 6.

The interventions that were given low and high priority by experts and safety managers, respectively, were “Clinical incident reporting and management system” (O-2), “Medical equipment sterilization protocols” (O-14) in the organization level, “Aseptic technique protocols and barrier precautions” (C-4), “Pressure injury (ulcer) prevention protocols” (C-13), and “Falls prevention initiatives” (C-14) in clinical level.

> P. 25, L. 287-288

The interventions that were given high priority by experts, but low priority by safety managers were shown in Table 7.

The interventions that were given high and low priority by experts and safety managers, respectively, were “Clinical governance frameworks and systems for patient safety” (O-1), “Patient-engagement initiatives” (O-5), and “Clinical communication protocols and training” (O-6) in the organizational level, “Central venous catheter insertion protocols” (C-6), “Procedural / surgical checklists” (C-8), “Peri-operative medication protocols” (C-10), and “Clinical care standards” (C-12) in the clinical level.

To clarify the definition of high and low priority, we added following explanations.

> P. 14, L. 207

We defined scores > 0 as 'high' and < 0 as 'low'.

Reviewer 2:

Comment 1

Dissemination and prioritization can be interpreted differently by various respondents. Were those that participated in the Delphi panel provided definitions of dissemination and prioritization?

Answer:

We prepared both survey forms focusing on items used in this study as supporting information to provide more detail on the wording of questions about these perspectives.

S1 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the Delphi survey.

S2 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the nationwide survey of patient safety managers in hospitals.

And we added following explanations.

> P. 6, L. 96-97

Parts of both questionnaire items used in this study were shown in S1 and S2 Tables.

Comment 2

In the analysis the authors state that "Except for the 10 system-level interventions not asked about dissemination in the questionnaire survey of safety managers..." Is there a rationale for why these 10 system level interventions were not included?

Answer:

To clarify the meaning of this matter, we corrected following explanations.

> P. 8, L. 143-148

We assessed the mean values of 32 interventions (Table1), consisting of 14 organizational-level interventions and 18 clinical-level interventions in past contribution, current dissemination, and priority for future implementation. The 10 system-level interventions were not included in the questionnaire for safety managers because these interventions involved the entire national healthcare system and could not be implemented in each hospital.

Except for the 10 system-level interventions not asked about dissemination in the questionnaire survey of safety managers, we assessed the mean values of 32 interventions (Table1), consisting of 14 organizational-level interventions and 18 clinical-level interventions in past contribution, present dissemination, and priority for future implementation.

Comment 3

In the discussion, it would be helpful to more clearly articulate what the potential reasons and implications are for differences in prioritization among experts and patient safety managers.

Answer:

We added following explanations.

> P. 226, L. 300-303

This difference seemed to be caused by that expert's assessment might include a healthcare system and policy perspective, while safety manager's assessment might be based on the needs and resources on their clinical and organizational settings.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 1

Keiko Nakamura

29 Nov 2022

PONE-D-22-13129R1Difference in prioritization of patient safety interventions between experts and patient safety managers in JapanPLOS ONE

Dear Dr. Hasegawa,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

Please submit your revised manuscript by Jan 12 2023 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Keiko Nakamura

Academic Editor

PLOS ONE

Journal Requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Additional Editor Comments:

The manuscript was reasonably revised according to the reviewers' comments with additional tables and supplementary tables.

Please pay attention to the following points and revise the manuscript accordingly.

Table 6 and Table 7 should not duplicate the results presented in Table 4a and Table 4b.

Combine Tables 6 and 7 and list the code (for example “O-2”) and interventions (for example “Clinical incident reporting and management system) showing “low priority by experts/high priority by managers” in one column (for example left column) and those showing “high priority by experts/low priority by manages” in another column (for example right column). The number of respondents and scores were presented in Table 4a and Table 4b, therefore these are not needed. A potential title of the updated Table 6 is “A summary list of interventions according to the priorities given by experts and safety managers”.

Confusing sentences are still remain.

“experts and safety managers had given high and low priority, respectively” (lines 284-285)

“experts and safety managers had given high and low priority” (line 322)

Clearer expressions are needed.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

PLoS One. 2023 Mar 1;18(3):e0280475. doi: 10.1371/journal.pone.0280475.r004

Author response to Decision Letter 1


27 Dec 2022

27/12/2022

Dear Dr. Keiko Nakamura,

Academic Editor, PLOS ONE

We thank you for the careful evaluation of our manuscript and allowing us to revise. We appreciate your valuable comments and we would like to respond as following:

Journal requirements:

Please review your reference list to ensure that it is complete and correct. If you have cited papers that have been retracted, please include the rationale for doing so in the manuscript text, or remove these references and replace them with relevant current references. Any changes to the reference list should be mentioned in the rebuttal letter that accompanies your revised manuscript. If you need to cite a retracted article, indicate the article’s retracted status in the References list and also include a citation and full reference for the retraction notice.

Answer:

We rechecked all our reference lists and determined everything was fine.

Additional Editor Comments 1

Table 6 and Table 7 should not duplicate the results presented in Table 4a and Table 4b.

Combine Tables 6 and 7 and list the code (for example “O-2”) and interventions (for example “Clinical incident reporting and management system) showing “low priority by experts/high priority by managers” in one column (for example left column) and those showing “high priority by experts/low priority by manages” in another column (for example right column). The number of respondents and scores were presented in Table 4a and Table 4b, therefore these are not needed. A potential title of the updated Table 6 is “A summary list of interventions according to the priorities given by experts and safety managers”.

Answer:

Following your suggestion, we combined Table 6 and Table 7 into new Table 6, revised the structure of Table 6, and changed the title of it.

Table 6. A summary list of interventions according to the priorities given by experts and safety managers

High priority by safety managers / Low priority by experts High priority by experts / Low priority by safety manages

Organizational level Organizational level

O-2 Clinical incident reporting and management system O-1 Clinical governance frameworks and systems for patient safety

O-9 Building a positive safety culture O-5 Patient-engagement initiatives

O-14 Medical equipment sterilization protocols O-6 Clinical communication protocols and training

Clinical level Clinical level

C-4 Aseptic technique protocols and barrier precautions C-6 Central venous catheter insertion protocols

C-13 Pressure injury (ulcer) prevention protocols C-8 Procedural / surgical checklists

C-14 Falls prevention initiatives C-10 Peri-operative medication protocols

    C-12 Clinical care standards

And, we corrected following explanations in the body.

> P. 22, L. 251

The interventions that were given high priority by safety managers, but low priority by experts were shown in left column of Table 6.

> P. 26, L. 277

The interventions that were given high priority by experts, but low priority by safety managers were shown in right column of Table 67.

Additional Editor Comments 2

Confusing sentences are still remain.

“experts and safety managers had given high and low priority, respectively” (lines 284-285)

“experts and safety managers had given high and low priority” (line 322)

Clearer expressions are needed.

Answer:

To simplify, we corrected following explanations.

> P. 26, L. 288-289

were given high priority by experts, but low priority by safety managers

experts and safety managers had given high and low priority, respectively

> P. 29, L. 328-329

were given high priority by experts, but low priority by safety managers

experts and safety managers had given high and low priority

We have rechecked our entire manuscript and aligned columns in Table 2b.

Table 2a. Baseline characteristics (Experts).

n %

Experts 24

Domain

Representative of nationwide organization related to patient safety 2 8.3

Hospital administrator 5 20.8

Patient safety manager 7 29.2

Researcher of patient safety 8 33.3

Other 2 8.3

Profession

Doctor 15 62.5

Nurse 4 16.7

Pharmacist 2 8.3

Others 3 12.5

Table 2b. Baseline characteristics (Safety managers).

  n %

Safety managers 603

Acute care hospital

< 100 beds 68 11.3

100–299 beds 178 29.5

≥ 300 beds 225 37.3

Chronic care hospital

< 100 beds 29 4.8

≥ 100 beds 48 8.0

Psychiatric hospital 46 7.6

Other hospitals 9 1.5

At the time of submission, the editorial team pointed out the following corrections.

Journal requirements:

Please provide additional details regarding participant consent.

In the Methods section, please ensure that you have specified (1) whether consent was informed and (2) what type you obtained (for instance, written or verbal).

If your study included minors, state whether you obtained consent from parents or guardians.

If the need for consent was waived by the ethics committee, please include this information.

Answer:

We did not obtain informed consent explicitly for participation in both investigations. However, all participants in both surveys were informed of the purposes of the surveys, data confidentiality and anonymity policies in the request letter. Additionally, taking part in the surveys was voluntary, not mandatory.

Both surveys did not include minors.

Based on our study protocols, the ethics committee did not request us to obtain participant consent.

We added following explanations.

> P. 6, L. 97-99

All participants of both surveys were informed about the research objective and the policy of data confidentiality and anonymity. Taking part in both surveys was voluntary, not mandatory. Therefore, we considered responses to surveys as consent to participate in the survey.

Attachment

Submitted filename: Response to Reviewers.docx

Decision Letter 2

Keiko Nakamura

3 Jan 2023

Difference in prioritization of patient safety interventions between experts and patient safety managers in Japan

PONE-D-22-13129R2

Dear Dr. Hasegawa,

We’re pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you’ll receive an e-mail detailing the required amendments. When these have been addressed, you’ll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Keiko Nakamura

Academic Editor

PLOS ONE

Additional Editor Comments (optional):

Reviewers' comments:

Acceptance letter

Keiko Nakamura

20 Feb 2023

PONE-D-22-13129R2

Difference in prioritization of patient safety interventions between experts and patient safety managers in Japan

Dear Dr. Hasegawa:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Professor Keiko Nakamura

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the Delphi survey.

    (PDF)

    S2 Table. Questionnaire items of evaluation on organizational and clinical level interventions for patient safety in the nationwide survey of patient safety managers in hospitals.

    (PDF)

    Attachment

    Submitted filename: Response to Reviewers.docx

    Attachment

    Submitted filename: Response to Reviewers.docx

    Data Availability Statement

    Data cannot be shared publicly, because we have been approved to conduct secondary data analyses, but not to share the data used by the ethics committee. These restrictions have been enforced by The Ethics Committee of Toho University School of Medicine. The external researchers can contact the Ethics Committee of Toho University School of Medicine regarding the use of the data but the committee does not accept applications other than Japanese language (med.rinri@ext.toho-u.ac.jp, +81-3-3762-4151). If an external researcher contacts the research team directly (tommie@med.toho-u.ac.jp (personal address of corresponding author), md20015h@st.toho-u.ac.jp (first author), health@med.toho-u.ac.jp (Department of Social Medicine, Toho University School of Medicine)), the research team members will submit reviews of external provision of data to the Ethics Committee on behalf of external researchers.


    Articles from PLOS ONE are provided here courtesy of PLOS

    RESOURCES