Abstract
Objective
Quantitative studies have shown the various benefits for having accreditation in hospitals. However, neither of these explored the general conditions before applying for an accreditation. To close this gap, this study aimed to investigate the possible association between joining an accreditation programme with various hospital characteristics.
Design
A cross-sectional study was implemented using the databases of the 2013 Hungarian hospital survey and of the Hungarian State Treasury.
Setting
Public general hospitals in Hungary.
Participants
The analysis involved 44 public general hospitals, 14 of which joined the preparatory project for a newly developed accreditation programme.
Main outcome measures
The outcomes included the percentage of compliance in quality management, patient information and identification, internal professional regulation, safe surgery, pressure sore prevention, infection control, the opinions of the heads of quality management regarding the usefulness of quality management and clinical audits, and finally, the total debt of the hospital per bed and per discharged patient.
Results
According to our findings, the general hospitals joining the preparatory project of the accreditation programme performed better in four of the six investigated activities, the head of quality management had a better opinion on the usefulness of quality management, and both the debt per bed number and the debt per discharged patient were lower than those who did not join. However, no statistically significant differences between the two groups were found in any of the examined outcomes.
Conclusions
The findings suggest that hospitals applying for an accreditation programme do not differ significantly in characteristics from those which did not apply. This means that if in the future the accredited hospitals become better than other hospitals, then the improvement could be solely contributed to the accreditation.
Keywords: quality in health care, clinical governance, organisation of health services, accreditation
Strengths and limitations of this study.
Due to the high response rate, the findings of this study can be generalised to all public general hospitals in Hungary.
Since the hospital survey was conducted in a single country, different health policies or financial environments did not impact the findings.
The findings cannot be generalised to private hospitals.
The questionnaire used in the study was originally designed for a national survey, not as a research instrument.
Introduction
The quantitative studies that investigate the usefulness of accreditation in healthcare are based on the premise that the written regulations in the accreditation standards directly influence the process of care. From studies that address this topic, we know that the accreditation of hospitals is associated with more mature quality management, better clinical practice,1 safer patient care,1 2 increased compliance in documentation,3–5 shorter length of stay for psychiatric inpatients,6 better attitudes towards medication error reporting7 and lower proportion of errors in medical prescriptions8 but are not associated with better performance measures for acute stroke, heart failure and ulcers.9 Furthermore, accreditation was shown to stimulate the improvement in health service organisations and promote high-quality organisational processes10 while also predict organisational culture and leadership.11 Although accreditation does not affect outcomes directly, we assume that if a positive association exists between accreditation and the process of care, then this positive effect must also be reflected in various outcomes. Although none of the studies found any association between accreditation and patient satisfaction,12–15 Danish studies have revealed that patients in fully accredited hospitals had a lower 30-day mortality risk16 and a modestly shorter length of stay but not a lower chance of acute readmission compared with patients in partially accredited hospitals,17 and the process of care significantly improved after accreditation.18 Also, a recent study had also revealed a positive association between the compliance with accreditation standards and the level of evidence-based hospital care.19 In addition, a retrospective longitudinal study conducted in the USA showed that patients in accredited hospitals had significantly fewer major complication outcomes following laparoscopic bariatric surgery compared with patients in non-accredited hospitals.20
Because of the nature of the statistical methods of these studies, whether the statistically significant findings are directly associated with accreditation or if there is a common independent explanatory factor cannot be determined. Some studies assume that the dedication of the top management to a high quality of care could be the primary explanatory factor.1 21 Although there is no evidence for this assumption, if there are indeed any kind of independent explanatory factors, then this creates a situation in which it is very difficult to determine whether obtaining accreditation is the true cause of the high quality of care within the institution. One possible way to determine if this is a relevant question is to compare the activities of hospitals before applying for accreditation to those who have not applied for accreditation. If we identify significant advantages for the hospitals that did apply for accreditation, then the conclusions of previous research studies need to be reinterpreted, and future studies are needed to identify the independent factors that explain both the intent for accreditation and the high quality of care.
To understand the circumstances of the current study, the following paragraphs provide an abridged description of the creation of the Hungarian accreditation system for healthcare. To supplement the ISO 9001 and Hungarian Health Care Standards (HHCS) certifications already used in the Hungarian healthcare system and to follow the trend of European countries,22 23 the plan to introduce an accreditation programme was considered in the early 2000s. A decade later, in December 2012, the 2-year European Union (EU)-funded Social Renewal Operating Programme (TÁMOP) 6.2.5.A-12/1-2012-0001 project was initiated to create the foundations of a voluntary Hungarian accreditation programme for healthcare.24 With a high emphasis on patient safety and following the requirements defined by the International Society for Quality in Healthcare, the accreditation standards and the assessment method for inpatient and outpatient institutions and public pharmacies were created by the end of the project.24 25 In addition, the accreditation programme obtained its official name: the Accreditation of Healthcare Providers for Safe Patient Care (BELLA).
The next project, TÁMOP-6.2.5/B-13/1-2014-0001, included multiple interventions to improve the quality of Hungarian healthcare, and one of these interventions was to prepare medical institutions to join the BELLA accreditation programme. This preparatory project lasted from October 2014 to November 2015, and overall, 30 hospitals and 15 outpatient institutions participated in it.26 When voluntarily joining the project, the institutions guaranteed that after the project ended, they would apply for the BELLA accreditation; otherwise, they would have to pay back the financial support that was provided by the project. Because of this high level of commitment, we assume that these institutions take the process of being accredited very seriously.
Methods
Aims of the study
The aims of this study were twofold: first, to determine if a difference already existed between the general hospitals, before the decision of joining or not joining the nationwide preparatory project for BELLA accreditation was made. To this end, we compared the hospitals in areas such as the maturity of quality management, patient information and identification, internal professional regulation, surgical procedures, pressure sore prevention, infection control as well as the quality managers’ opinion of the usefulness of quality management and clinical audits. The second aim was to investigate how the financial status of the hospitals might have influenced the decision to apply for this preparatory project. The investigation of this aim could have gone both ways. Either the hospitals with better financial status were the ones that could afford to apply for the project, or because of the lack of it the hospitals joining were desperate to get the financial benefits that came with the project. As no similar studies have been conducted before, both of the initial assumptions were considered feasible.
Data collection and data processing
The questionnaire from the 2013 Hungarian national hospital survey was used in this study and was created by the first two and last two authors of this paper. The foundation of the questionnaire was the 2009 national survey of the Health Insurance Supervisory Authority which was also used to study the association between the ISO 9001:2008 and the HHCS certifications and various quality-related activities.27 In the revised 2013 questionnaire, 144 questions involved general information about the institution, quality management, patient information, patient identification, internal professional regulation, safe surgery, pressure sore prevention and infection control. The quality management dimension included various activities regarding quality planning, quality control, quality assurance and quality improvement. Patient information and patient identification were in the same dimension in which the former asked when the patient was informed and by whom, while the latter asked if there was a local protocol on how to identify patients and if so, which patient groups are included in it. The internal professional regulation dimension asked questions regarding reanimation and the usage of local protocols and clinical audit. The questions of the safe surgery dimension were mostly from the WHO surgical safety checklist,28 while the pressure sore prevention and infection control dimensions asked questions on how these activities are conducted and in what manner are these documented, respectively.
At the end of the dimensions that considered quality management and internal professional regulation, seven specific questions were asked of the heads of quality management on the usefulness of quality management, and three additional questions were asked on the usefulness of clinical audits. These were the only professional questions that had continuous answer options from 1 to 5, whereas the others had single or multiple-choice options. All questions covered the state of the hospital on the 31 December 2013.
For the national survey, permission was given by the National Institute of Quality and Organizational Development in Healthcare and Medicines, which supervises and controls the 105 state-owned hospitals. The data collection was conducted online with the EvaSys programme (EvaSys Education Survey Automation Suite, V.6, Electric Paper Evaluationssysteme, Lüneburg, Germany). The data collection was performed in two phases. In the first phase, which lasted from February to June 2014, all 113 hospitals, which were members of the Hungarian Hospital Alliance, were addressed. Because the response rate was too low, the Department of Health Policy of the Hungarian Ministry of Human Capacities was asked to support the survey. After an agreement was made, the second phase of the data collection was performed from October to December 2014. Because of the circular provided by the Department of Health Policy, the response rate nearly doubled, and in the end, 81 hospitals (71.7% response rate) answered the questionnaire.
Because of the heterogeneous characteristics of the hospitals, several exclusion criteria were applied. From the original 81 hospitals in the database, those that are not general hospitals were ignored. Due to the lack of a uniform definition for a general hospital, the decision was made that four types of basic inpatient care—inpatient medicine for adults, inpatient medicine for children, surgery and obstetrics—had to be provided in order for a hospital to be considered a general hospital. Of the remaining 46 hospitals, one had participated in the creation of the BELLA accreditation standards. Because it had a head start, we assumed that in this institution, both the quality management and patient care were already influenced by the accreditation standards. In addition, one university hospital provided answers at the departmental level. Although attempts were made to generalise the answers to an institutional level, the answers varied to such a degree that it made a reliable generalisation unfeasible. The remaining 44 hospitals had bed numbers higher than 130, which was one of the requirements to participate in the Deepening our Understanding of Quality Improvement in Europe research project.29 To check whether the response rate was sufficient for drawing general conclusions at a national level, the National Health Insurance’s Annual Report on Hospital Bed Size and Patient Flow for 2013, which contains a list of all the hospitals in Hungary on the 31 December 2013, was used as a reference point.30
The questions considering the quality management and patient care activities were dichotomised, and the answers that were positive were aggregated for each hospital by dimension. The answers concerning the opinion on the usefulness of quality management and clinical audits were treated separately, and, therefore, the first dimension had a possible score between 7 and 35, and the second dimension had a possible score between 3 and 15. Thereafter, the percentage was calculated from the possible maximum score for every dimension. In the survey, each question had the option of “I cannot/do not want to answer the question”, and the hospitals, in many instances, took the opportunity to select this answer. In addition, on rare occasions, some questions remained unanswered. For these reasons, the answering ratio for the questions for each dimension had to be 90% or above. In cases where a hospital answered less than 90% of the questions of a dimension, that dimension was ignored in the statistical calculation for the given hospital.
The financial status of the hospital was measured using the institutions’ overall debt in Hungarian currency (Hungarian forint). These data were obtained from the Hungarian State Treasury (MÁK) for each general hospital regarding the last month of 2013. To avoid the confounding factor of the hospital size, the hospitals’ debt was calculated per the number of beds and per the number of patients discharged in 2013 separately.
The list of hospitals that participated in the nationwide preparatory project for the BELLA accreditation was obtained from the National Healthcare Service Centre (ÁEEK). This list was the basis for arranging the hospitals that answered the previously mentioned 2013 survey into two groups, namely, participating and non-participating hospitals.
Statistical analysis
Cronbach’s alpha was used to test the internal reliability of the dimensions of the questionnaire, and the Kolmogorov-Smirnov test was applied to check the normality of the distributions of each dimension for both groups depending on their participation in the project. We rejected the normality if the P value was <0.01. A Spearman’s correlation was used to investigate the possible associations between the dimensions. To determine the statistical significance of the differences between the two groups, a Mann-Whitney U test and an independent t-test were used depending on the normality of the distributions. With the exception of the test of normality, the level of significance was set at <0.05 for the entire statistical analysis. The SPSS V.22 software programme (SPSS for Windows, V.22.0, IBM, Released 2013. Armonk, New York, USA) was used during the statistical analysis.
Results
Descriptive statistics
The 44 general hospitals included in this study represented 73.3% of all general hospitals in Hungary in 2013. Of the original 30 hospitals that joined the preparatory project for the BELLA accreditation, 11 were not general hospitals and of the remaining 19 only 14 took part in the survey. The answers of the 30 hospitals that did not take part in the preparatory project were used for comparison. The hospital-related characteristics of the 44 institutions are indicated in table 1. Of the four hospitals that completed the questionnaire and were owned by a private company or by a foundation, none were general hospitals. Thus, only public hospitals were analysed in this study.
Table 1.
Characteristics of the general hospitals that participated in the study
| Characteristics | Participated in the preparatory project* (n=14) | Did not participate in the preparatory project* (n=30) | Total (n=44) | |||
| Ownership | ||||||
| EMMI | 1 | 7.1% | 2 | 6.7% | 3 | 6.8% |
| GYEMSZI | 12 | 85.7% | 26 | 86.7% | 38 | 86.4% |
| Other ministry | 1 | 7.1% | 2 | 6.7% | 3 | 6.8% |
| Private | 0 | 0% | 0 | 0% | 0 | 0% |
| Teaching status | ||||||
| University hospital | 1 | 7.1% | 2 | 6.7% | 3 | 6.8% |
| Teaching hospital | 9 | 64.3% | 22 | 73.3% | 31 | 70.5% |
| Non-teaching hospital | 4 | 28.6% | 6 | 20.0% | 10 | 22.7% |
| Hospital beds | ||||||
| 131–500 | 4 | 28.6% | 12 | 40.0% | 16 | 36.4% |
| 501–1000 | 2 | 14.3% | 10 | 33.3% | 12 | 27.3% |
| >1000 | 8 | 57.1% | 8 | 26.7% | 16 | 36.4% |
| Certification/excellence award | ||||||
| ISO 9001:2008 | 12 | 85.7% | 29 | 96.7% | 41 | 93.2% |
| ISO 14001:2005 | 8 | 57.1% | 10 | 33.3% | 18 | 40.9% |
| OHSAS 18001:2007 | 2 | 14.3% | 1 | 3.3% | 3 | 6.8% |
| HHCS | 11 | 78.6% | 18 | 60.0% | 29 | 65.9% |
| EFQM | 2 | 14.3% | 1 | 3.3% | 3 | 6.8% |
*The preparatory project for the BELLA accreditation.
BELLA, Accreditation of Healthcare Providers for Safe Patient Care; EMMI, Ministry of Human Capacities; GYEMSZI, National Institute for Quality and Organizational Development in HealthCare and Medicine; HHCS, Hungarian Health Care Standards.
Answering ratio of questions, normality and internal reliability
When the answering ratios of questions for each dimension were assessed, overall, 34 answers were excluded at a dimensional level (table 2). The test of normality varied according to dimension and participation. The internal reliability was strong in quality management (α=0.78) and pressure sore prevention (α=0.80), as well as in the opinion on quality management (α=0.89) and clinical audits (α=0.86). There was a somewhat below acceptance level of internal reliability in safe surgery (α=0.64), and the internal reliability was weak in patient information and identification (α=0.35), internal professional regulation (α=0.49) and infection control (α=0.57).
Table 2.
Answering ratio of questions, normality and internal reliability of the dimensions
| Dimension (n=number of questions) |
Participated in the preparatory project* | Did not participate in the preparatory project* | Cronbach’s alpha† | ||||
| Answer below 90% (n) | Answer 90% or above (n) | Kolmogorov-Smirnov test (P value)† |
Answer below 90% (n) | Answer 90% or above (n) | Kolmogorov-Smirnov test (P value)† |
||
| Quality management (n=19) | 1 | 13 | 0.001 | 3 | 27 | 0.003 | 0.78 |
| Patient information and identification (n=10) |
0 | 14 | <0.001 | 1 | 29 | <0.001 | 0.35 |
| Internal professional regulation (n=10) | 2 | 12 | 0.20 | 0 | 30 | 0.014 | 0.49 |
| Safe surgery (n=35) |
3 | 11 | 0.14 | 2 | 28 | 0.04 | 0.64 |
| Pressure sore prevention (n=34) | 0 | 14 | 0.20 | 0 | 30 | 0.20 | 0.80 |
| Infection control (n=18) |
0 | 14 | 0.10 | 3 | 27 | 0.025 | 0.57 |
| Opinion on quality management (n=7) | 0 | 14 | 0.20 | 4 | 26 | 0.20 | 0.89 |
| Opinion on clinical audit (n=3) | 0 | 14 | 0.043 | 6 | 24 | <0.001 | 0.86 |
*The preparatory project for the BELLA accreditation.
†Calculations were only made where the answering ratio for the questions was 90% or greater.
BELLA, Accreditation of Healthcare Providers for Safe Patient Care.
Correlation matrix
Spearman’s correlation matrix (table 3) reveals significant moderate-level associations between the dimensions of quality management and internal professional regulation (r=0.52, P=0.001), infection control and pressure sore prevention (r=0.48, P=0.001), internal professional regulation and opinion on clinical audits (r=0.39, P=0.019), and opinion on quality management and opinion on clinical audits (r=0.60, P<0.001). Since no strong correlation was identified, a common explanatory factor underlying the dimensions can be ruled out, and thus, these dimensions could be assessed independently from each other.
Table 3.
Spearman’s correlation matrix of the dimensions
| Dimensions (n=number of questions) |
QM | PII | IPR | SS | PSP | IC | OQM | |||||||
| r value | P value | r value | P value | r value | P value | r value | P value | r value | P value | r value | P value | r value | P value | |
| Quality management (n=19) | – | – | – | – | – | – | – | – | – | – | – | – | – | – |
| Patient information/identification (n=10) | 0.29 | 0.07 | – | – | – | – | – | – | – | – | – | – | – | – |
| Internal professional regulation (n=10) | 0.52 | 0.001* | 0.20 | 0.20 | – | – | – | – | – | – | – | – | – | – |
| Safe surgery (n=35) | 0.31 | 0.07 | 0.10 | 0.53 | 0.16 | 0.34 | – | – | – | – | – | – | – | – |
| Pressure sore prevention (n=34) | 0.02 | 0.92 | 0.13 | 0.42 | 0.27 | 0.08 | 0.06 | 0.73 | – | – | – | – | – | – |
| Infection control (n=18) | 0.06 | 0.71 | −0.11 | 0.16 | 0.16 | 0.33 | 0.09 | 0.60 | 0.48 | 0.001* | – | – | – | – |
| Opinion on quality management (n=7) | 0.03 | 0.85 | 0.23 | 0.15 | 0.26 | 0.12 | 0.31 | 0.07 | 0.15 | 0.34 | 0.13 | 0.45 | – | – |
| Opinion on clinical audits (n=3) | −0.03 | 0.99 | −0.17 | 0.32 | 0.39 | 0.019* | 0.34 | 0.050 | 0.27 | 0.10 | 0.09 | 0.62 | 0.60 | <0.001* |
*P<0.05.
IC, infection control; IPR, internal professional regulation; OQM, opinion on quality management; PII, patient information and identification; PSP, pressure sore prevention; QM, quality management; SS, safe surgery.
Comparative statistics
Comparisons of the participating general hospitals with the non-participating hospitals revealed no statistically significant differences in any of the measured activities (table 4). Additionally, the hospitals that participated in the preparatory project had lower means of debt per bed number and per the number of discharged patients than those that did not join, but the differences were not statistically significant (table 5). However, it is worth mentioning that the SDs of the debt ratios were very high. When attempts were made to remove the outlier data from the calculations, this has not decreased the SDs in a meaningful way.
Table 4.
Statistical analysis of the hospitals in each dimension grouped by participation in the project
| Dimension (n=number of questions) |
Participated in the preparatory project* | Did not participate in the preparatory project* | Participated versus did not participate |
|||||||||
| Answer (n) |
Max/min | Mean/median† | Q3/Q1 | SD/IQR† | Answer (n) |
Max/min | Mean/median† | Q3/Q1 | SD/IQR† | Statistical method† | P value | |
| Quality management (n=19) | 13 | 100.0 | 94.7 | 97.4 | 13.6 | 27 | 100.0 | 89.5 | 94.7 | 10.5 | Mann-Whitney U test | 0.574 |
| 36.8 | 83.8 | 47.4 | 84.2 | |||||||||
| Patient information and identification (n=10) |
14 | 100.0 | 100.0 | 100.0 | 10.0 | 29 | 100.0 | 100.0 | 100.0 | 10.0 | Mann-Whitney U test | 0.706 |
| 80.0 | 90.0 | 70.0 | 90.0 | |||||||||
| Internal professional regulation (n=10) | 12 | 100.0 | 86.6 | 97.5 | 11.5 | 30 | 100.0 | 81.8 | 90.0 | 13.3 | Student’s t-test | 0.280 |
| 60.0 | 80.0 | 50.0 | 70.0 | |||||||||
| Safe surgery (n=35) | 11 | 97.1 | 87.9 | 94.3 | 8.6 | 28 | 100.0 | 91.2 | 96.4 | 5.7 | Student’s t-test | 0.170 |
| 68.6 | 82.9 | 80.0 | 85.7 | |||||||||
| Pressure sore prevention (n=34) | 14 | 100.0 | 74.9 | 83.0 | 12.7 | 30 | 94.1 | 72.4 | 82.0 | 14.7 | Student’s t-test | 0.588 |
| 55.9 | 63.9 | 35.3 | 61.5 | |||||||||
| Infection control (n=18) | 14 | 100.0 | 86.7 | 100.0 | 9.7 | 27 | 100.0 | 80.6 | 88.9 | 11.1 | Student’s t-test | 0.089 |
| 72.2 | 77.8 | 61.1 | 72.2 | |||||||||
| Opinion on quality management (n=7) | 14 | 100.0 | 84.7 | 97.1 | 13.6 | 26 | 100.0 | 83.5 | 95.0 | 13.5 | Student’s t-test | 0.794 |
| 57.1 | 73.6 | 57.1 | 74.3 | |||||||||
| Opinion on clinical audit (n=3) | 14 | 100.0 | 83.3 | 100.0 | 20.0 | 24 | 100.0 | 83.3 | 100.0 | 20.0 | Mann-Whitney U test | 0.392 |
| 60.0 | 80.0 | 73.3 | 80.0 | |||||||||
*The preparatory project for the BELLA accreditation.
†Depending on the normality of the distributions.
BELLA, Accreditation of Healthcare Providers for Safe Patient Care.
Table 5.
Statistical analysis of hospital debt grouped by participation
| Hospital debt | Participated in the preparatory project* | Did not participate in the preparatory project* | Participated versus did not participate | ||||
| Descriptive statistics | K-S test (P value) |
Descriptive statistics | K-S test (P value) |
Student’s t-test (P value) |
|||
| Total debt of the hospital/the number of beds (HUF 1000) |
Max | 1543.0 | 0.162 | Max | 2680.1 | 0.181 | 0.400 |
| Min | 2.0 | Min | 0 | ||||
| Q3 | 852.1 | Q3 | 1130.3 | ||||
| Q1 | 439.9 | Q1 | 317.4 | ||||
| Mean | 701.5 | Mean | 862.9 | ||||
| Median | 641.7 | Median | 812.3 | ||||
| SD | 392.5 | SD | 654.4 | ||||
| Total debt of the hospital/annual patients discharged (HUF 1000) |
Max | 44.0 | 0.200 | Max | 60.9 | 0.038 | 0.487 |
| Min | 0.1 | Min | 0 | ||||
| Q3 | 25.1 | Q3 | 34.1 | ||||
| Q1 | 12.3 | Q1 | 9.0 | ||||
| Mean | 19.9 | Mean | 23.2 | ||||
| Median | 20.6 | Median | 21.4 | ||||
| SD | 10.3 | SD | 16.1 | ||||
*The preparatory project for the BELLA accreditation.
BELLA, Accreditation of Healthcare Providers for Safe Patient Care; HUF, Hungarian forint; K-S test, Kolmogorov-Smirnov test; Max, maximum.
Discussion
Implications for the BELLA accreditation
Because earlier studies had shown that neither ISO 9001 and the Hungarian Hospital Care Standards nor the HHCS had provided substantial benefits for hospitals regarding health-specific activities,27 31 it is imperative that we assess in what areas the BELLA accreditation will give added value to the hospitals in Hungary. To date, only one published study has addressed this question.32 Although this research only investigated the changes in patient safety culture among staff members before and after the development of the BELLA accreditation standards, these results might indicate the actual benefits after the hospitals obtain their accreditation. According to the findings, a statistically significant improvement was detected regarding organisational learning, continuous improvement, communication openness and teamwork.
Our study gives context for future studies investigating the impact of the BELLA accreditation. Since no significant advantages were detected among the hospitals applying for the preparatory project, future differences can be solely contributed to the accreditation. Furthermore, the notion that the hospitals only joined the EU-funded project for financial gains is questioned by the finding that the average debt rate of these hospitals was lower than those that did not join the project.
Implications for international studies
Surprisingly, no connection was found between quality management activities and the opinions on their usefulness (r=0.03, P=0.85). In addition, although most of the heads of quality management agreed with the usefulness of clinical audits, only 24.4% of the general hospitals reported conducting at least one in 2013.33 Furthermore, in many cases, nursing audits and process audits were reported as clinical audits; thus, the ratio of hospitals that use genuine clinical audits in Hungary is much smaller. All of these results might lead to the conclusion that the usefulness of asking the opinions of the heads of quality management on various activities is questionable. A possible explanation is that the opinions of the heads of quality management are a reflection of what should be, not of reality. For example, the heads of quality management may understand the importance of clinical audits, but without sufficient support from top management, they cannot be properly implemented. This assumption should be investigated in future studies.
The results of the comparative statistics suggest that the assumption that there might be an independent explanatory factor explaining both the intent for accreditation and high quality of care1 21 is unfounded. Because no significant differences were identified between the two groups of Hungarian general hospitals, we conclude that accreditation is not a method that selects hospitals which already perform better, but rather it is a tool that—if implemented correctly—can contribute to the further development of hospital activities. This also means that the benefits identified in quantitative studies regarding hospitals are indeed due to the accreditation.
Our study did not explore how the top management differs in hospitals that applied for an accreditation programme from those that did not. Since in countries where accreditation is not mandatory, the management has the authority to initiate the process to apply for one, it would be worthwhile to investigate the various attitudes and beliefs of management and to identify the key factors that make them more open to obtaining an accreditation for their hospitals.
Strengths and limitations
Because of the 73.3% response rate, the findings of this study can be generalised to all public general hospitals in Hungary. Alas, the sample size was not high enough to manage the high SDs of the debt ratios. Because the survey was conducted in a single country, including confounding factors, such as different health policies or financial environments, in the analysis was unnecessary. However, no private hospital participated in this study. This is due to the fact that there are not many private hospitals in Hungary, they normally provide specialised care and they rarely take part in government or academic surveys. Also, the 2013 questionnaire was originally designed for a national survey, not as a research instrument. The low Cronbach’s alpha score in three dimensions of patient care is attributed to this shortcoming. Nevertheless, the dimensions of quality management, pressure sore prevention and the opinions on quality management and clinical audits have strong internal reliability. Additionally, the answer option “I cannot/do not want to answer the question” acted as a double-edged sword. This option prevented hospitals from giving false information on specific activities because the question was ambiguous or it touched on a sensitive topic. However, this answer option led to a situation where not all questions were answered in each dimension per hospital, which weakened the overall level of evidence of the conclusions drawn from the statistical analysis. Because using valid information is more important than swelling the number of the sample, we believe that the benefits of introducing this option in the questionnaire outweighed the overall costs.
Conclusion
This is the first study that examines the hospital characteristics before applying for an accreditation programme through statistical methods, which resulted in two key findings. First, since no differences were identified in the maturity of quality management, patient care and the debt rate, both notions that either only hospitals with excellent performance or only hospitals lagging behind the rest are prompted to apply for accreditation are questionable. From this statement rises the second conclusion, that future differences in favour of accredited hospitals could be attributed to the effect of accreditation itself. Both of these conclusions give us a better understanding on the interpretation of results regarding research studies about accreditation in hospital care.
Finally, we suggest that future studies investigating the status of hospitals before applying for an accreditation should focus on the various knowledge, interests, attitudes and beliefs of the hospital management regarding accreditation and quality in general via interviews or questionnaires.
Supplementary Material
Acknowledgments
The authors would like to express their gratitude to the National Institute of Quality and Organizational Development in Healthcare and Medicines for authorising the 2013 survey in its hospitals, the Hungarian Hospital Alliance and the Hungarian National Committee of the European Organization for Quality for supporting the 2013 survey and the Department of Health Policy of the Hungarian Ministry of Human Capacities for first supporting and then facilitating the second phase of the 2013 data collection. The authors would also like to thank the hospital leaders for participating in the 2013 survey and all the hospital staff who were involved in completing the questionnaires.
Footnotes
Contributors: VD and SG designed the study, wrote the first draft of the paper and coordinated the contributions from the other coauthors. VD, SG, BM and TG created the questionnaire and conducted the nationwide hospital survey of 2013. JS and OKBC designed and conducted the statistical analyses. CD planned and interpreted the analysis regarding hospital debt. All the authors made critical comments on the drafts of the paper. All the authors read and approved the final manuscript.
Funding: The work is supported by the GINOP-2.3.2-15-2016-00005 project. The project is cofinanced by the European Union under the European Regional Development Fund.
Competing interests: VD and SG were involved in and supported by the European Union-funded TÁMOP-6.2.5.A-12/1- 2012-0001 project, which sought to create the foundation of a Hungarian accreditation system called the Accreditation of Healthcare Providers for Safe Patient Care (BELLA).
Patient consent: Not required.
Provenance and peer review: Not commissioned; externally peer reviewed.
Data sharing statement: Data available on request from the corresponding author.
References
- 1.Shaw C, Groene O, Mora N, et al. Accreditation and ISO certification: do they explain differences in quality management in European hospitals? Int J Qual Health Care 2010;22:445–51. 10.1093/intqhc/mzq054 [DOI] [PubMed] [Google Scholar]
- 2.Suñol R, Vallejo P, Thompson A, et al. Impact of quality strategies on hospital outputs. Qual Saf Health Care 2009;18 Suppl 1(Suppl. 1):i62–i68. 10.1136/qshc.2008.029439 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Devkaran S, O’Farrell PN. The impact of hospital accreditation on clinical documentation compliance: a life cycle explanation using interrupted time series analysis. BMJ Open 2014;4:e005240 10.1136/bmjopen-2014-005240 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Al-Sughayir MA. Does accreditation improve pro re nata benzodiazepines administration in psychiatric inpatients? Pre-post accreditation medical record comparison. Int J Ment Health Syst 2017;11:16 10.1186/s13033-017-0124-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Nomura AT, Silva MB, Almeida MA. Quality of nursing documentation before and after the Hospital Accreditation in a university hospital. Rev Lat Am Enfermagem 2016;24:e2813 10.1590/1518-8345.0686.2813 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Al-Sughayir MA. Effect of accreditation on length of stay in psychiatric inpatients: pre-post accreditation medical record comparison. Int J Ment Health Syst 2016;10:55 10.1186/s13033-016-0090-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Lee E. Safety climate and attitude toward medication error reporting after hospital accreditation in South Korea. Int J Qual Health Care 2016;28:508–14. 10.1093/intqhc/mzw058 [DOI] [PubMed] [Google Scholar]
- 8.Mekory TM, Bahat H, Bar-Oz B, et al. The proportion of errors in medical prescriptions and their executions among hospitalized children before and during accreditation. Int J Qual Health Care 2017;29:366–70. 10.1093/intqhc/mzx031 [DOI] [PubMed] [Google Scholar]
- 9.Bogh SB, Falstie-Jensen AM, Bartels P, et al. Accreditation and improvement in process quality of care: a nationwide study. Int J Qual Health Care 2015;27:336–43. 10.1093/intqhc/mzv053 [DOI] [PubMed] [Google Scholar]
- 10.Hinchcliff R, Greenfield D, Moldovan M, et al. Narrative synthesis of health service accreditation literature. BMJ Qual Saf 2012;21:979–91. 10.1136/bmjqs-2012-000852 [DOI] [PubMed] [Google Scholar]
- 11.Braithwaite J, Greenfield D, Westbrook J, et al. Health service accreditation as a predictor of clinical and organisational performance: a blinded, random, stratified study. Qual Saf Health Care 2010;19:14–21. 10.1136/qshc.2009.033928 [DOI] [PubMed] [Google Scholar]
- 12.Heuer AJ. Hospital accreditation and patient satisfaction: testing the relationship. J Healthc Qual 2004;26:46–51. [DOI] [PubMed] [Google Scholar]
- 13.Sack C, Lütkes P, Günther W, et al. Challenging the holy grail of hospital accreditation: a cross sectional study of inpatient satisfaction in the field of cardiology. BMC Health Serv Res 2010;10:120 10.1186/1472-6963-10-120 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Sack C, Scherag A, Lütkes P, et al. Is there an association between hospital accreditation and patient satisfaction with hospital care? A survey of 37,000 patients treated by 73 hospitals. Int J Qual Health Care 2011;23:278–83. 10.1093/intqhc/mzr011 [DOI] [PubMed] [Google Scholar]
- 15.Haj-Ali W, Bou Karroum L, Natafgi N, et al. Exploring the relationship between accreditation and patient satisfaction - the case of selected Lebanese hospitals. Int J Health Policy Manag 2014;3:341–6. 10.15171/ijhpm.2014.116 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Falstie-Jensen AM, Larsson H, Hollnagel E, et al. Compliance with hospital accreditation and patient mortality: a Danish nationwide population-based study. Int J Qual Health Care 2015;27:165–74. 10.1093/intqhc/mzv023 [DOI] [PubMed] [Google Scholar]
- 17.Falstie-Jensen AM, Nørgaard M, Hollnagel E, et al. Is compliance with hospital accreditation associated with length of stay and acute readmission? A Danish nationwide population-based study. Int J Qual Health Care 2015;27:451–8. 10.1093/intqhc/mzv070 [DOI] [PubMed] [Google Scholar]
- 18.Bogh SB, Falstie-Jensen AM, Hollnagel E, et al. Improvement in quality of hospital care during accreditation: A nationwide stepped-wedge study. Int J Qual Health Care 2016;28:715–20. 10.1093/intqhc/mzw099 [DOI] [PubMed] [Google Scholar]
- 19.Falstie-Jensen AM, Bogh SB, Hollnagel E, et al. Compliance with accreditation and recommended hospital care-a Danish nationwide population-based study. Int J Qual Health Care 2017;29:625–33. 10.1093/intqhc/mzx104 [DOI] [PubMed] [Google Scholar]
- 20.Telem DA, Talamini M, Altieri M, et al. The effect of national hospital accreditation in bariatric surgery on perioperative outcomes and long-term mortality. Surg Obes Relat Dis 2015;11:749–57. 10.1016/j.soard.2014.05.012 [DOI] [PubMed] [Google Scholar]
- 21.Shaw CD, Groene O, Botje D, et al. The effect of certification and accreditation on quality management in 4 clinical services in 73 European hospitals. Int J Qual Health Care 2014;26(Suppl 1):100–7. 10.1093/intqhc/mzu023 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Lombarts MJ, Rupp I, Vallejo P, et al. Application of quality improvement strategies in 389 European hospitals: results of the MARQuIS project. Qual Saf Health Care 2009;18(Suppl 1):i28–i37. 10.1136/qshc.2008.029363 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Shaw C, Bruneau C, Kutryba B, et al. Towards hospital standardization in Europe. Int J Qual Health Care 2010;22:244–9. 10.1093/intqhc/mzq030 [DOI] [PubMed] [Google Scholar]
- 24.Belicza É, Lám J, Safadi H, et al. A BELLA akkreditációs program szerepe a betegellátás biztonságának javításában, 1. rész: A fejlesztési módszertan [The role of the BELLA accreditation program in improving the safety of patient care, part 1: the method of development]. IME - Az egészségügyi vezetők szaklapja 2015;14:8–12. [Google Scholar]
- 25.Belicza É, Lám J. Az egészségügyi szolgáltatók akkreditációs rendszere: a BELLA projekt háttere [Accreditation system for healthcare providers – background of project BELLA]. Egészségügyi Gazdasági Szemle 2014;52:2–6. [Google Scholar]
- 26.Belicza É, Lám J. A BELLA akkreditációs program aktualitásai [The actualities of the BELLA accreditation program]. 2015. http://demin.hu/files/userfiles/DEMIN_XV/DEMIN-XV-E/1-1-3-DEMIN-XV-E-BE-LJ.pdf (accessed 14 Aug 2017).
- 27.Dombrádi V, Csenteri OK, Sándor J, et al. Association between the application of ISO 9001:2008 alone or in combination with health-specific standards and quality-related activities in Hungarian hospitals. Int J Qual Health Care 2017;29:283–9. 10.1093/intqhc/mzx016 [DOI] [PubMed] [Google Scholar]
- 28.Messahel FM, Al-Qahtani AS. Benchmarking of World Health Organization surgical safety checklist. Saudi Med J 2009;30:422–5. [PubMed] [Google Scholar]
- 29.Secanell M, Groene O, Arah OA, et al. Deepening our understanding of quality improvement in Europe (DUQuE): overview of a study of hospital quality management in seven countries. Int J Qual Health Care 20141:5–15. 10.1093/intqhc/mzu025 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 30.National Health Insurance Fund of Hungary. Kórházi ágyszám- és betegforgalmi kimutatás 2013 [Report on Hospital Bed Size and Patient Flow in 2013]. 2014. http://www.oep.hu//data/cms1009257/korhazi_agyszam2013.zip (accessed 14 Aug 2017).
- 31.Makai P, Klazinga N, Wagner C, et al. Quality management and patient safety: survey results from 102 Hungarian hospitals. Health Policy 2009;90:175–80. 10.1016/j.healthpol.2008.09.009 [DOI] [PubMed] [Google Scholar]
- 32.Lám J, Merész G, Bakacsi G, et al. A betegbiztonságot támogató szervezeti kultúra változása a hazai akkreditációs programot tesztelő intézményekben [Changing of the patient safety culture in the pilot institutes of the Hungarian accreditation program]. Orv Hetil 2016;157:1667–73. [DOI] [PubMed] [Google Scholar]
- 33.Gődény S, Margitai B, Dombrádi V, et al. A Debreceni Egyetem Népegészségügyi Kar felmérése a magyarországi kórházak minőségügyi rendszeréről - 2013 [The 2013 survey of the quality management systems in Hungarian hospitals conducted by the Facultiy of Public Health, University of Debrecen]. 2015. https://drive.google.com/folderview?id=0B1zmT4OyUmvxfk9KdlNkSWE2MHNuMFRXNXZ2dWYwNVoyTlZrS0lMaVNnbG5QS0JMYWUxTVk&usp=sharing (accessed 14 Aug 2017).
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
