Skip to main content
International Journal of Environmental Research and Public Health logoLink to International Journal of Environmental Research and Public Health
. 2022 Nov 24;19(23):15640. doi: 10.3390/ijerph192315640

Assessing the Efficiency and Productivity of the Hospital Clinics on the Island of Rhodes during the COVID-19 Pandemic

Lorena Androutsou 1, Michail Kokkinos 1,2, Dimitra Latsou 1,*, Mary Geitona 1,3
Editor: Paul B Tchounwou
PMCID: PMC9735861  PMID: 36497714

Abstract

(1) Background: The aim was to measure the efficiency and productivity of 15 specialty clinics during the COVID-19 pandemic period 2020–2021 in the General Hospital of Rhodes. (2) Methods: An input-oriented data envelopment analysis and the Malmquist productivity index are used. Labor and capital were used as inputs, and in-patient discharges and days were used as outputs. (3) Results: Five out of the seven clinics in the pathology sector appeared fully efficient with an optimal productivity, and the rest showed progress in 2021. In 2020 the COVID-19 pathology clinic appeared to be inefficient and less productive, while in 2021, it showed a positive performance change. The surgical sector showed very high efficiency rates or even reached an optimal efficiency in both years. The productivity measurement, in most of the surgical clinics, was satisfactory to very high. In 2020 the COVID-19 surgical clinic appeared to be more efficient and productive than in 2021 when its performance declined. (4) Conclusions: The hospital responded to the pressure during the pandemic, by increasing its efficiency and productivity from 2020 to 2021. This was due to the accomplishment of the appropriate organizational changes in the infrastructure, human resources, and technology. The efficiency and productivity assessments should be incorporated in the hospitals’ decision making.

Keywords: efficiency, productivity, data envelopment analysis (DEA), Malmquist, hospital, COVID-19, Greece

1. Introduction

The COVID-19 health crisis intensified the cooperation and solidarity between states and organizations, boosted technological advances, and redefined new pathways in resources’ management. More importantly it emphasized accessibility, sustainability, and created opportunities and new perspectives in health care systems [1,2]. This situation resulted to an increased health care expenditure [3], urged the necessity to adopt control systems, and apply effectiveness and efficiency criteria in health systems [4]. Hospitals had to develop new clinical, managerial, and public health practices focusing on COVID-19 care, while simultaneously, they had to sustain the efficiency and quality of healthcare. Thus, the need for better resources’ management and performance assessments focusing on the measurement and comparative analysis of efficiency and productivity, became more demanding, in order to highlight the best practices.

Efficiency and productivity are interrelated concepts [5]. Efficiency refers to the “comparison between an existing function with the optimal one” [6]. Productivity is the measure of the production capacity, including the measurement of efficiency to achieve the greatest performance with the lesser effort [7,8]. The data envelopment analysis (DEA) method is a key tool for performing these measurements. Charnes, Cooper, and Rhodes started, in 1978, the theoretical development of the DEA approach on how to produce a measure of efficiency for decision-making units (DMUs) [9]. This is a non-parametric method of mathematical programming capable of handling multiple inputs and outputs expressed in different measurement units, therefore it is considered as a multi-criteria approach. The units (organizations) that convert the inputs into outputs are referred to as DMUs and determine the best organizations (best-practice) to determine the “efficiency limit” [10]. The DEA provides two options while creating models: input or output oriented. The computation of DEA can be performed under both variable returns to scale (VRS) and the constant returns to scale (CRS). The CRS score captures the global (in)efficiency, whereas the VRS and the “scale” scores decompose the global score into pure technical efficiency and scale efficiency, respectively [9,11,12]. The conversion of the inputs into outputs relative to best practice is referred to as the technical efficiency. Depending on the input-output ratio of efficiency, it provides the ability of an organization to produce as much output as the input allows, or to use as little input as the output production allows [9,13].

The DEA also includes the Malmquist productivity index (MI) for each DMU. Founded by Malmquist [14], adopted by Caves et al. [15], and developed by Färe et al. [12] as a productivity indicator, based on the DEA, it measures the productivity change, diachronically. The VRS/CRS option has no influence on the Malmquist DEA because both are used to calculate various distances used to construct the Malmquist indices [16,17]. The application of this non-parametric mathematical programming method is a commonly used technique for recording data and calculating indicators of the total productivity change and its components (technological change, pure technical efficiency, scale efficiency) [5,6,9,13,15,16,17,18,19,20]. The DEA analysis has been widely used in other economic sectors and the theoretical modeling has been extended with the combination of new variables [9,12,15,19,21,22,23,24,25,26,27,28,29].

The number of studies, based on the DEA methods, is gradually increasing and the DEA is the most frequently used tool for the efficiency evaluation [30], with healthcare and hospitals being among the most popular topics [31]. When applying the DEA in health care, the DMU is usually defined as an entire hospital or clinic (homogeneous or heterogeneous). The DEA facilitates a comparative analysis while evaluating the results for one year or diachronically. Studies in efficiency measurement, using parametric or non-parametric techniques in the hospital sector, have been conducted in several countries, including Greece [32,33,34,35,36,37,38,39,40,41,42,43,44,45,46,47,48,49]. However, the published bibliography assessing the efficiency at the clinical level by running the DEA [50,51,52], has been limited with only a single study examining the combined efficiency and productivity in Greece [42]. In early 2020, the COVID-19 pandemic was declared by the WHO, urging the need to reallocate resources and recruit personnel efficiently and productively, as one of the main measures to respond to this health system crisis.

Greece was also hit by the COVID-19 pandemic. The government responded immediately by introducing policies in the healthcare sector [53,54,55]. At the hospital level, numerous measures were implemented focusing on organizational, administrative, and managerial interventions. Fundamental changes included the reallocation of beds, personnel, and medical equipment, the clinics’ transformations into COVID-19 units, additional response funding, and patients’ management. Even though numerous studies have explored the efficiency and productivity of hospitals by using the DEA in Greece, there are no studies conducted during the COVID-19 pandemic. There is also a very limited number of similar studies worldwide.

Thus, the aim of this study was to assess the clinics’ efficiency and productivity of the General Hospital of Rhodes during the 2020–2021 pandemic, by applying the DEA and MI models. The hospital under study is located in the island of Rhodes, which is remote from the Greek mainland. On an annual basis, the hospital covers the patient care for approximately 350,000 people, including the residents of Rhodes and the neighboring smaller islands, as well as tourists and refugees [56]. During the examined years, the capacity of the hospital was 22 clinics, 400 beds, and 580 staff. More specifically, in 2020, there were 23,000 in-patients and approximately 60,000 hospitalization days, which increased slightly in 2021, to 24,000 and 65,000, accordingly. The COVID-19 patients were 405 in 2020 with 1200 hospitalization days, while in 2021, the patient number tripled to 1500 with a 525% increase in hospitalization days (7500).

2. Materials and Methods

A case study was conducted in the largest hospital of the South Aegean region. The methodology applied was the DEA and MI. The efficiency and productivity were assessed in heterogeneous and homogenous clinics. Out of the 22 clinics, seven were excluded from the analysis, based on the following criteria: intensive care units (ICUs) due to patients’ emergency profile feature, diagnostic examination unit, one day clinics, such as artificial kidney, Mediterranean anemia, infectious diseases, hemodynamic, and dental units. In addition, out-patient care was also excluded. In particular, 15 clinics were selected, seven in the pathology and eight in the surgical sector, that provided in-patient care. All 15 clinics were considered single DMUs. In order to create comparable units and to avoid the heterogeneity of the sample, two DEA models were built and separately run by sector, as presented in Table 1.

Table 1.

Clinics per sector.

Clinics of the Pathology Sector Clinics of the Surgical Sector
DMU 1: Hematology DMU 8: A’ Surgery-COVID-19
DMU 2: Cardiology DMU 9: B’ Surgery
DMU 3: A’ Pathology–COVID-19 DMU 10: Obstetrics and Gynecology
DMU 4: B’ Pathology DMU 11: Urology
DMU 5: Pediatric DMU 12: Ear, Nose, Throat (E.N.T.)
DMU 6: Neurology DMU 13: Ophthalmology
DMU 7: Gastroenterology DMU 14: Orthopedics
DMU 15: Neurosurgery
Total number of clinics: 7 Total number of clinics: 8

The scores for the MI measure the changes in the total factor productivity (TFPCH), technological and technical efficiency (TECHCH and EFFCH, respectively) and its components (pure technical efficiency change -PECH and scale efficiency change-SECH) [15]. More specifically, the technological efficiency change shows the extent to which the technological limit of the examined DMU is shifted from one period to another [57]. A score higher than one indicates productivity progress. When the technical efficiency exceeds the technological change index, then productivity growth is primarily the result of the technical efficiency improvements. When the opposite occurs, then the increased efficiency is mainly attributed to the technological progress [6,58,59]. Furthermore, the technical efficiency change affects the productivity through its components, the pure technical efficiency, and scale efficiency. Pure technical efficiency, which in turn expresses the application of the best practices of the resource usage and the scale efficiency, determines how closely an observed DMU is on the most productive scale [15,29]. Moreover, numerous studies have emphasized the decomposition of the productivity and the influential role of the technical and scale efficiencies in the hospital’s performance [60,61,62,63].

The DEA and MI methods chosen were input-oriented, run for the VRS and have been performed in clinics that were considered to transform labor and capital (inputs) into health services, approximated by the number of in-patient discharges and in-patient days (outputs). The annual number of full-time medical and nursing personnel employed in each clinic, is used as the proxy labor inputs. The number of hospital beds is assumed to be the proxy input of capital resources. The study uses a hospital clinic perspective.

The data were collected from the hospital’s medical records and through the bi-health system, which is the data registered annually and officially by the Regional Health Authority (2nd DYPE). The results were obtained using the software “DEA.P version 2.1 for Windows” [18]. The study was approved by the Scientific Council of the General Hospital of Rhodes.

3. Results

3.1. Analysis of Efficiency

During the two years of the review (2020 and 2021), the pathology clinics (DMUs 1, 2, 4, 6, and 7) appeared fully efficient and approached an optimal efficiency (Table 2). In 2021, the A’ Pathology (DMU 3) was fully transformed into a COVID-19 clinic, by increasing its inputs (beds and nursing staff) and outputs (in-patient discharges and days), showing a very positive performance change, compared to 2020. This clinic became efficient in the CRS and VRS, as well in the SE, proving that the operational changes implemented have brought it very close to the most efficient performance, as shown in Figure 1. The pediatric clinic (DMU 5) showed a low efficiency under the CRS and VRS in 2020 and also remained at low levels in 2021 (Figure 1).

Table 2.

Efficiency and productivity measurement of the pathology and surgical sectors (2020–2021).

CRS VRS SE-CRS/VRS
DMU 2020 2021 2020 2021 2020 2021
Pathology Sector
DMU 1 1.000 1.000 1.000 1.000 1.000 1.000
DMU 2 1.000 1.000 1.000 1.000 1.000 1.000
DMU 3 0.651 0.738 0.686 0.761 0.948 0.970
DMU 4 1.000 1.000 1.000 1.000 1.000 1.000
DMU 5 0.296 0.305 0.360 0.383 0.824 0.797
DMU 6 1.000 1.000 1.000 1.000 1.000 1.000
DMU 7 1.000 1.000 1.000 1.000 1.000 1.000
Average 0.850 0.863 0.864 0.878 0.967 0.967
Surgical Sector
DMU 8 0.934 0.762 0.982 0.879 0.951 0.867
DMU 9 0.720 1.000 0.775 1.000 0.929 1.000
DMU 10 1.000 1.000 1.000 1.000 1.000 1.000
DMU 11 1.000 1.000 1.000 1.000 1.000 1.000
DMU 12 0.552 0.436 0.848 0.800 0.651 0.545
DMU 13 1.000 1.000 1.000 1.000 1.000 1.000
DMU 14 0.912 0.881 1.000 0.902 0.912 0.976
DMU 15 0.698 1.000 0.901 1.000 0.775 1.000
Average 0.852 0.885 0.938 0.948 0.902 0.924

CRS = Constant Returns to Scale, VRS = Variable Returns to Scale, SE = Scale Efficiency.

Figure 1.

Figure 1

CRS, VRS, and SE variations (%) in the pathology and surgical sectors (2020–2021).

Regarding the surgical sector, very high-efficiency rates or even optimal rates were reached. In both 2020 and 2021, the surgical clinics (DMUs 10, 11, and 13) scored optimal efficiency levels under the CRS, VRS, and SE. The rest of the DMUs showed variations between the examined years, as shown in Table 2. More specifically, only DMU 9 and DMU 15 presented a significant improvement and demonstrated a full efficiency from 2020 to 2021 (Figure 1). DMUs 8, 12, and 14 showed a decrease in efficiency under the CRS and VRS, while the SE was differentiated among them (Figure 1).

Overall, the pathology sector was very efficient in 2020 and 2021, indicating positive variations in the second year of 1.53% and 1.62%, under the CRS and VRS, accordingly, and no noticeable variations in the SE. The surgical sector was also very efficient in both years, with positive variations in the CRS (3.9%), VRS (1.06%), and SE (2.44%) in 2021 (Figure 1).

3.2. Analysis of Productivity

In 2021, all clinics of the pathology sector showed a positive change in the TFPCH, due to the significant increase in the technological change, except DMU 7, as presented in Table 3 and Table 4, and Figure 2. Moreover, in DMU 3 (the COVID-19 clinic), an increase in the TFPCH is observed, due to the positive changes in the EFFCH, PECH, SECH, and TECHCH, demonstrating a better use of inputs (personnel and beds) and reaching an optimal level of operation during 2021. Furthermore, in 2021, DMU 5 presented a positive change in the TFPCH counterbalancing the slight decrease in the TECHCH (−0.6%) and SECH (−3.3%). In DMU 7, a reduction of 9.1% in the TECHCH and TFPCH appeared, while the other indexes achieved higher than 1 threshold values.

Table 3.

Malmquist productivity index of the pathology and surgical sectors (2020–2021).

DMU EFFCH TECHCH PECH SECH TFPCH
Pathology Sector
DMU 1 1.000 1.201 1.000 1.000 1.201
DMU 2 1.000 1.179 1.000 1.000 1.179
DMU 3 1.134 1.080 1.109 1.022 1.225
DMU 4 1.000 1.038 1.000 1.000 1.038
DMU 5 1.030 0.994 1.065 0.967 1.024
DMU 6 1.000 1.436 1.000 1.000 1.436
DMU 7 1.000 0.909 1.000 1.000 0.909
Average 1.022 1.109 1.024 0.998 1.134
Surgical Sector
DMU 8 0.816 1.156 0.895 0.912 0.943
DMU 9 1.389 1.272 1.290 1.077 1.767
DMU 10 1.000 1.124 1.000 1.000 1.124
DMU 11 1.000 0.931 1.000 1.000 0.931
DMU 12 0.790 1.186 0.943 0.837 0.936
DMU 13 1.000 1.167 1.000 1.000 1.167
DMU 14 0.966 1.144 0.902 1.071 1.105
DMU 15 1.432 1.148 1.110 1.290 1.644
Average 1.023 1.137 1.011 1.016 1.168

EFFCH = technical efficiency change index, TECHCH = technological change index, PECH = pure technical efficiency change index, SECH = scale efficiency change index, TFPCH = total factor productivity change index.

Table 4.

Malmquist productivity index changes (%) of the pathology and surgical sectors (2020–2021).

EFFCH TECHCH PECH SECH
Pathology Sector
DMU 1 20.1%
DMU 2 17.9%
DMU 3 13.1% 8.0% 10.9% 2.2%
DMU 4 3.8%
DMU 5 3.0% −0.6% 6.5% −3.3%
DMU 6 43.6%
DMU 7 −9.1%
Average 2.2% 10.9% 2.4% −0.2%
Surgical Sector
DMU 8 −18.4% 15.6% −10.4% −8.8%
DMU 9 38.3% 27.2% 29.0% 7.7%
DMU 10 12.4%
DMU 11 −6.9%
DMU 12 −21.0% 18.6% −5.7% −16.3%
DMU 13 16.7%
DMU 14 −3.4% 14.4% −9.8% 7.1%
DMU 15 43.2% 14.8% 11.0% 12.9%
Average 2.3% 13.7% 1.1% 1.6%

EFFCH = technical efficiency change index, TECHCH = technological change index, PECH = pure technical efficiency change index, SECH = scale efficiency change index.

Figure 2.

Figure 2

Total factor productivity change index (%) of the pathology and surgical sectors (2020–2021).

Most of the clinics in the surgical sector showed a positive change in 2021, in the TFPCH (Table 3 and Table 4 and Figure 2). More specifically, the increase in the TECHCH of DMUs 10 and 13 impacted positively on the TFPCH. DMU 14 showed an increase in the TFPCH by 10.5%, which is due to the increase of the TECHCH and the SECH counterbalancing the decrease of the PECH by 9.8%. DMU 15 had a significant increase in the TFPCH by 64.4%, due to the improvement of the TECHCH and SECH. However, in DMUs 8, 11, and 12, the TFPCH was negatively affected by both the EFFCH and TECHCH. In particular, the negative TFPCH in DMUs 8 and 12 is explained, due to the decrease in the EFFCH, which is both at the level of the PECH and SECH, although the TECHCH increased. In DMU 11, despite the very productive performance, a reduction of 6.9% in the TECHCH impacted negatively the TFPCH. In addition, a significant variation was observed in the TFPCH between the homogeneous clinics, whereas DMU 9 presented an exceptionally positive change (76.7%), compared to a 5.7% negative change in DMU 8.

Overall, the TFPCH and all of the other indexes of the pathology and surgical sectors increased between 2020 and 2021, except for a slight reduction in the SECH of the pathology sector (0.2%) (Figure 2).

4. Discussion

The assessment of the hospital efficiency and productivity performances can be of great value at the micro and macro levels in the healthcare sector. The necessity for a comparative assessment becomes higher in a pandemic era, especially when healthcare needs and resource allocations increase and cannot be predicted. The aim of this study was to measure the efficiency and productivity of the hospital clinics in the General Hospital of Rhodes, during the 2020–2021 COVID-19 pandemic, by applying the DEA and MI models.

The results of our study showed that during both years in the pathology sector, five out of the seven clinics appeared fully efficient with an optimal productivity, while the other two showed progress in 2021. The A′ pathology clinic (DMU 3) was converted entirely into a COVID-19 unit in 2020, with a positive impact on the efficiency and productivity in 2021. This clinic not only increased the technological threshold but also improved the clinical practices by benefiting from the increase in human and capital resources, during the second period. The B′ pathology clinic (DMU 4), also operated at an optimal level by hospitalizing all of the non-COVID cases. Thus, both homogenous clinics achieved the best performance, verifying the soundness of the policies pursued.

Additionally, the surgical sector scored high-efficiency rates and satisfactory to high productivity rates. Three out of the eight clinics revealed optimal performance levels by fully exploiting their capital and human resources, as well as innovation, brought in the context of the pandemic to the hospital. The performance of the A’ surgical clinic (DMU 8) declined in 2021 because it was fully transformed into a COVID-19 unit. The efficiency and productivity of the B’ surgical clinic (DMU 9) were greatly increased, due to its excess capacity as the other homogenous clinic (DMU 8) operated as the “backup plan” for COVID-19 patients.

Regarding the changes in the total factor productivity in both sectors, it is observed that although the overall rates had a similar degree of increase, the technical efficiency affected more the clinics of the surgical sector. In addition, the shift in the technological change had a significant impact on the change in the total factor productivity in both sectors, with the pathological sector mostly affected.

It should be noted that the progress observed in the hospital clinics was due to a plethora of alternative organizational, administrative, and managerial interventions that were introduced during the pandemic outbreak. Among the most important measures taken were the introduction of medical innovations and equipment related to COVID-19 care, the transformation of specific clinics in both sectors to COVID-19 units, the reallocation of beds and staff, as well as the changing of patients’ management. Our results are in accordance with the international literature. There are numerous studies reporting that the processes related to the organization and management of health resources, the infrastructure, the availability, and use of innovative technologies, as well as patient management and staff training affect productivity changes [51,64,65,66,67]. Several studies have stated that productivity deficits are mostly due to the losses in operational capacity, limited planning ability, insufficient staff availability, and longer procedure implementation times [68,69,70,71]. Furthermore, the hospital structure and, in particular, healthcare equipment and human capital, play a crucial role in the management of the pandemic [72]. The Lytras and Tsiodras study conducted during the pandemic in Greece, highlighted not only the limited resources and the stress capacity depletion, but also the necessity for staff training and specialization [73]. Furthermore, the number of beds plays a significant role in the management of the pandemic along with the reallocation of patients and, subsequently the reallocation of beds [74]. Many authors also emphasize the effect of both clinic size and the number of nursing staff on both the technical efficiency and performance [65,66,68,71]. Another common finding is reported in a recent study conducted in Portugal during the pandemic showing that hospitals’ performance also dropped in 2020, while in 2021, better results were achieved [75]. Despite the fact that international research under pandemic conditions is limited, hospitals’ inefficiencies related to the diversity in their structure and management have been highlighted [74,76,77,78]. The loss of operational capacity, limited planning ability, insufficient staff availability, the inadequate response to non-COVID incidents and longer procedure implementation times, create a productivity deficit [70].

In Greece, many studies were conducted to measure the efficiency and productivity at the hospital and the clinical level by applying the DEA, with the majority of them being input oriented [32,33,36,39,40,43,44,45,47,48,49,50,79,80,81,82,83]. Only the studies of Androutsou, et al., in 2011 [42] and Geitona, et al., in 2013 [50] were output-oriented, comparing the homogeneous and heterogeneous hospital clinics. Moreover, several studies conducted before the pandemic in Greece reported inefficiencies in the hospitals’ clinics, mostly related to the lack of appropriate infrastructure, staff, the irrational utilization of financial and human resources, as well as innovation [32,33,36,39,42,49,50,79,80]. In some of the above-mentioned studies, it was also found that the pathological clinics were more efficient than the surgical ones [39,42,50].

Limitations of the Study

Some limitations should be taken into consideration. First, the analysis is only based on a mathematical approach and is unable to examine the qualitative characteristics of the decision units. Second, the epidemiological data, readmissions rates, the severity of cases, as well as the specific clinics, based on the exclusion criteria, have not been taken into consideration. Third, our results come from a remote general hospital in Greece and cannot be generalized. However, they should not be underestimated, due to the fact that it is the first attempt to measure the efficiency and productivity of the hospital clinics under pandemic conditions in the country.

5. Conclusions

The General Hospital of Rhodes responded to the pressure created by the pandemic crisis by increasing its efficiency and productivity from 2020 to 2021. This achievement was due to its ability to accomplish the appropriate organizational changes and rationally allocate human resources, infrastructure, as well as technology. The efficiency and productivity assessments, especially during a pandemic crisis, should be considered as an opportunity to take advantage of the reorganization of hospitals, the clinics’ management and the integration of innovation. Moreover, successful measures taken can be a reference for best practices generated across the healthcare sector.

Acknowledgments

The authors would like to thank the administrative staff for their substantial contribution to the data collection.

Author Contributions

Conceptualization, L.A. and M.G.; Methodology, L.A., M.K. and M.G.; Software, L.A. and M.K.; Formal analysis, L.A., M.K. and D.L.; Investigation, L.A. and M.K.; Resources, M.K.; Data curation, L.A., M.K., D.L. and M.G.; Writing—Original Draft Preparation, L.A., M.K., D.L. and M.G; Writing—Review and Editing, L.A., D.L. and M.G; Visualization, D.L.; Supervision, M.G.; Project administration, M.G. All authors have read and agreed to the published version of the manuscript.

Institutional Review Board Statement

Not applicable.

Informed Consent Statement

Not applicable.

Data Availability Statement

Restrictions apply to the availability of these data. Data were collected from the Post-Graduate Program “Public Administration-health services administration” of the Department of Economics and Business of the Neapolis University Pafos (NUP).

Conflicts of Interest

The authors declare no conflict of interest.

Disclaimer

The information and views set out in this article are those of the authors and do not necessarily reflect the official opinion of the European Commission.

Funding Statement

This research received no external funding.

Footnotes

Publisher’s Note: MDPI stays neutral with regard to jurisdictional claims in published maps and institutional affiliations.

References

  • 1.World Health Organization . Health Systems Resilience during COVID-19: Lessons for Building Back Better. European Observatory on Health Systems and Policies; Brussels, Belgium: 2021. [PubMed] [Google Scholar]
  • 2.Androutsou L., Latsou D., Geitona M. Health Systems Challenges and Responses for Recovery in the Pre and Post COVID-19 Era. J. Serv. Sci. Manag. 2021;14:444–460. doi: 10.4236/jssm.2021.144028. [DOI] [Google Scholar]
  • 3.European Commission Eurostat How Much Did Governments Spend on Health in 2020? 2022. [(accessed on 20 June 2022)]. Available online: https://ec.europa.eu/eurostat/web/products-eurostat-news/-/ddn-20220311-1.
  • 4.Lupu D., Tiganasu R. COVID-19 and the efficiency of health systems in Europe. Health Econ. Rev. 2022;12:14. doi: 10.1186/s13561-022-00358-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Palmer S., Torgerson D. Definitions of efficiency. BMJ. 1999;318:1136. doi: 10.1136/bmj.318.7191.1136. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.Hollingworth B. Non-Parametric and Parametric Applications Measuring Efficiency in Health Care. Health Care Manag. Sci. 2003;6:203–218. doi: 10.1023/A:1026255523228. [DOI] [PubMed] [Google Scholar]
  • 7.Färe R., Primont D. Multi-Output Production and Quality: Theory and Applications. Kluwer Academic Publishers; Boston, MA, USA: 1995. [Google Scholar]
  • 8.Fried H., Lovell C., Schmidt S. The Measurement of Productive Efficiency. Oxford University Press; New York, NY, USA: 1993. [Google Scholar]
  • 9.Charnes A., Cooper W., Rhodes E. Measuring efficiency of decision-making units. Eur. J. Oper. Res. 1978;2:429–444. doi: 10.1016/0377-2217(78)90138-8. [DOI] [Google Scholar]
  • 10.Banker R., Morey R. The use of categorical variables in data envelopment analysis. Manag. Sci. 1986;32:1613–1627. doi: 10.1287/mnsc.32.12.1613. [DOI] [Google Scholar]
  • 11.Banker R., Charnes A., Cooper W. Some models for estimation of technical and scale efficiencies in data envelopment analysis. Manag. Sci. 1984;30:1078–1092. doi: 10.1287/mnsc.30.9.1078. [DOI] [Google Scholar]
  • 12.Färe R., Grosskopf S., Lindgren B., Roos P. Data Envelopment Analysis: Theory, Methodology, and Applications. Springer; Dordrecht, The Netherlands: 1994. Productivity Developments in Swedish Hospitals: A Malmquist Output Index Approach. [DOI] [Google Scholar]
  • 13.Hollingsworth B., Dawson P., Maniadakis N. Efficiency measurement of health care: A review of non-parametric methods and applications. Health Care Man. Sci. 1999;2:161–172. doi: 10.1023/A:1019087828488. [DOI] [PubMed] [Google Scholar]
  • 14.Malmquist S. Index numbers and indifference curves. Trabajos de Estatistica. 1953;4:1209–1242. doi: 10.1007/BF03006863. [DOI] [Google Scholar]
  • 15.Caves D.W., Christensen L.R., Diewert W.E. The economic theory of index numbers and measurement of input, output and productivity. Econometrica. 1982;50:1393–1414. doi: 10.2307/1913388. [DOI] [Google Scholar]
  • 16.Coelli T., Perelman S. Efficiency Measurement, Multiple-Output Technologies and Distance Functions: With Application to European Railways. CREPP, University of Liege; Liège, Belgium: 1996. [Google Scholar]
  • 17.Charnes A., Cooper W.W., Lewin A.Y., Seiford L.M. Data Envelopment Analysis: Theory, Methodology and Applications. Kluwer Academic Publisher; Boston, MA, USA: 1994. [Google Scholar]
  • 18.Coelli T.J. A Guide to DEAP, Version 2.1: A Data Envelopment Analysis (Computer) Program. Center for Efficiency and Productivity Analysis, Department of Econometrics, University of New England; Armidale, NSW, Australia: 1996. Working Paper, Papers No. 8/96. [Google Scholar]
  • 19.Coelli T., Perelman S. Comparison of parametric and nonparametric distance functions: With application to European railways. Eur. J. Oper. Res. 1999;117:326–339. doi: 10.1016/S0377-2217(98)00271-9. [DOI] [Google Scholar]
  • 20.Coelli T., Rao D., Battase G.E. An Introduction to Efficiency and Productivity Analysis. Kluwer; Boston, MA, USA: 1998. [Google Scholar]
  • 21.Newhouse J.P. Frontier estimation: How useful a tool for health economics? J. Health Econ. 1994;13:317–322. doi: 10.1016/0167-6296(94)90030-2. [DOI] [PubMed] [Google Scholar]
  • 22.Cooper W., Seiford L., Tone K. Introduction to Data Envelopment Analysis and Its Uses. Springer Sci.; New York, NY, USA: 2006. [Google Scholar]
  • 23.Cooper W., Seiford L., Kaoru T. Data Envelopment Analysis: A Comprehensive Text with Models, Applications, References and DEA-Solver Software. 2nd ed. Springer; New York, NY, USA: 2007. [Google Scholar]
  • 24.Ozcan Y. Health Care Benchmarking and Performance Evaluation. An Assessment Using Data Envelopment Analysis (DEA) Springer; New York, NY, USA: 2008. (International Series in Operations Research & Management Science). [Google Scholar]
  • 25.Färe R., Grosskopf S., Margaritis D. The diet problem and DEA. J. Oper. Res. Soc. 2011;62:1420–1422. doi: 10.1057/jors.2010.113. [DOI] [Google Scholar]
  • 26.Ferrier G., Rosko M., Valdmanis V. Response to modelling and notation of DEA with strong and weak disposable outputs. Health Care Manag. Sci. 2011;14:389–390. doi: 10.1007/s10729-011-9160-0. [DOI] [PubMed] [Google Scholar]
  • 27.Ferrier G., Trivitt J. Incorporating quality into the measurement of hospital efficiency: A double DEA approach. J. Product. Anal. 2013;40:337–355. doi: 10.1007/s11123-012-0305-z. [DOI] [Google Scholar]
  • 28.Chilingerian J., Sherman D. Health-Care Applications: From Hospitals to Physicians, from Productive Efficiency to Quality Frontiers. In: Cooper W., Seiford L., Zhu J., editors. Handbook on Data Envelopment Analysis. Vol. 164. Springer; Boston, MA, USA: 2011. (International Series in Operations Research & Management Science). [DOI] [Google Scholar]
  • 29.Charles V., Färe R., Grosskopf S. A translation invariant pure DEA model. Eur. J. Oper. Res. 2016;249:390–392. doi: 10.1016/j.ejor.2015.09.037. [DOI] [Google Scholar]
  • 30.Zakowska I., Godycki-Cwirko M. Data envelopment analysis applications in primary health care: A systematic review. [(accessed on 8 November 2022)];Fam. Pract. 2020 37:147–153. doi: 10.1093/fampra/cmz057. Available online: https://pubmed.ncbi.nlm.nih.gov/31605609/ [DOI] [PubMed] [Google Scholar]
  • 31.Emrouznejad A., Yang G. A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socio-Econ. Plan. Sci. 2017;61:4–8. doi: 10.1016/j.seps.2017.01.008. [DOI] [Google Scholar]
  • 32.Kontodimopoulos N., Niakas D. A 12-year Analysis of Malmquist Total Factor Productivity in Dialysis Facilities. J. Med. Syst. 2006;30:333–342. doi: 10.1007/s10916-005-9005-9. [DOI] [PubMed] [Google Scholar]
  • 33.Prezerakos P., Maniadakis N., Kaitelidou N., Kotsopoulos N. Measuring across hospital efficiency and productivity: The case of second Regional Health Authority of Attica. Eur. Res. Stud. 2007;10:83–96. doi: 10.35808/ersj/165. [DOI] [Google Scholar]
  • 34.Kontodimopoulos N., Moschovakis G., Aletras V., Niakas D. The effect of environmental factors on technical and scale efficiency of primary health care providers in Greece. Cost Eff. Resour. Alloc. 2007;5:14. doi: 10.1186/1478-7547-5-14. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Kontodimopoulos N., Nanos P., Niakas D. Balancing efficiency of health services and equity of access in remote areas in Greece. Health Policy. 2006;76:49–57. doi: 10.1016/j.healthpol.2005.04.006. [DOI] [PubMed] [Google Scholar]
  • 36.Aletras V., Kontodimopoulos N., Zagouldoudis A., Niakas D. The short-term effect on technical and scale efficiency in establishing regional health systems and general management in Greek NHS hospitals. Health Policy. 2007;83:236–245. doi: 10.1016/j.healthpol.2007.01.008. [DOI] [PubMed] [Google Scholar]
  • 37.Katharaki M. Approaching the management of hospital units with an operation research technique: The case of 32 Greek obstetrics and gynecology public units. Health Policy. 2008;85:19–31. doi: 10.1016/j.healthpol.2007.06.001. [DOI] [PubMed] [Google Scholar]
  • 38.O’Neill L., Rauner M., Heidenberger K., Kraus M. A cross-national comparison and taxonomy of DEA-based hospital efficiency studies. Socio-Econ. Plan. Sci. 2008;42:158–189. doi: 10.1016/j.seps.2007.03.001. [DOI] [Google Scholar]
  • 39.Maniadakis N., Kotsopoulos N., Prezerakos P., Yfantopoulos J. Measuring intra-hospital clinic efficiency and productivity: Application to a Greek university general hospital. Eur. Res. Stud. 2007;11:95–100. [Google Scholar]
  • 40.Halkos G.E., Tzeremes N.G. A conditional nonparametric analysis for measuring the efficiency of regional public healthcare delivery: An application to Greek prefectures. Health Policy. 2011;103:73–82. doi: 10.1016/j.healthpol.2010.10.021. [DOI] [PubMed] [Google Scholar]
  • 41.Geitona M., Androutsou L., Theodoratou D. Cost estimation of patients admitted to the intensive care unit: A case study of the Teaching University Hospital of Thessaly. J. Med. Econ. 2010;13:179–184. doi: 10.3111/13696991003684092. [DOI] [PubMed] [Google Scholar]
  • 42.Androutsou L., Geitona M., Yfantopoulos J. Measuring efficiency and productivity across hospitals in the regional health authority of Thessaly, in Greece. J. Health Manag. 2011;13:121–140. doi: 10.1177/097206341101300201. [DOI] [Google Scholar]
  • 43.Polyzos N. A three-year Performance Evaluation of the NHS Hospitals in Greece. [(accessed on 6 November 2022)];Hippokratia. 2012 16:350–355. Available online: https://www.ncbi.nlm.nih.gov/pmc/articles/PMC3738611/ [PMC free article] [PubMed] [Google Scholar]
  • 44.Karagianni R. Technical and Scale Efficiency of Public Hospitals in Greece. Greek Econ. Outlook. 2012;12:66–70. [Google Scholar]
  • 45.Kounetas K., Papathanassopoulos F. How efficient are Greek Hospitals? A case study using a double bootstrap DEA approach. [(accessed on 7 November 2022)];Eur. J. Health Econ. 2013 14:979–994. doi: 10.1007/s10198-012-0446-z. Available online: https://www.jstor.org/stable/42002304. [DOI] [PubMed] [Google Scholar]
  • 46.Cheng Z., Tao H., Cai M., Lin H., Lin X., Shu Q., Zhang R. Technical efficiency and productivity of Chinese county hospitals: An exploratory study in Henan province, China. BMJ Open. 2015;5:e007267. doi: 10.1136/bmjopen-2014-007267. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Xenos P., Nektarios M., Constantopoulos A., Yfantopoulos J. Two-stage hospital efficiency analysis including qualitative evidence: A Greek case. J. Hosp. Adm. 2016;5:1. doi: 10.5430/jha.v5n3p1. [DOI] [Google Scholar]
  • 48.Xenos P., Yfantopoulos J., Nektarios M., Polyzos N., Tinios P., Constantopoulos A. Efficiency and productivity assessment of public hospitals in Greece during the crisis period 2009–2012. Cost Eff. Resour. Alloc. 2017;15:6. doi: 10.1186/s12962-017-0068-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 49.Flokou A., Aletras V., Niakas D. Decomposition of potential efficiency gains from hospital mergers in Greece. Health Care Manag. Sci. 2017;20:467–484. doi: 10.1007/s10729-016-9365-3. [DOI] [PubMed] [Google Scholar]
  • 50.Geitona M., Androutsou L., Yfantopoulos G. Efficiency Assessment across Homogeneous Specialty Clinics in the Region of Thessaly, Greece. Open Public Health J. 2013;6:11–20. doi: 10.2174/1874944501306010011. [DOI] [Google Scholar]
  • 51.Ancarani A., Di Mauro C., Gitto S., Mancuso P., Ayach A. Technology acquisition and efficiency in Dubai hospitals. Technol. Forecast. Soc. Change. 2016;13:475–485. doi: 10.1016/j.techfore.2016.07.010. [DOI] [Google Scholar]
  • 52.Magnusen J., Nyland K. Measuring efficiency in clinical departments. Health Policy. 2008;87:1–7. doi: 10.1016/j.healthpol.2007.09.013. [DOI] [PubMed] [Google Scholar]
  • 53.Kousi T., Mitsi L.C., Simos J. The early stage of COVID-19 outbreak in Greece: A review of the National response and the socioeconomic impact. Int. J. Environ. Health Res. 2021;18:322. doi: 10.3390/ijerph18010322. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 54.Ladi S., Angelou A., Panagiotatou D. Regaining trust: Evidence-informed policymaking during the first phase of the COVID-19 crisis in Greece. South Eur. Soc. Politics. 2021:1–26. doi: 10.1080/13608746.2021.1983932. [DOI] [Google Scholar]
  • 55.European Commission Greece: Details of Greece’s Support Measures to Help Citizens and Companies during the Significant Economic Impact of the Coronavirus Pandemic. 2022. [(accessed on 10 May 2022)]. Available online: https://ec.europa.eu/info/live-work-travel-eu/coronavirus-response/jobs-and-economy-during-coronavirus-pandemic/state-aid-cases/greece_en.
  • 56.Hellenic Statistical Authority Population-Housing Census–2021. 2022. [(accessed on 10 August 2022)]. Available online: https://elstat-outsourcers.statistics.gr/Census2022_GR.pdf. (In Greek)
  • 57.Brown M., Popkin J. A measure of technological change and returns to scale. Rev. Econ. Stat. 1962;44:402–411. doi: 10.2307/1926657. [DOI] [Google Scholar]
  • 58.Farrell M.J. The measurement of productivity efficiency. J. R. Stat. Soc. 1957;120:153–281. doi: 10.2307/2343100. [DOI] [Google Scholar]
  • 59.Lovell C. Production Frontiers and Productive Efficiency in the Measurement of Productive Efficiency: Techniques and Applications. In: Fried H.O., Schmidt S.S., Lovell C.K., editors. The Measurement of Productive Efficiency: Techniques and Applications. Oxford University Press; New York, NY, USA: 1993. pp. 3–67. [Google Scholar]
  • 60.McCallion G., Colin Glass J., Jackson R., Kerr C.A., McKillop D.G. Investigating productivity change and hospital size: A nonparametric frontier approach. Appl. Econ. 2000;32:161–174. doi: 10.1080/000368400322859. [DOI] [Google Scholar]
  • 61.Ferrier G.D., Valdmanis V.G. Efficiency and Productivity Changes in Large Urban Hospitals 1994–2002: Ownership, Markets and the Uninsured. In: Blank J.L.T., Valdmanis V.G., editors. Advanced in Health Economics and Health Service Research: Evaluating Hospital Policy and Performance. Contributions from Hospital Policy and Productivity Research; New York, NY, USA: 2008. [PubMed] [Google Scholar]
  • 62.Chowdhury Z.V., Wodchis W., Laporte A. Efficiency and Technological Change in Health Care Services in Ontario. [(accessed on 8 September 2022)];Int. J. Product. Perform. Manag. 2010 60:721–745. doi: 10.1108/17410401111167807. Available online: https://ideas.repec.org/p/qld/uqcepa/54.html. [DOI] [Google Scholar]
  • 63.Chai P., Zhang Y., Zhou M., Liu S., Kinfu Y. Technical and scale efficiency of provincial health systems in China: A bootstrapping data envelopment analysis. BMJ Open. 2019;9:e027539. doi: 10.1136/bmjopen-2018-027539. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Ozcan Y.A., Roice D.L. Health Care Delivery Restructuring and Productivity Change: Assessing the Veterans Integrated Service Network (VISNs) Using the Malmquist Approach. Med. Care Res. Rev. 2010;68((Suppl. 1)):20S–35S. doi: 10.1177/1077558710369912. [DOI] [PubMed] [Google Scholar]
  • 65.Sahin B., İlgün G. Assessment of the impact of public hospital associations (PHAs) on the efficiency of hospitals under the Ministry of health in Turkey with data envelopment analysis. Health Care Manag. Sci. 2019;22:437–446. doi: 10.1007/s10729-018-9463-5. [DOI] [PubMed] [Google Scholar]
  • 66.Selamzade F., Yuksl O. Examination of efficiency Change of Provincial Hospital in Azerbaijan with Malmquist Index. J. Int. Health Sci. Manag. 2021;7:14–53. doi: 10.48121/jihsam.911044. [DOI] [Google Scholar]
  • 67.Shaikh Z.M. Zuber’s Coronavirus Disease (COVID-19), Standards for Hospitals. Int. J. Health Sci. Pharm. 2021;5:2581–6411. doi: 10.47992/IJHSP.2581.6411.0064. [DOI] [Google Scholar]
  • 68.Giancotti M., Guglielmo A., Mauro M. Efficiency and optimal size of hospitals: Results of a systemic search. [(accessed on 2 September 2022)];PLoS ONE. 2017 12:e0174533. doi: 10.1371/journal.pone.0174533. Available online: https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0174533. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 69.Alatawi A.D., Niessen L.W., Khan J.A. Efficiency evaluation of public hospitals in Saudi Arabia: An application of data envelopment analysis. BMJ Open. 2020;10:e031924. doi: 10.1136/bmjopen-2019-031924. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 70.Coyle D., Dreesbeimdieck K., Manley A. Productivity in UK healthcare during and after the Covid-19 pandemic. Natl. Inst. Econ. Rev. 2021;258:90–116. doi: 10.1017/nie.2021.25. [DOI] [Google Scholar]
  • 71.Medarević A., Vuković D. Efficiency and Productivity of Public Hospitals in Serbia Using DEA-Malmquist Model and Tobit Regression Model, 2015–2019. Int. J. Environ. Health Res. 2021;18:12475. doi: 10.3390/ijerph182312475. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 72.Ferraz D., Mariano E., Manzine P., Moralles H., Morceiro P., Torres B., de Almeida M.R., Soares de Mello J.C., Rebelatto D.A.D.N. COVID health structure index: The vulnerability of Brazilian microregions. Soc. Indic. Res. 2021;158:197–215. doi: 10.1007/s11205-021-02699-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 73.Lytra T., Tsiordas S. Total patient load, regional disparities and in-hospital mortality of intubated COVID-19 patients in Greece, from September 2020 to May 2021. Scand. J. Public Health. 2022;50:671–675. doi: 10.1177/14034948211059968. [DOI] [PubMed] [Google Scholar]
  • 74.Nepomuceno T.C., Wilka M.N.S., Nepomuceno K.T.C., Barros I.K.F. A DEA-based complexity of needs approach for hospital beds evacuation during the COVID-19 outbreak. J. Healthc. Eng. 2020;2020:8857553. doi: 10.1155/2020/8857553. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 75.Nunes A., Ferreira D. Evaluating Portuguese Public Hospitals Performance: Any Difference Before and During COVID-19? Preprints. 2022:2022100201. doi: 10.20944/preprints202210.0201.v1. [DOI] [Google Scholar]
  • 76.Nurhafiza M.H., Ming-Miin Y., Kok F.S. Assessing the efficiency of Malaysia health-system in COVID-19 prevention and treatment response. Health Care Manag. Sci. 2021;24:273–285. doi: 10.1007/s10729-020-09539-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 77.Kamel M.A., Mousa M.E. Measuring operational efficiency of isolation hospitals during COVID-19 pandemic using data envelopment analysis: A case of Egypt. [(accessed on 2 September 2022)];Benchmarking Int. J. 2021 28:2178–2201. doi: 10.1108/BIJ-09-2020-0481. Available online: https://pesquisa.bvsalud.org/global-literature-on-novel-coronavirus-2019-ncov/resource/pt/covidwho-1062959. [DOI] [Google Scholar]
  • 78.Klein M.G., Cheng C.J., Lii E., Mao K., Mesbahi H., Zhu T., Muckstadt J.A., Hupert N. COVID-19 Models for Hospital Surge Capacity Planning: A Systematic Review. Disaster Med. Public Health Prep. 2022;16:390–397. doi: 10.1017/dmp.2020.332. [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 79.Maniadakis N., Thanassoulis E. Assessing productivity changes in UK hospitals reflecting technology and input prices. Appl. Econ. 2000;32:1575–1589. doi: 10.1080/000368400418970. [DOI] [Google Scholar]
  • 80.Athanassopoulos A.D., Gounaris C. Assessing the technical and allocative of hospital allocations in Greece and its resource allocation implications. Eur. J. Oper. Res. 2001;133:416–431. doi: 10.1016/S0377-2217(00)00180-6. [DOI] [Google Scholar]
  • 81.Tsekouras K., Papathanassopoulos F., Kounetas K., Pappous G. Does the adoption of new technology boost productive efficiency in the public sector? The case of ICUs system. Int. J. Prod. Econ. 2010;128:427–433. doi: 10.1016/j.ijpe.2010.07.041. [DOI] [Google Scholar]
  • 82.Dimas G., Goula A., Soulis S. Productive performance and its components in Greek public hospitals. Oper. Res. 2012;12:15–27. doi: 10.1007/s12351-010-0082-2. [DOI] [Google Scholar]
  • 83.Mitropoulos P., Mitropoulos I., Giannikos I. Combining DEA with location analysis for the effective consolidation of services in the health sector. Comput. Oper. Res. 2013;40:2241–2250. doi: 10.1016/j.cor.2012.01.008. [DOI] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

Restrictions apply to the availability of these data. Data were collected from the Post-Graduate Program “Public Administration-health services administration” of the Department of Economics and Business of the Neapolis University Pafos (NUP).


Articles from International Journal of Environmental Research and Public Health are provided here courtesy of Multidisciplinary Digital Publishing Institute (MDPI)

RESOURCES