Skip to main content
Frontiers in Medical Technology logoLink to Frontiers in Medical Technology
. 2026 Jun 10;8:1820803. doi: 10.3389/fmedt.2026.1820803

Hospital efficiency assessment: a systematic review of DEA and hybrid DEA–machine learning approaches

Nesrin Alkan 1, Ubeyde Kaan Koluk 1, Bilal Baris Alkan 2, Alper Sinan 2,*
PMCID: PMC13290754  PMID: 42358430

Abstract

The increasing complexity of healthcare systems and growing resource constraints have made hospital efficiency assessment central to healthcare management and policy. Data Envelopment Analysis (DEA) has been widely used to evaluate hospital efficiency due to its ability to accommodate multiple input and output structures. However, classical DEA applications provide limited support for explaining efficiency scores, generating predictions, and informing managerial decision-making. This study systematically reviews hospital efficiency studies published between 2020 and 2025 to examine the use and limitations of DEA and to identify approaches integrating DEA with machine learning (ML). To more comprehensively demonstrate the methodological diversity of DEA-machine learning integration, studies from non-healthcare fields have also been included in the comparative analysis. Following PRISMA guidelines, standalone DEA and DEA–ML studies were analysed and coded across methodological dimensions. Multiple Correspondence Analysis was applied to identify dominant methodological configurations and emerging patterns in the literature. Findings indicate that CCR and BCC models remain prevalent, with human resources and financial indicators as common inputs and service delivery measures as outputs. DEA–ML research largely relies on two-stage structures focused on classification and prediction. The results highlight methodological gaps and the potential of more explainable and decision-support-oriented DEA–ML approaches to enhance benchmarking and resource allocation in hospital efficiency management.

Keywords: data envelopment analysis, decision-making, hospital efficiency, machine learning, multiple correspondence analysis, systematic review

1. Introduction

Health systems, comprising organizations, resources, and activities aimed at protecting, improving, and maintaining health, are among the key indicators of a country's social welfare and development levels. Every country is responsible for improving and protecting the health of its population, and effectively fulfilling this responsibility depends on the provision of effective prevention, protection, and treatment services (1). In this context, evaluating the performance of health systems emerges as a critical requirement for the efficient use of limited resources, improving service quality, and enhancing health outcomes. However, due to high-cost infrastructure investments, a large and heterogeneous workforce, rapidly changing technologies, and fluctuating service demand, the health sector remains one of the areas where performance and effectiveness analyses are conducted in the most complex manner.

Performance evaluations conducted at different levels of health systems serve as an important decision-support tool for policymakers in improving resource allocation, for managers in optimizing operational processes, and for ensuring quality and equity in service delivery. In particular, efficiency analyses at the hospital level play a strategic role in ensuring financial sustainability, improving service quality, and strengthening performance management systems (2). In this context, the concept of efficiency, a fundamental economic principle expressing the production of the highest output with available inputs, is widely used in the healthcare literature (3, 4). The foundations of modern productivity measurement were laid by Farrell (5), and his framework continues to guide contemporary performance analysis in healthcare.

Data Envelopment Analysis (DEA) has been one of the most widely used methods in the literature for many years in measuring hospital efficiency, due to its ability to simultaneously address multiple input and output structures. Different DEA approaches, primarily the CCR (6) and BCC (7) models, have made significant contributions to measuring the relative technical efficiency of hospitals. However, a significant portion of DEA-based studies in the hospital efficiency literature is limited to calculating and comparing efficiency scores; they offer a limited analytical framework for explaining the reasons for these scores, generating future predictions, and developing achievable improvement goals. Furthermore, factors such as data heterogeneity, measurement errors, and insufficient representation of the quality dimension further limit the explanatory power of classical DEA models.

In recent years, the increasing complexity of healthcare systems and the rise in the volume and diversity of data have made these limitations more visible, leading researchers to hybrid approaches that integrate DEA with Machine Learning (ML) methods. Machine learning, a subfield of artificial intelligence (AI), focuses on developing algorithms that enable computers to learn from data without explicit programming (8, 9). ML methods, which emerged from early AI research in the 1950s (10, 11), are designed to identify patterns, classify information, generate predictions, and support decision-making in complex systems (12, 13).

DEA-machine learning integration should be considered not only as a technical extension to overcome the limitations of DEA, but also within the context of the evolution of decision support systems and data-driven analytics approaches. The literature emphasizes that decision support systems have evolved over time from descriptive and explanatory analyses to predictive and prescriptive analytical approaches (14). In this evolutionary process, the prediction, classification, and variable significance determination capabilities offered by machine learning methods are significantly expanding the scope and decision support capacity of analytical models (15). In this context, the efficiency measurement and comparative analysis capabilities provided by DEA, combined with the advanced analytical capacity offered by machine learning methods, create a more comprehensive decision support structure. Furthermore, the recently prominent Explainable AI approaches play a significant role in decision support processes by increasing the interpretability of machine learning models (16). Therefore, DEA-machine learning integration can be considered a natural part of the evolution of analytical methods.

Within this theoretical framework, DEA-machine learning integration offers significant analytical advantages in concrete applications. DEA-ML integration offers more flexible and powerful analytical capabilities compared to classical DEA in areas such as estimating efficiency scores, classifying hospitals based on their similarities, determining variable importance, and setting explainability and targets. However, the limited number of studies in the literature that combine DEA and machine learning methods in the context of hospital efficiency makes it difficult to comprehensively understand the methodological structure of this integration by focusing solely on the healthcare field. Therefore, in order to better understand the methodological diversity and analytical potential of DEA-ML integration, this study also includes DEA-ML studies conducted in different application areas outside the healthcare sector. This choice is consistent with the cross-domain methodological transferability approach in the literature, which refers to the adaptability of analytical methods across different problem contexts. Machine learning plays a role not only in prediction but also in model and theory development (17); DEA, on the other hand, is a domain-independent method applicable in different sectors (18, 19). Therefore, examining the applications of these methods in different fields is methodologically meaningful. Rather than expanding the scope, this approach aims to reveal the purposes of DEA-machine learning integration in different contexts, the data structures and analytical strategies used, and to provide a framework for how these can be adapted to hospital efficiency analyses. The purpose of including non-healthcare studies is to comparatively demonstrate how DEA and machine learning methods are used together in different fields. These studies are not used to directly generate hospital efficiency results, but rather to support the interpretation of health findings and to provide researchers with a methodological frame of reference.

Accordingly, this study systematically examines how DEA is used in hospital efficiency studies published between 2020 and 2025 and the limitations of this approach; then, it evaluates, from a holistic perspective, how these limitations are attempted to be overcome through methodological approaches based on DEA-ML integration studies. This systematic review, conducted in line with the PRISMA guidelines, aims to provide a critical and guiding contribution to the literature by revealing the methodological transformation from classical DEA practices to DEA-ML integration.

In this context, multiple correspondence analysis was applied to go beyond merely describing the methodological characteristics of the articles examined in the study and to reveal the implicit relationships in the literature in a deeper way. Correspondence analysis is an exploratory multivariate technique that aims to represent the relationships between categorical variables in a low-dimensional geometric space based on chi-square distances (20). Thus, it goes beyond simply revealing which methods are used how frequently in the literature, enabling the discovery of structural relationships and implicit methodological patterns among the studies. While traditional narrative-based syntheses and frequency tables are limited to describing the methodological diversity in the literature, multiple correspondence analysis allows for a multidimensional representation of the literature by simultaneously considering multiple categorical variables. In this way, the natural clustering of studies sharing similar methodological approaches can be visually determined; dominant research paradigms and marginal or innovative methodological orientations can be more clearly distinguished.

In the multiple correspondence analysis applied within the scope of this study, the functional roles of machine learning algorithms within DEA-based analytical frameworks (such as classification, prediction, variable significance determination, target setting, and explainability) were emphasized, rather than their technical details. The studies examined were evaluated together in terms of research objectives, DEA-ML integration directions, application areas, and data structures, aiming to map methodological similarities and divergences that are difficult to reveal with classical systematic review approaches. This approach reveals the methodological transitions, hybridization patterns, and research directions that are still in the maturing stage in the literature, evolving from DEA to machine learning, in an analytical and interpretable way. Therefore, multiple correspondence analysis significantly strengthens the theoretical depth and methodological originality of the study by transforming the scattered and heterogeneous DEA-ML literature into a holistic methodological map.

In this context, the study aims not only to describe the literature on the combined use of DEA and ML methods, but also to systematically analyze the methodological structure and analytical logic behind this integration. Accordingly, the research questions of the study are structured as follows:

RQ1: In DEA-based studies evaluating hospital efficiency, which input and output variables are predominantly used, and what trends have these variable selections shown over time?

RQ2: In the literature, within which methodological forms and analytical approaches is the integration of DEA and ML methods applied?

RQ3: In which sectors, primarily healthcare, are DEA-ML integrations applied; which data types (cross-sectional, panel, big data, etc.) and analytical environments are preferred in these applications?

RQ4: How can the methodological diversity observed in the DEA-ML literature be systematically classified within the context of dominant, transitional, and innovative research clusters?

The multiple correspondence analysis applied in seeking answers to these research questions allows for the answer not only to the question of “which method has been used how often?”, but also to more in-depth questions such as which methods have been used together for what purposes, in what contexts, and in what analytical roles, how these combinations are clustered in the literature, and through what patterns the observed methodological transformation from DEA to machine learning has occurred. Thus, this study aims to go beyond mapping the current state of DEA-ML integration and to provide a methodological classification framework for the hospital efficiency literature and an analytical roadmap to guide future research.

2. Materials and methods

2.1. Study design

This systematic review was conducted in accordance with the Preferred Reporting Items for Systematic Reviews and Meta-Analyses (PRISMA) guidelines (21, 22). The PRISMA framework ensures a transparent and replicable process for the identification, screening, and synthesis of relevant studies. The review process comprised four main stages: identification, screening, eligibility assessment, and inclusion. The overall workflow of the review is presented in Figure 1.

Figure 1.

PRISMA flow diagram illustrating the study selection process: 490 records identified, 178 duplicates removed, 312 records screened, 180 excluded, 132 reports assessed for eligibility, 44 excluded, resulting in 88 studies included in review.

PRISMA flowchart.

The systematic review framework was structured based on the PICOS criteria. The population (P) consisted of hospitals and healthcare systems evaluated in efficiency studies. The intervention (I) included the application of Data Envelopment Analysis (DEA) and DEA–machine learning hybrid approaches. The comparator (C) involved different DEA model specifications or alternative analytical approaches used for performance evaluation. The outcomes (O) focused on efficiency scores, performance assessment, and benchmarking results. The study design (S) was limited to empirical studies employing quantitative data and analytical methods. This framework guided the study selection, data extraction, and synthesis processes.

2.2. Search strategy

In this study, the literature review and study selection process was conducted systematically in accordance with the PRISMA (Preferred Reporting Items for Systematic Reviews and Meta-Analyses) guidelines. The literature search was performed using two separate keyword groups, covering the period 2020–2025 in the Web of Science (WoS) and Scopus databases.

The literature search was conducted in two stages using two separate keyword groups in the Web of Science and Scopus databases. In the first stage, searches using the keywords “hospital efficiency” AND “data envelopment analysis” yielded 61 publications in the Web of Science database and 67 in the Scopus database. In the second stage, using the keywords “data envelopment analysis” AND “machine learning,” 130 records were identified in the Web of Science database and 232 in the Scopus database. The number of records obtained for each stage was documented separately. The final literature search was conducted on December 30, 2025, and only studies published in English were included in the review. After eliminating overlaps and duplicate records between databases, the remaining studies were subjected to a preliminary review at the title and abstract level. Publications outside the scope of the research were eliminated at this stage; studies deemed suitable were then subjected to full-text suitability evaluation. The screening and study selection process was conducted independently by two researchers. Title-abstract screening and full-text evaluations were performed separately, and any disagreements were resolved through discussion until consensus was reached. As a result of the full-text review, publications whose methodological framework, data structure, or analytical approach did not align with the study's objectives were excluded. At the end of this elimination process, a total of 88 articles were ultimately selected for inclusion in the study. Of these studies, 40 focus solely on DEA-based efficacy analyses in the context of hospitals and healthcare services, while 48 focus on the integration of Data Envelopment Analysis with machine learning methods. In this context, the inclusion of DEA (machine learning) studies from non-healthcare sectors was a conscious methodological choice. These studies were not evaluated with the aim of generating direct inferences regarding hospital efficiency, but rather to reveal how DEA integration is structured in different application areas and with which data structures and analytical strategies it is used. This approach allows for a more comprehensive examination of methodological approaches that can be adapted to hospital efficiency analyses, going beyond the limited number of DEA studies in the healthcare field. All stages of the study selection process are visualized in detail using the PRISMA flowchart.

The main reason for limiting the research to the 2020–2025 period is that approaches based on the integration of DEA and machine learning methods have shown a significant increase and methodological diversification in studies aimed at evaluating hospital efficiency, especially in the post-2020 period. During this period, it is observed that machine learning algorithms for classification and prediction purposes are used more systematically within the DEA framework; and analytical purposes such as explainability, determining variable importance, and target setting have come to the forefront. Focusing on this time period allows the study to evaluate the current input-output structures and analytical approaches used in the hospital efficiency literature within a more consistent framework. The literature review was conducted without any country or institutional context restrictions.

2.3. Inclusion and exclusion criteria

Studies were included if they:

  1. The publication must have taken place between January 2020 and December 2025; this period should reflect both the current trends in DEA-based applications in the hospital efficiency literature and the process in which DEA-machine learning integration became methodologically prominent.

  2. The studies should be empirical studies that directly evaluate healthcare or hospital efficiency and use DEA as the primary analytical tool in effectiveness measurement.

  3. The studies should include either hospital and healthcare applications where DEA is used alone, or DEA-based frameworks where it is integrated with or compared to ML or artificial intelligence-based methods.

  4. The studies should not be limited to theoretical or conceptual discussions but should present empirical findings based on measurable input and output variables.

Studies with the following characteristics are excluded:

  1. Publications whose full text is not accessible.

  2. Purely conceptual or methodological studies that do not include an empirical application or provide data-based analysis.

  3. Studies that do not include the DEA method as a primary analytical component or use DEA only as a secondary/auxiliary tool.

2.4. Selection and data extraction process

As shown in the PRISMA flowchart in Figure 1, a total of 490 records were obtained from database searches. After removing duplicate records, 312 studies were subjected to title and abstract level searches. At this stage, 180 records were eliminated because they were inconsistent with the study topic, did not address hospital efficiency with DEA, or did not include the integration of Data Envelopment Analysis and ML methods. The remaining 132 studies were included in the full-text review and examined in detail according to the eligibility criteria. As a result of the full-text review, 44 studies were excluded for reasons such as not including an empirical application, not using DEA as a primary analysis method, or being outside the scope of the study. Finally, a total of 88 studies that met the inclusion criteria were included in the systematic review.

Results

As a result of the literature review conducted in accordance with the PRISMA guidelines, a total of 40 studies published between 2020 and 2025 that evaluated hospital efficiency using only the DEA method were included in this review. These studies were systematically examined to reveal the ways in which DEA is used and the preferred model types in the hospital efficiency literature. The basic characteristics of the examined studies are summarized in Table 1 in terms of author(s) and publication year, the DEA model used, and the type of hospital analyzed. The input and output variables used in the studies were evaluated separately and analyzed through frequency tables to reveal current trends.

Table 1.

Summary of methodological characteristics of studies included in the systematic review.

Author(s) and Year DEA model Type of hospitals compared Methodological approach Purpose of second-stage analysis
Alatawi et al. (23) CCR, BCC 91 MoH public hospitals in Saudi Arabia DEA only —
Ayiko et al. (24) CCR, BCC 78 general hospitals in Uganda DEA + Tobit Determinants of efficiency
Barpanda and Sreekumar (25) CCR 20 private hospitals in Kerala, India DEA only —
Berger et al. (26) SBM, Super-efficiency DEA 120 public/non-profit hospitals in Austria DEA only —
Cho (27) BCC 200 hospitals across 7 U.S. regions DEA only —
Küçük et al. (28) BCC 669 MoH hospitals in Türkiye DEA only —
Mohamadi et al. (29) CCR, MPI Health systems of 36 countries DEA only —
Schneider et al. (30) CCR, MPI 1,428 acute care hospitals in Germany DEA + Double-bootstrap Statistical validation of efficiency scores
Akula and Singh (31) CCR, BCC 48 tertiary hospitals in Punjab, India DEA only —
Fumbwe et al. (32) Dynamic DEA 133 public hospitals in Tanzania DEA only —
Han and Lee (33) CCR, BCC 3,458 U.S. hospitals DEA + Tobit Determinants of efficiency
Peng et al. (34) CCR, BCC 200 public hospitals in China DEA + Tobit, PSM Determinants of efficiency + Impact evaluation
Piubello Orsini et al. (35) BCC, MPI 43 public hospitals in Italy DEA + Tobit Determinants of efficiency
Yeşilyurt et al. (36) CCR, BCC 97 public hospitals in Türkiye DEA + PSO Optimization of efficiency scores
Yin et al. (37) CCR, MPI 25 public hospitals in Wuhan DEA only —
Yue et al. (38) SBM, MPI 61 TCM hospitals in China DEA only —
Chiu et al. (39) Dynamic DEA 19 medical centers in Taiwan DEA + Beta regression Determinants of efficiency
Danilov (40) BCC 56 state hospitals in Russia DEA + Regression Determinants of efficiency
Ghiyasi et al. (41) Inverse DEA, DEA-R 130 public hospitals in Iran DEA only —
Guerra et al. (42) CCR, BCC 50 hospitals in Brazil DEA only —
Yousefi et al. (43) BCC 15 public hospitals in Western Iran DEA + Tobit Determinants of efficiency
Bağcı and Koçyiğit (44) CCR, BCC, MPI 555 public hospitals in Türkiye DEA + Statistical analysis Descriptive analysis of efficiency trends
Dohmen et al. (45) BCC, MPI 72 Dutch hospitals DEA only —
Farantos and Koutsoukis (46) Window-DEA Greek public hospitals DEA only —
Hajiagha et al. (47) CCR 11 public hospitals in Iran DEA + PCA + FA Dimension reduction and model structuring
Lee et al. (48) CCR, BCC, SBM 6,251 U.S. hospitals DEA + Nonparametric tests Group comparison and influencing factors
Sun et al. (49) CCR, BCC 49 public hospitals in China DEA + Tobit Determinants of efficiency
Afonso et al. (50) NDEA 27 hospitals in Portuguese NHS DEA only —
Chatterjee and Gangopadhyay (51) CCR, BCC 25 hospitals in India DEA + Tobit Determinants of efficiency
Cinaroğlu (52) BCC Public hospitals in Türkiye (2005–2017) DEA + PSM, DiD Policy impact analysis
Li et al. (53) BCC 434 U.S. hospitals DEA + Semi-parametric Determinants of efficiency
Lindaas et al. (54) BCC, MPI 19 hospital trusts in Norway DEA + OLS Determinants of efficiency
Mitakos and Mpogiatzidis (55) CCR, BCC 38 Greek hospitals (COVID-19) DEA + AHP Decision support/weighting
Nguyen et al. (56) CCR, BCC 57 hospitals in Australia DEA + DiD Policy impact analysis
Wang et al. (57) CCR, BCC 16 TCM hospitals in China DEA only —
Fourlopoulou et al. (58) Cost DEA, MPI 109 Greek public hospitals DEA only —
Hadian et al. (59) AP, Super-efficiency DEA, MPI 26 university hospitals in Iran DEA only —
Jiang et al. (60) BCC 749 public hospitals in China DEA + PSM, DID Tobit Impact evaluation + Determinants of efficiency
Liao et al. (61) CCR, BCC, SBM, MPI TCM hospitals in China DEA only —
Shen et al. (62) BCC 70 U.S. hospitals DEA + Tobit & Logistic Determinants + Classification

As summarized in Table 1, the BCC (Variable Returns to Scale) model was the most frequently applied (24 occurrences), indicating a preference for variable scale efficiency analyses over constant returns. The CCR (Constant Returns to Scale) model followed with 19 uses, while MPI (Malmquist Productivity Index) appeared eleven times, reflecting interest in dynamic productivity change analyses. Other DEA models such as SBM, NDEA, Super-efficiency DEA, and AP were used less frequently (Table 2). These patterns suggest methodological diversity across studies, although the predominance of BCC and CCR models indicates that most evaluations relied on traditional DEA frameworks.

Table 2.

Frequency of DEA models used in the reviewed studies.

DEA model Frequency (n)
BCC (Banker, Charnes and Cooper) 24
CCR (Constant Returns to Scale) 19
MPI (Malmquist Productivity Index) 11
SBM (Slacks-Based Measure) 4
Super-efficiency DEA 2
Dynamic DEA 2
NDEA (Network DEA) 1
AP (Additive Model) 1
Inverse DEA 1
DEA-R 1
Window-DEA 1
Cost DEA 1

Analysis of input variables (Table 3) revealed that number of beds (49), number of physicians (36), and number of nurses (34) were the most common indicators, emphasizing the importance of physical capacity and core human resources in efficiency measurement. Cost/expenditure (25) and staff count (25) were also frequently included, suggesting a focus on both technical and financial efficiency. While these variables were widely used, their definitions and measurement approaches varied across studies, which may limit direct comparability. Secondary inputs such as technological infrastructure and case complexity indicators were occasionally incorporated to capture contextual and operational differences, but these appeared inconsistently across the reviewed literature.

Table 3.

Frequency of input variables used in the reviewed studies.

Category of input variable Specific variable Frequency (n)
Capacity Number of beds/hospital beds 49
Core workforce Number of physicians/doctors 36
Core workforce Number of nurses 34
Cost/financial Cost/expenditure/spending 25
Support workforce Number of staff/other personnel/general health personnel 25
Infrastructure/equipment Equipment/devices/infrastructure 5
Specialized capacity and technology MRI/CT scanners, special beds, etc. (7 sub-inputs) 7
Operational and quality inputs Case-mix index, length of stay, number of isolation rooms, services provided, etc. (8 sub-inputs) 8
Secondary financial inputs Per capita expenditure, financial ratios, etc. (5 sub-inputs) 5

Regarding output variables (Table 4), outpatient volume (40), inpatient volume (37), and number of surgeries (31) were dominant, demonstrating a traditional focus on service volume and production capacity. Quality-related outputs such as infection rates (6) and mortality rates (9) were increasingly included, reflecting a shift toward comprehensive models integrating both efficiency and care quality. However, the inclusion of quality indicators was still limited relative to volume-based outputs, indicating that most studies prioritized production efficiency over holistic performance assessments. Additional measures such as bed occupancy rates, length of stay, and process-specific metrics were used in a subset of studies, contributing to methodological heterogeneity.

Table 4.

Frequency of output variables used in the reviewed studies.

Category of output variable Specific variable Frequency (n)
Basic volume and productivity Outpatient visits 40
Inpatient admissions 37
Number of surgeries 31
Emergency visits/number of cases 18
Number of births 7
Quality and adverse outcomes Mortality rates/number of deaths 9
Infection rates/specific adverse outcomes 6
Quality, safety, and adverse outcomes (complications, complaints, etc.) 5
Operational efficiency and process Average length of stay 5
Bed occupancy rate 6
Resource utilization and efficiency ratios (such as bed/physician ratio) 9
Specific process and volume indicators (such as day care, laboratory, ECG tests) 19
Case severity and complexity DRG, MEL, HDG scores 3
Case-mix and diagnosis-based indicators (diagnostic accuracy, discharge by diagnosis) 11
Financial and institutional Revenue 13
Institutional and financial performance (ratios, staff satisfaction) 7
General health and accessibility General health and access indicators (life expectancy, spending ratio, service access) 4

In the second phase of this study, a comprehensive literature review was conducted to holistically reveal the methodological diversity and analytical objectives of studies that use DEA and machine learning methods together. Within the scope of the review, a total of 48 studies published between 2020 and 2025 that address DEA-ML integration in different application areas were systematically analyzed. The studies were classified and compared in terms of the DEA models used, the integrated machine learning methods, and the application areas. This classification aims to reveal the purposes and analytical strategies with which DEA-ML integration is used in different fields such as finance, energy, environment, education, industry, and public services, not just the healthcare sector. The findings provide important clues for determining methodological approaches that can be used in hospital efficiency analyses. A summary of the studies created in this regard is presented in Table 5.

Table 5.

Studies integrating data envelopment analysis (DEA) and machine learning (ML).

Author(s) and year DEA methods Machine learning methods Application domain Total quality score
Aydin and Yurdakul (63) Weighted Stochastic Imprecise DEA (WSIDEA) k-means, Hierarchical Clustering, Decision Tree, Random Forest Country-level COVID-19 performance 7
Appiahene et al. (64) CCR-DEA (Two-stage: Deposit & Investment) Decision Tree (C5.0), Random Forest, Artificial Neural Network Banking sector (Bank branch operational efficiency, Ghana) 7
Najadat et al. (65) CCR, BCC Ensemble Decision Trees (DECORATE) Finance and Industrial Firms 6
Nazari et al. (66) Super-efficiency DEA Support Vector Machine (SVM), Artificial Neural Network (ANN), k-Nearest Neighbors (KNN), Decision Trees Economics, Banking, and Finance 6
Mirmozaffari et al. (67) CCR, BCC, FDH, Window DEA k-means clustering, pre-processing filters Cement Industry 7
Singpai and Wu (68) CCR, BCC (VRS, output-oriented) AutoML; Artificial Neural Network (BPNN) Energy/Environment/Sustainability (SDGs) 7
De La Hoz et al. (69) CCR-DEA Random Forest, Decision Tree Higher Education (Engineering Programs) 7
Hatamzad et al. (70) CCR (CRS) SVM, SVM-GA, KNN, Decision Tree, MLP, Logistic Regression Road Maintenance/Transportation Infrastructure 7
Mirmozaffari et al. (71) CCR, BCC, Additive DEA, Malmquist Productivity Index (MPI) k-Nearest Neighbors, Decision Tree, Naïve Bayes, Association Rules (Apriori) Cement Industry/Eco-efficiency/Energy & Environmental Management 5
Olanrewaju (72) CCR Artificial Neural Network (Multilayer Perceptron) Energy 5
Xu et al. (73) CCR CART, Boosted Tree (BT), Random Forest (RF), Logistic Regression (LR) COVID-19 response efficiency of U.S. states (healthcare system performance/public health policy) 7
Zhong et al. (74) SBM Neural Networks (NN), Support Vector Regression (SVR), XGBoost, Lasso Banking and Finance 7
Zhu, Zhu and Emrouznejad (75) CCR (CRS) ANN (BPNN), GA-ANN (GANN), SVM, Improved SVM Manufacturing/Industrial Firms 7
Ali and Shirazi (76) VRS DEA (input-oriented) Transformer-based NLP (BERT) Environmental sustainability/E-waste policy 5
Liu et al. (77) NDDF-based DEA LightGBM Green economic efficiency/environmental sustainability (prefecture-level cities, China) 5
Mirmozaffari et al. (78) Additive DEA, CCR, BCC, Window DEA k-NN, Decision Tree, Naïve Bayes Pharmaceutical companies/firm efficiency (COVID-19 period) 6
Niu et al. (79) SBM with undesirable outputs (global covariance) Logistic Regression, SVM, BPNN, CART, Random Forest, GBDT, XGBoost, LightGBM, AdaBoost, Bagging Low-carbon economic efficiency (regional/environmental sustainability) 7
Petridis et al. (80) RDM, SBM Support Vector Machines (classification) Finance 7
Tsaples et al. (81) Two-stage/multi-dimensional DEA (alternative optimization metric) Machine learning–based exploratory modeling (EMA, feature exploration) Country-level sustainability assessment (EU-28) 4
Wahyudi and Asrol (82) CCR Decision Trees and Artificial Neural Networks Food Industry 5
Zarrin et al. (83) SBM DEA (VRS, input-oriented), Bootstrapped DEA Self-Organizing Map ANN (SOM-ANN), Multilayer Perceptron ANN (MLP-ANN) Healthcare/Hospitals (Germany) 7
Zhang et al. (84) SBM Support Vector Regression, BPNN, Random Forest, XGBoost Environmental Studies 7
Aparicio et al. (85) Dynamic DEA, Dynamic FDH Decision Tree-based Efficiency Analysis (EAT) Manufacturing and Food Sectors 7
Duras et al. (86) BCC, SCNLS-based DEA LASSO, Elastic Net (EN), Adaptive LASSO (ALASSO) Electricity distribution sector (Swedish DSOs) 7
Rajaprasad and Rambabu (87) CCR Logistic Regression, Random Forest, Decision Tree, XGBoost Construction Project Sites/Occupational Health and Safety Performance 7
Yu and Lou (88) CCR-DEA (input-oriented, CRS) Projection Pursuit Regression (PPR); comparative models with ANN (BPNN) and SVR Performance evaluation and efficiency prediction of DMUs 6
Nishtha et al. (89) Interval DEA, CCR, BCC Support Vector Regression (SVR) Banking 7
Bogetoft et al. (90) DEA (CCR, target setting) Counterfactual analysis, bilevel optimization (XAI-based ML integration) Banking 6
Çakır (91) Context-dependent DEA Adaptive Neuro-Fuzzy Inference System (ANFIS) Transportation and Railways 7
Chivardi and Zamudio Sosa (92) BCC (output-oriented) with bootstrapping Random Forest Technical efficiency of primary diabetes care (Mexico) 7
Khoubrane et al. (93) CCR, BCC CatBoost, LightGBM, XGBoost Finance and Business 7
Omrani et al. (94) DEA, COLS Support Vector Regression (SVR), Fuzzy C-Means (FCM) Electricity distribution companies (energy sector) 6
Perroni et al. (95) CCR, BCC, IRS, DRS, SFA SVM, KNN, Decision Tree, LDA, LM Manufacturing/Energy Performance 7
Rezaee et al. (96) CCR-DEA (CRS), multi-level efficiency frontiers Random Forest, LIME, MOCE, MOPSO Hospital performance evaluation and benchmarking (Iran) 7
Santamato et al. (97) Output-oriented DEA (VRS, SHAP-weighted DEA) Logistic Regression, k-means clustering, SHAP (XAI) Healthcare/Hospitals (Italy–Apulia & Emilia-Romagna) 7
Shi and Zhao (98) BCC Random Forest, RBF-SVM, Logistic Regression Banking and Finance 7
Zofio et al. (99) CCR, BCC Efficiency Analysis Trees (EAT), Convexified EAT (CEAT) Higher Education Institutions 7
Boubaker et al. (100) CSW-RA-DEA (Regression-based DEA) Neural Networks, Support Vector Regression, Random Forest Economics, Business, Manufacturing 7
Czyżewski et al. (101) SBM-DEA (VRS), Luenberger Index (TFP) Random Forest, GBM, XGBoost, CatBoost, LASSO Agriculture, Food Security, Sustainable Development 7
de Oliveira et al. (102) Super-SBM DEA (VRS) Gradient Boosting (XGBoost) Healthcare/Hospitals 7
Dipierro and De Witte (103) CCR, BCC Random Forest–based feature selection, Genetic Algorithm, Ant Colony Optimization Higher Education Institutions (European universities) 7
Guillen et al. (104) DEA with undesirable outputs (EATBoosting; enhanced hyperbolic DEA) Gradient Tree Boosting (EATBoosting) Manufacturing/PCB production 6
He et al. (105) Three-stage SBM DEA, Global Malmquist Productivity Index LASSO, LSTM, Double/Debiased Machine Learning (DML) Green total factor productivity (cross-country analysis) 7
Joo (106) Free Disposal Hull (FDH) Efficiency Analysis Trees (EAT), Random Forest for EAT (RFEAT) Health system efficiency of OECD countries 7
Mazandaran et al. (107) CCR (input-oriented), Russell non-radial DEA Artificial Neural Network (MLP) Finance/Listed Companies 7
Soffan et al. (108) BCC Fuzzy C-Means, k-medoids, MLP, SVR, Random Forest, Gradient Boosting, Genetic Algorithm Tax service offices/public sector efficiency (Indonesia) 7
Sun et al. (109) BCC Gradient Boosting Machine, Random Forest, SVM, ANN, AdaBoost Telehealth efficiency/Healthcare services (U.S.) 7
Yılmaz et al. (110) BCC k-means clustering, CART, Random Forest Global COVID-19 contagion control and treatment efficiency 7

Table 5 shows that DEA-ML integration is addressed in the literature through many different methodological combinations. On the DEA side, CCR and BCC models are predominantly used, but SBM, super-efficiency DEA, window analysis, dynamic DEA, and models including unwanted outputs have also gained prominence, especially in recent years. In terms of machine learning methods, Random Forest, support vector machines, artificial neural networks, and gradient boosting-based algorithms are heavily used for estimating efficiency scores, classification, clustering, variable selection, and explainability purposes. It is noteworthy that the number of studies focusing on health and hospitals is relatively limited; however, DEA-ML approaches developed in fields such as finance, energy, environment, and education include more advanced analytical tools (XAI, counterfactual analysis, target setting). This situation indicates that DEA applications in the healthcare sector are still predominantly addressed within the classical framework, and the analytical potential offered by DEA-ML integration is not sufficiently utilized. Therefore, adapting this methodological accumulation from different fields to hospital efficiency analyses presents a significant opportunity to both improve the accuracy of effectiveness measurement and produce more explainable and actionable outcomes from a policy and management perspective.

In this study, a systematic quality assessment process was applied to evaluate the methodological quality of the studies included in accordance with the PRISMA guidelines. The quality assessment criteria used were based on the checklist approach commonly used in systematic review studies and adapted to the methodological characteristics of DEA-machine learning studies, based on the framework proposed by Kitchenham (115). Seven criteria were used in the evaluation: (1) clarity of research objective, (2) transparency of dataset, (3) specification of DEA model, (4) clarity of machine learning method, (5) presence of model validation process, (6) use of performance evaluation metrics, and (7) interpretation of results. Each criterion was scored as 1 (yes) or 0 (no), and a total quality score between 0 and 7 was calculated for each study. The total quality scores for the literature included in the study are presented in Table 5. The findings indicate that the majority of studies clearly define their research objectives, present datasets in detail, and explicitly specify DEA and machine learning methods. However, some shortcomings are noteworthy, particularly in terms of model validation techniques (train-test separation, cross-validation, etc.) and the use of performance evaluation metrics. These shortcomings are particularly evident in studies published between 2020 and 2022, whereas recent studies show a more systematic and standards-compliant application of model validation processes. This indicates that the DEA and machine learning integration literature is becoming increasingly mature methodologically. Most of the studies reviewed largely meet the defined quality criteria, indicating that the literature has a strong methodological foundation.

The studies summarized in Table 5 reveal not only the diversity of methods used but also the purposes and analytical strategies employed in different contexts for DEA-ML integration. However, a table-based descriptive presentation is limited in its ability to comprehensively assess the relational structures, shared methodological patterns, and points of divergence between the studies. Therefore, Multiple Correspondence Analysis (MCA) was applied to visually and analytically reveal dominant methodological patterns, alternative approaches, and potential research gaps in the DEA-ML integration literature. To this end, the literature on DEA-ML integration was systematically reviewed, and a categorical dataset was created from studies selected according to defined inclusion criteria. To ensure the rigor and consistency of the coding process, a structured coding protocol was developed prior to analysis, including clear definitions and decision rules. All studies were assigned to a single dominant category per dimension according to their primary methodological focus, within six predefined dimensions. In studies with multiple methodological components, classification was based on the dominant analytical approach emphasized by the authors. The coding framework used for MCA is given in Table 6.

Table 6.

Coding framework used in MCA.

Dimension Categories
Purpose Supervised ML (classification & prediction); Model interpretability; Clustering; Benchmarking/target setting
Integration direction DEA → ML; ML → DEA; Simultaneous/hybrid; DEA-based ML
Application area Healthcare; Finance; Industry; Education; Energy/Environment; Other
Data structure Cross-sectional; Time-dependent data structure; Big data/text-based
DEA orientation Input-oriented; Output-oriented; Unspecified/both
Target variable DEA efficiency score; Multi-level DEA class; Non-efficiency/mixed target

The coding process was conducted independently by two researchers, and ambiguities were re-examined to ensure consistency. Inter-coder reliability was assessed using both percentage agreement and Cohen's kappa coefficient. Agreement rates ranged from 91.7% to 97.9%, while kappa values ranged from 0.817 to 0.960, indicating a very high level of agreement between coders. Coding differences were discussed and resolved, and Multiple Correspondence Analysis (MCA) was performed on the final consensus dataset.

The two-dimensional MCA map obtained from the multiple correspondence analysis, presented in Figure 3, explains approximately half of the total inertia (Dimension 1: 24.7%; Dimension 2: 24.1%). In analyses based on categorical data structures, this level of explanation indicates the presence of a meaningful and interpretable relational structure in the literature (111). To show which categories are decisive in the formation of these dimensions, the variables contributing to Dimension 1 and Dimension 2 are presented in Figure 2.

Figure 3.

MCA factor map scatterplot displaying terms related to machine learning (ML) and data envelopment analysis (DEA), grouped in green and red, across two principal dimensions labeled Dim 1 (24.67%) and Dim 2 (24.10%) with black dashed axes intersecting at the origin.

MCA Map of the DEA–ML literature.

Figure 2.

Two bar charts compare the contributions of variables to Dimension 1 and Dimension 2, with the highest contributors being \"target setting\" and \"mixed target\" respectively; a red dashed line marks a 10 percent threshold.

Contribution of categories to dimension 1 and dimension 2.

The contribution graphs presented in Figure 2 show the methodological categories that are decisive in the formation of Dimension 1 and Dimension 2 obtained within the scope of MCA. Dimension 1 is predominantly shaped by categories related to the direction of integration between DEA and machine learning and the purpose of analytical use. In contrast, Dimension 2 is primarily shaped by categories reflecting the direction of integration between DEA and machine learning and differences in target variable structures. Categories with contribution levels above the average are considered as key reference points in interpreting the relevant dimensions. To complement the graphical interpretation and provide a more detailed numerical representation, the category coordinates and contribution values are presented in Table 7.

Table 7.

Category coordinates and contributions from multiple correspondence analysis.

Category Dim 1 Dim 2 Contribution Dim 1 (%) Contribution Dim 2 (%)
Supervised ML (classification & prediction) −0.274 −0.245 3.13 2.57
Model interpretability −0.430 0.678 1.92 4.90
Benchmarking/target setting 2.746 0.547 43.68 1.77
DEA → ML −0.294 −0.504 3.60 10.85
ML → DEA −1.075 2.102 6.69 26.19
Simultaneous/hybrid 1.364 1.341 12.93 12.79
DEA-based ML 2.589 −0.135 23.29 0.06
DEA efficiency score 0.142 −0.375 0.94 6.68
Multi-level DEA class −0.480 0.529 1.07 1.33
Non-efficiency/mixed target −0.630 2.149 2.75 32.85

When the category coordinates are examined, it is seen that the studies are distinctly differentiated according to their methodological approaches. In particular, the fact that benchmarking/target setting and DEA-based machine learning approaches are located on the positive side of Dimension 1 indicates that this dimension represents analytical approaches that are more focused on decision support and goal setting. In contrast, DEA → ML structures are located on the negative side of Dimension 1 and reflect more traditional, two-stage analysis approaches. When evaluated in terms of Dimension 2, it is observed that the ML → DEA and non-efficiency/mixed target categories are concentrated in the positive region. This indicates that the second dimension is particularly related to the integration aspect between DEA and machine learning, and the analytical use purpose of the model. When the contribution values are examined, it is seen that Dimension 1 is largely shaped by benchmarking/target setting (43.68%), while Dimension 2 is predominantly determined by the ML → DEA (26.19%) and non-efficiency/mixed target (32.85%) categories. This indicates that the contribution values reflect the extent to which each category represents the dimensional structure in a distinctive way, rather than the frequency of the categories.

Based on these numerical results, the overall relational structure among categories is visualized in the MCA factor map presented in Figure 3.

The Multiple Correspondence Analysis (MCA) results presented in Figure 3 show that the methodological preferences, analytical objectives, and application areas of studies based on DEA-ML integration are significantly differentiated under two main dimensions. The first dimension (Dim1) explains 24.7% of the total variance and mainly reflects the direction of integration between DEA and machine learning and the level of decision support-oriented use. On the positive side of this dimension are approaches that use DEA and ML simultaneously and integrally, such as benchmarking/target setting, DEA-based ML, and simultaneous/hybrid; while on the negative side are structures that are more two-stage and where DEA outputs provide input to ML models, such as DEA → ML, non-efficiency/mixed target, and model interpretability. The second dimension (Dim2) explains 24.1% of the total variance and represents the data structure and contextual complexity level of the studies. At the top of this dimension, high-dimensional, sustainability and environmental performance-focused applications such as big data/text-based, ML → DEA, and energy/environment come to the forefront; while at the bottom, studies based on more traditional, score-based and time-dependent efficiency analyses such as healthcare, efficiency score, and time-dependent data structure are concentrated.

The map shows that studies in the context of health and hospital efficiency are mostly clustered around the center and on the negative side of the second dimension. This indicates that DEA-ML studies in the health field largely rely on classical DEA models, and machine learning methods are mostly used for secondary analytical purposes such as classifying or estimating efficiency scores. In contrast, it is noteworthy that studies conducted in the fields of energy, environment, and sustainability are differentiated by more complex data structures and deeper hybrid integration strategies. Overall, the MCA findings reveal that the DEA-ML literature does not exhibit a homogeneous structure. While there is a dominant core of the literature based on supervised learning models and efficiency scores as target variables, more innovative methodological approaches are also emerging. These approaches employ DEA and ML simultaneously and integrally, often relying on mixed target variables and big data contexts. This indicates that advanced hybrid DEA–ML approaches and goal-setting-oriented analyses are still limited, particularly in the hospital efficiency literature. However, there is significant potential to adapt methodological approaches developed in other sectors to the healthcare field.

4. Discussion

This systematic review presents a comprehensive and multi-layered synthesis of studies using Data Envelopment Analysis (DEA) and Machine Learning (ML) methods in evaluating hospital and healthcare system performance. Covering the period 2020–2025, the analysis reveals not only the frequency of the methods used but also the analytical purposes, data structures, and integration strategies within which these methods are used together. At this point, it is important to make a clear distinction between hospital-specific findings and cross-sector methodological insights. Findings from DEA-based studies conducted in hospital and healthcare settings provide direct evidence regarding input-output structures, performance indicators, and efficiency measurement practices specific to healthcare systems. In contrast, studies conducted in other sectors are considered not as direct empirical evidence regarding hospital efficiency, but as methodological examples revealing how DEA-machine learning integration is structured in different contexts. Therefore, cross-sector findings are used to support and enrich the methodological interpretation of hospital-focused findings, rather than generating domain-specific conclusions. In this context, Multiple Correspondence Analysis (MCA), applied beyond classical table-based summaries, has allowed for a relational perspective on the methodological patterns and divergences in the literature. The MCA findings indicate that the DEA–ML literature does not exhibit a homogeneous structure. Instead, it reveals a multi-layered structure with a dominant methodological core and more innovative approaches in peripheral regions.

The majority of studies clustered in the center of the map consist of two-stage structures that use efficiency scores obtained from DEA as target variables and rely on supervised learning models (particularly Artificial Neural Networks and Support Vector Machines). This suggests that DEA is predominantly positioned in the literature as an explanatory or preprocessing tool, while ML methods mostly serve secondary analytical purposes such as classification or prediction. These findings indicate that the integration of DEA and machine learning within the scope of (RQ2) is largely shaped around two-stage structures in the literature, and that more advanced, simultaneous, and hybrid approaches remain limited.

It is noteworthy that this core structure largely overlaps with the health and hospital efficiency literature. The majority of health-focused studies included in the review prefer the BCC model, which is based on the assumption of variable scale returns; focusing on traditional capacity indicators such as bed capacity, physician and nurse numbers as inputs, and patient volume-based metrics as outputs. The use of the Malmquist Productivity Index (MPI), particularly in the post-pandemic period to track temporal change, reflects the increasing interest in dynamic efficiency analysis in health systems. However, while the integration of indicators reflecting quality and patient safety (e.g., mortality or infection rates) is increasing, inconsistencies in the use of these variables limit the production of generalizable results for value-based performance evaluations in healthcare. This situation reveals that the input and output variables used in hospital efficiency studies under (RQ1) are largely based on traditional capacity and service volume indicators; while quality and financial indicators are increasing, they are not yet consistently integrated.

The findings presented in Tables 3, 4 demonstrate that the use of quality-based output variables in DEA (machine learning) studies is shaped not only by analytical preferences but also by structural and organizational factors. Health data is considered personal health information (PHI) because it is directly related to patient care and is subject to stricter legal and ethical protection compared to other types of data. In this context, regulatory frameworks such as GDPR and HIPAA impose significant limitations on data access, sharing, and use; and mandate principles such as explicit consent, data minimization, and access control (112). However, the use of quality indicators is also closely related to the measurement difficulties arising from the nature of these variables. Quality in healthcare is a multidimensional concept encompassing multiple aspects and varying depending on patients' individual preferences and values. While this introduces a certain degree of subjectivity to quality measurement, the persistence of differences in application, even in areas with strong scientific evidence, makes the standardization of quality indicators difficult (113). Furthermore, the differences in data protection regulations and quality measurement standards between countries and health systems make it difficult to develop comparable and generalizable quality indicators. Indeed, the literature clearly emphasizes that heterogeneity in data protection practices constitutes a significant obstacle to international health system comparisons (114). In this context, observed findings should be evaluated not only in terms of methodological preferences but also in conjunction with multidimensional factors such as data access, regulatory structure, and measurement challenges.

Studies located in the peripheral regions of the MCA map represent approaches where DEA and ML are integrated more deeply and simultaneously. These studies often use mixed target variables and analyze big data or text-based structures. A significant portion of these studies focus on the fields of energy, environment, and sustainability; they utilize more advanced ML techniques such as Random Forest, boosting algorithms, and explainable artificial intelligence (XAI) tools. These findings demonstrate that, within the scope of (RQ3), DEA-machine learning integration is not limited to the healthcare sector but is being applied in different fields such as energy, environment, and finance with more advanced data structures and analytical approaches. This indicates that methodological innovations in DEA-ML integration are being adopted more rapidly in fields outside the healthcare sector, while these approaches remain limited in the healthcare sector.

In this context, the distribution of the studies examined according to their application areas also supports this observation. Of the 48 studies included in the review, 6 focus directly on hospitals and healthcare services, and this number reaches 10 when studies on healthcare system performance and COVID-19 are also included. The remaining studies are distributed across different fields such as energy, environment, finance, industry, and public services. This distribution demonstrates the widespread use of DEA-machine learning integration in various application areas, rather than a gap in the health literature. Although the relatively limited number of health-focused studies might be considered an imbalance, this does not weaken the validity of the study's findings. On the contrary, the inclusion of studies from different fields reveals the methodological diversity and analytical potential of DEA-machine learning integration more comprehensively. This cross-disciplinary perspective contributes to the identification of analytical approaches that are not yet widely used in the healthcare sector but have significant potential. Finally, when the findings are evaluated within the scope of RQ4, it is seen that the DEA-machine learning literature can be classified within dominant, transitional, and innovative methodological clusters; and that the transition between these clusters is still limited, especially in the healthcare field. These findings reveal that the integration of DEA-ML in the healthcare sector is still predominantly based on traditional, two-stage, and score-based structures; while advanced hybrid approaches focused on decision support, goal setting, and explainability are a developing research area. This methodological gap indicated by the MCA results provides an important guiding framework for future studies in healthcare. In particular, the use of real-time administrative and clinical datasets, more consistent integration of quality-oriented outcomes, and making DEA-ML models explainable to decision-makers are among the key research needs highlighted in the literature. In conclusion, this study not only summarizes current methodological trends in the hospital efficiency literature but also provides a methodological roadmap for advanced hybrid approaches applicable in healthcare by highlighting the structural and relational dimensions of DEA-ML integration through MCA. In this respect, the study makes a critical and guiding contribution to the literature on the more standardized, comparable, and policy-meaningful use of DEA and machine learning in healthcare research.

5. Conclusion

This systematic review comprehensively reveals how Data Envelopment Analysis (DEA) and Machine Learning (ML) methods are used in evaluating performance and efficiency in healthcare, and within which analytical strategies they are integrated. Findings covering the period 2020–2025 show that DEA continues to provide a flexible framework for efficiency analysis in healthcare.

The findings indicate that the DEA–ML literature is characterized by a dominant core based on traditional approaches, while more advanced and integrated methods remain limited. This structural divergence reveals that advanced hybrid models developed in areas such as energy, environment, and sustainability have only been reflected to a limited extent in the healthcare sector. This finding highlights a structural divergence between healthcare and other domains in terms of DEA-ML integration.

The review findings indicate that input structures used in hospital efficiency studies are increasingly focused on financial indicators, and that classical non-parametric DEA approaches are being supported by tree-based and ensemble-based machine learning methods to enhance their distinctiveness. However, it is observed that DEA models used in the literature largely concentrate around traditional BCC and CCR frameworks; physical capacity and basic human resources dominate as inputs, while service volume dominates as outputs. Although quality, patient safety, and process-based outputs have begun to be incorporated more frequently, their use remains inconsistent across studies.

Overall, this study describes how DEA and machine learning methods are positioned in healthcare research. It also identifies key methodological gaps by highlighting the structural and relational dimensions of this integration. These findings collectively underscore the need for more coherent and methodologically consistent DEA-ML applications in healthcare. In this respect, the study offers a holistic and guiding methodological framework for efficiency analysis in healthcare for academics, policymakers, and practitioners.

6. Future research directions

The findings of this study demonstrate certain methodological limitations in the DEA-machine learning literature, particularly in the context of healthcare and hospital efficiency. Firstly, existing studies largely rely on two-stage structures where efficiency scores obtained from DEA are used as target variables in machine learning models. Therefore, it is important for future research to address efficiency measurement and machine learning processes within integrated models rather than as separate stages.

Furthermore, it was determined that the input and output variables used in hospital efficiency studies are predominantly based on capacity and service volume, while quality and patient safety indicators are used in a limited and inconsistent manner. Therefore, future studies that systematically integrate quality-oriented and process-based indicators into models will contribute to more comprehensive performance evaluations.

Furthermore, the Multiple Correspondence Analysis results show that DEA-machine learning applications in the healthcare field are mostly concentrated around traditional approaches, whereas more advanced hybrid models are used in fields such as energy and environment. In line with this finding, adapting advanced DEA-machine learning approaches developed in other fields to hospital and healthcare system data will increase analytical depth and decision support capacity.

Finally, current studies show that machine learning methods are mostly used for classification and prediction purposes. Therefore, it is important for future research to focus on how these methods can be improved not only for prediction but also to enhance the interpretability of efficiency analyses and their usability for decision-makers.

7. Limitations

This study provides a comprehensive systematic review and methodological synthesis of DEA-ML integration in healthcare, but it has some limitations. First, the included studies exhibit significant diversity in terms of DEA modeling approaches, machine learning algorithms, and analytical designs. While this reflects the evolving nature of the field, it limits the direct comparability of the efficiency results obtained between the studies. Similarly, differences in the definitions of input and output variables limit comparability across studies. In particular, the inconsistent integration of quality and patient safety indicators requires a cautious interpretation of the findings. Secondly, the MCA used in this study is an exploratory method and does not allow causal inferences. MCA results are sensitive to how categorical variables are defined and do not offer causal inferences. Furthermore, the fact that DEA-ML applications in healthcare have largely gained momentum in the post-2020 period naturally limited the number of studies included in the review. These limitations, rather than weakening the study's findings, highlight the need for more standardized, transparent, and methodologically mature approaches to DEA-ML integration in healthcare. The scope of this study is limited to the years 2020–2025. This choice is related to the increasing use of DEA-machine learning integration, especially in recent years, and the emergence of methodological diversity during this period. However, excluding studies developed before this time frame is a limitation of the study. Nevertheless, since this study aims to reveal the current state of methodological trends and especially the analytical approaches that have emerged recently, its focus is limited to the recent literature. In this context, the findings reflect current methodological developments and are geared towards analyzing current trends rather than comprehensively addressing the historical development of the literature.

Funding Statement

The author(s) declared that financial support was not received for this work and/or its publication.

Footnotes

Edited by: Sven Hellbach, West Saxon University of Applied Sciences of Zwickau, Germany

Reviewed by: Zheng Yuan, China Academy of Chinese Medical Sciences, China

Mehmet Ulaş Koyuncuoğlu, Pamukkale University, Türkiye

Data availability statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.

Author contributions

NA: Conceptualization, Investigation, Methodology, Project administration, Software, Supervision, Visualization, Writing – original draft, Writing – review & editing. UK: Data curation, Investigation, Methodology, Writing – original draft, Writing – review & editing. BA: Investigation, Validation, Visualization, Writing – original draft, Writing – review & editing. AS: Investigation, Methodology, Validation, Visualization, Writing – original draft, Writing – review & editing.

Conflict of interest

The author(s) declared that this work was conducted in the absence of any commercial or financial relationships that could be construed as a potential conflict of interest.

Generative AI statement

The author(s) declared that generative AI was not used in the creation of this manuscript.

Any alternative text (alt text) provided alongside figures in this article has been generated by Frontiers with the support of artificial intelligence and reasonable efforts have been made to ensure accuracy, including review by the authors wherever possible. If you identify any issues, please contact us.

Publisher's note

All claims expressed in this article are solely those of the authors and do not necessarily represent those of their affiliated organizations, or those of the publisher, the editors and the reviewers. Any product that may be evaluated in this article, or claim that may be made by its manufacturer, is not guaranteed or endorsed by the publisher.

References

  • 1.Alexander CA, Busch G, Stringer K. Implementing and interpreting a data envelopment analysis model to assess the efficiency of health systems in developing countries. IMA J Manag Math. (2003) 14(1):49–63. 10.1093/imaman/14.1.49 [DOI] [Google Scholar]
  • 2.Smith PC, editor. Performance Measurement for Health System Improvement: Experiences, Challenges and Prospects. Cambridge: Cambridge University Press; (2009). [Google Scholar]
  • 3.Shone R. Applications in Intermediate Microeconomics. Oxford: Martin Robertson; (1981). [Google Scholar]
  • 4.Özgener Ş, Küçük F. Hastanelerde modern yönetim felsefesinin verimliliğe etkisi: Gevher Nesibe Hastanesinde bir Uygulama. Selçuk Üniv Sosyal Bilim Enstitüsü Derg. (2008) 20:543–60. https://izlik.org/JA68NC59ZJ [Google Scholar]
  • 5.Farrell M, Royal J. The measurement of productive efficiency. J R Stat Soc Ser A. (1957) 120(3):253–81. 10.2307/2343100 [DOI] [Google Scholar]
  • 6.Charnes A, Cooper WW, Rhodes E. Measuring the efficiency of decision making units. Eur J Oper Res. (1978) 2(6):429–44. 10.1016/0377-2217(78)90138-8 [DOI] [Google Scholar]
  • 7.Banker RD, Charnes A, Cooper WW. Some models for estimating technical and scale inefficiencies in data envelopment analysis. Manage Sci. (1984) 30(9):1078–92. 10.1287/mnsc.30.9.1078 [DOI] [Google Scholar]
  • 8.Bishop CM, Nasrabadi NM. Pattern Recognition and Machine Learning. Vol. 4, No. 4. New York: Springer; (2006). p. 738. [Google Scholar]
  • 9.Koza JR, Bennett FH, III, Andre D, Keane MA. Automated design of both the topology and sizing of analog electrical circuits using genetic programming. In: Artificial Intelligence in design’96) Dordrecht: Springer Netherlands; (1996). P. 151–70. [Google Scholar]
  • 10.McCarthy J. Programs with common sense. In: Mechanisation of Thought Processes: Proceedings of the Symposium of the National Physics Laboratory. Her Majesty’s Stationery Office; (1959). p. 77–84. Available online at: http://www-formal.stanford.edu/jmc/mcc59.html [Google Scholar]
  • 11.McCarthy J, Minsky ML, Rochester N, Shannon CE. A proposal for the dartmouth summer research project on artificial intelligence. In: Dartmouth Conference (1956). [Google Scholar]
  • 12.Naylor CD. On the prospects for a (deep) learning health care system. Jama. (2018) 320(11):1099–100. 10.1001/jama.2018.11103 [DOI] [PubMed] [Google Scholar]
  • 13.Rai A, Constantinides P, Sarker S. Next generation digital platforms: toward human-AI hybrids. MIS Q. (2019) 43(1):iii–ix. [Google Scholar]
  • 14.Power DJ. UNI ScholarWorks (2002).
  • 15.Domingos P. A few useful things to know about machine learning. Commun ACM. (2012) 55(10):78–87. 10.1145/2347736.2347755 [DOI] [Google Scholar]
  • 16.Adadi A, Berrada M. Peeking inside the black-box: a survey on explainable artificial intelligence (XAI). IEEE Access. (2018) 6:52138–60. 10.1109/ACCESS.2018.2870052 [DOI] [Google Scholar]
  • 17.Shmueli G, Koppius OR. Predictive analytics in information systems research1. MIS Q. (2011) 35(3):553–72. 10.2307/23042796 [DOI] [Google Scholar]
  • 18.Cook WD, Seiford LM. Data envelopment analysis (DEA)–thirty years on. Eur J Oper Res. (2009) 192(1):1–17. 10.1016/j.ejor.2008.01.032 [DOI] [Google Scholar]
  • 19.Emrouznejad A, Yang GL. A survey and analysis of the first 40 years of scholarly literature in DEA: 1978–2016. Socioecon Plann Sci. (2018) 61:4–8. 10.1016/j.seps.2017.01.008 [DOI] [Google Scholar]
  • 20.Greenacre M. Correspondence Analysis in Practice. Boca Raton, FL: Chapman and Hall/CRC; (2017). [Google Scholar]
  • 21.Tranfield D, Denyer D, Smart P. Towards a methodology for developing evidence-informed management knowledge by means of systematic review. Br J Manag. (2003) 14(3):207–22. 10.1111/1467-8551.00375 [DOI] [Google Scholar]
  • 22.Liberati A, Altman DG, Tetzlaff J, Mulrow C, Gøtzsche PC, Ioannidis JP, et al. The PRISMA statement for reporting systematic reviews and meta-analyses of studies that evaluate healthcare interventions: explanation and elaboration. Br Med J. (2009) 339:b2700. 10.1136/bmj.b2700 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Alatawi AD, Niessen LW, Khan JA. Efficiency evaluation of public hospitals in Saudi Arabia: an application of data envelopment analysis. BMJ Open. (2020) 10(1):e031924. 10.1136/bmjopen-2019-031924 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Ayiko R, Mujasi PN, Abaliwano J, Turyareeba D, Enyaku R, Anguyo R, et al. Levels, trends and determinants of technical efficiency of general hospitals in Uganda: data envelopment analysis and Tobit regression analysis. BMC Health Serv Res. (2020) 20(1):916. 10.1186/s12913-020-05746-w [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Barpanda S, Sreekumar N. Performance analysis of hospitals in Kerala using data envelopment analysis model. J Health Manag. (2020) 22(1):25–40. 10.1177/0972063420908372 [DOI] [Google Scholar]
  • 26.Berger M, Sommersguter-Reichmann M, Czypionka T. Determinants of soft budget constraints: how public debt affects hospital performance in Austria. Soc Sci Med. (2020) 249:112855. 10.1016/j.socscimed.2020.112855 [DOI] [PubMed] [Google Scholar]
  • 27.Cho J. Comparative efficiency analysis of hospitals based on the region, ownership, and service using data envelopment analysis. Issues in Inf Syst. (2020) 21(3):153–67. 10.48009/3_iis_2020_153-167 [DOI] [Google Scholar]
  • 28.Küçük A, Özsoy VS, Balkan D. Assessment of technical efficiency of public hospitals in Turkey. Eur J Public Health. (2020) 30(2):230–5. 10.1093/eurpub/ckz143 [DOI] [PubMed] [Google Scholar]
  • 29.Mohamadi E, Manesh AO, Takian A, Majdzadeh R, Lotfi FH, Sharafi H, et al. Technical efficiency in health production: a comparison between Iran and other upper middle-income countries. Health Policy Technol. (2020) 9(3):335–47. 10.1016/j.hlpt.2020.06.007 [DOI] [Google Scholar]
  • 30.Schneider AM, Oppel EM, Schreyögg J. Investigating the link between medical urgency and hospital efficiency–insights from the German hospital market. Health Care Manag Sci. (2020) 23(4):649–60. 10.1007/s10729-020-09520-6 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 31.Akula SC, Singh P. Modeling relation between hospital efficiency and customer satisfaction of tertiary hospitals: a case of data envelopment analysis. Pharmacogn J. (2021) 13(6):1527–32. 10.5530/pj.2021.13.194 [DOI] [Google Scholar]
  • 32.Fumbwe F, Lihawa R, Andrew F, Kinyanjui G, Mkuna E. Examination on level of scale efficiency in public hospitals in Tanzania. Cost Eff Resour Alloc. (2021) 19(1):49. 10.1186/s12962-021-00305-4 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 33.Han A, Lee KH. The impact of public reporting schemes and market competition on hospital efficiency. Healthcare. (2021) 9(8):1031. 10.3390/healthcare9081031 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 34.Peng Z, Zhu L, Wan G, Coyte PC. Can integrated care improve the efficiency of hospitals? Research based on 200 hospitals in China. Cost Eff Resour Alloc. (2021) 19(1):61. 10.1186/s12962-021-00314-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 35.Piubello Orsini L, Leardini C, Vernizzi S, Campedelli B. Inefficiency of public hospitals: a multistage data envelopment analysis in an Italian region. BMC Health Serv Res. (2021) 21(1):1281. 10.1186/s12913-021-07276-5 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 36.Yeşilyurt ME, Şahin E, Elbi MD, Kızılkaya A, Koyuncuoğlu MU, Akbaş-Yeşilyurt F. A novel method for computing single output for DEA with application in hospital efficiency. Socioecon Plann Sci. (2021) 76:100995. 10.1016/j.seps.2020.100995 [DOI] [Google Scholar]
  • 37.Yin G, Chen C, Zhuo L, He Q, Tao H. Efficiency comparison of public hospitals under different administrative affiliations in China: a pilot city case. Healthcare. (2021) 9(4):437. 10.3390/healthcare9040437 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 38.Yue J, Zhou Y, Ning J, Yin G, Wu Y, Li J, et al. Efficiency and productivity of county-level traditional Chinese medicine hospitals in Hubei province, China: a retrospective study based on 17 years of panel data. Int J Health Plann Manage. (2021) 36(4):1308–25. 10.1002/hpm.3171 [DOI] [PubMed] [Google Scholar]
  • 39.Chiu CM, Chen MS, Lin CS, Lin WY, Lang HC. Evaluating the comparative efficiency of medical centers in Taiwan: a dynamic data envelopment analysis application. BMC Health Serv Res. (2022) 22(1):435. 10.1186/s12913-022-07869-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 40.Danilov AV. Scenarios for restructuring the regional inpatient healthcare system based on efficiency indicators and specialization indices. Int J Healthc Manag. (2022) 15(3):230–7. 10.1080/20479700.2020.1870366 [DOI] [Google Scholar]
  • 41.Ghiyasi M, Soltanifar M, Sharafi H. A novel inverse DEA-R model with application in hospital efficiency. Socioecon Plann Sci. (2022) 84:101427. 10.1016/j.seps.2022.101427 [DOI] [Google Scholar]
  • 42.Guerra M, Morgan BF, Alves MCDA. Financial performance and profile of Brazilian hospitals. J Health Manag. (2022) 24(2):175–86. 10.1177/09720634221088056 [DOI] [Google Scholar]
  • 43.Yousefi Nayer M, Fazaeli AA, Hamidi Y. Hospital efficiency measurement in the west of Iran: data envelopment analysis and econometric approach. Cost Eff Resour Alloc. (2022) 20(1):5. 10.1186/s12962-022-00341-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 44.Bağcı H, Çil Koçyiğit S. Evaluating the decentralization of public hospitals in Turkey in terms of technical efficiency: data envelopment analysis and Malmquist index. Benchmarking Int. J. (2023) 30(10):4425–60. 10.1108/BIJ-03-2021-0140 [DOI] [Google Scholar]
  • 45.Dohmen P, van Ineveld M, Markus A, van der Hagen L, van de Klundert J. Does competition improve hospital performance: a DEA based evaluation from The Netherlands. Eur J Health Econ. (2023) 24(6):999–1017. 10.1007/s10198-022-01529-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 46.Farantos GI, Koutsoukis NS. The influence of SYRIZA-ANEL Greek health policies on hospital efficiency. Health Res Policy Syst. (2023) 21(1):83. 10.1186/s12961-023-01032-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 47.Hajiagha SHR, Amoozad Mahdiraji H, Hashemi SS, Garza-Reyes JA, Joshi R. Public hospitals performance measurement through a three-staged data envelopment analysis approach: evidence from an emerging economy. Cybern Syst. (2023) 54(1):1–26. 10.1080/01969722.2022.2055382 [DOI] [Google Scholar]
  • 48.Lee CC, Langdo J, Hwang D, Marques V, Hwang P. Impacts of distributors and group purchasing organizations on hospital efficiency and profitability: a bilateral data envelopment analysis model. Int Trans Oper Res. (2023) 30(1):476–502. 10.1111/itor.12957 [DOI] [Google Scholar]
  • 49.Sun M, Ye Y, Zhang G, Xue Y, Shang X. Measuring the efficiency of public hospitals: a multistage data envelopment analysis in Fujian province, China. Front Public Health. (2023) 11:1091811. 10.3389/fpubh.2023.1091811 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 50.Afonso GP, Ferreira DC, Figueira JR. A network-DEA model to evaluate the impact of quality and access on hospital performance. Ann Oper Res. (2024) 342(3):2169–99. 10.1007/s10479-023-05362-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 51.Chatterjee S, Gangopadhyay S. Determinants of hospital performance under Variable ownership pattern: a two-stage analysis. Tanzan J Health Res. (2024) 25(4):1476–90. 10.4314/thrb.v25i4.20 [DOI] [Google Scholar]
  • 52.Cinaroglu S. Efficiency effects of public hospital closures in the context of public hospital reform: a multistep efficiency analysis. Health Care Manag Sci. (2024) 27(1):88–113. 10.1007/s10729-023-09661-4 [DOI] [PubMed] [Google Scholar]
  • 53.Li X, Williams Jr D, Lawrence J, Park JM. Physician-hospital integration and hospital efficiency investigation. J Hosp Manag Health Policy. (2024) 8:8. 10.21037/jhmhp-24-10 [DOI] [Google Scholar]
  • 54.Lindaas NA, Anthun KS, Magnussen J. New public management and hospital efficiency: the case of Norwegian public hospital trusts. BMC Health Serv Res. (2024) 24(1):36. 10.1186/s12913-023-10479-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 55.Mitakos A, Mpogiatzidis P. Operational efficiency of public hospitals in Greece during the COVID-19 pandemic: a comparative analysis using DEA and AHP models. J Mark Access Health Policy. (2024) 12(4):388–402. 10.3390/jmahp12040030 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 56.Nguyen BH, Grosskopf S, Yong J, Zelenyuk V. Activity-based funding reform and the performance of public hospitals: the case of Queensland, Australia. Econ Inq. (2024) 62(4):1679–701. 10.1111/ecin.13246 [DOI] [Google Scholar]
  • 57.Wang J, Lv H, Jiang H, Ren W. The efficiency evaluation of traditional Chinese medicine hospitals by data envelopment analysis in Zhengzhou, China. Front Public Health. (2024) 12:1445766. 10.3389/fpubh.2024.1445766 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 58.Fourlopoulou A, Xenos P, Messinios G, Maniadakis N. Performance of Greek public hospitals before and after the economic recession and the pandemic: application of a novel cost Malmquist index for comparing productivity across multiple groups. Healthcare. (2025) 13(11):1253. 10.3390/healthcare13111253 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 59.Hadian SA, Rezayatmand R, Ketabi S, Shaarbafchizadeh N, Pourghaderi AR. Evaluating hospital performance with additive DEA and MPI: the isfahan university of medical science case study. BMC Health Serv Res. (2025) 25(1):5. 10.1186/s12913-024-12145-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 60.Jiang W, Lou X, Chen Q, Song L, Chen Z. Impact of pilot public hospital reform on efficiencies: a DEA analysis of county hospitals in east China, 2009–2015. Health Econ Rev. (2025) 15(1):16. 10.1186/s13561-025-00600-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 61.Liao Z, Zhou J, Yang H, Hou D. Evaluating technical efficiency and influencing factors in traditional Chinese medicine hospitals: evidence from Hebei province, China. Front Public Health. (2025) 13:1621755. 10.3389/fpubh.2025.1621755 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 62.Shen J, Hodgkin D, Perloff J. A comparative inpatient care efficiency analysis of safety-net vs. Non-safety-net hospitals: an analysis using Massachusetts inpatient claims data from 2015 to 2019. Health Care Manag Sci. (2025) 28:178–90. 10.1007/s10729-025-09704-y [DOI] [PubMed] [Google Scholar]
  • 63.Aydin N, Yurdakul G. Assessing countries’ performances against COVID-19 via WSIDEA and machine learning algorithms. Appl Soft Comput. (2020) 97:106792. 10.1016/j.asoc.2020.106792 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 64.Appiahene P, Missah YM, Najim U. Predicting bank operational efficiency using machine learning algorithm: comparative study of decision tree, random forest, and neural networks. Adv Fuzzy Syst. (2020) 2020(1):8581202. 10.1155/2020/8581202 [DOI] [Google Scholar]
  • 65.Najadat H, Al-Daher I, Alkhatib K. Performance evaluation of industrial firms using DEA and DECORATE ensemble method. Int Arab J Inf Technol. (2020) 17(5):750–7. 10.34028/iajit/17/5/8 [DOI] [Google Scholar]
  • 66.Nazari A, Mehregan M, Tehrani R. Evaluating the effectiveness of data mining techniques in credit scoring of bank customers using mathematical models: a case study of individual borrowers of Refah Kargaran bank in Zanjan province, Iran. Int J Nonlinear Anal Appl. (2020) 11(Special Issue):299–309. 10.22075/ijnaa.2020.4604 [DOI] [Google Scholar]
  • 67.Mirmozaffari M, Yazdani M, Boskabadi A, Ahady Dolatsara H, Kabirifar K, Amiri Golilarz N. A novel machine learning approach combined with optimization models for eco-efficiency evaluation. Appl Sci. (2020) 10(15):5210. 10.3390/app10155210 [DOI] [Google Scholar]
  • 68.Singpai B, Wu D. Using a DEA–AutoML approach to track SDG achievements. Sustainability. (2020) 12(23):10124. 10.3390/su122310124 [DOI] [Google Scholar]
  • 69.De La Hoz E. Assessing and classification of academic efficiency in engineering teaching programs. Full J Effic Responsib Educ Sci. (2021) 14:41–52. 10.7160/eriesj.2021.140104 [DOI] [Google Scholar]
  • 70.Hatamzad M, Pinerez GP, Casselgren J. Using slightly imbalanced binary classification to predict the efficiency of winter road maintenance. IEEE Access. (2021) 9:160048–63. 10.1109/ACCESS.2021.3131702 [DOI] [Google Scholar]
  • 71.Mirmozaffari M, Shadkam E, Khalili SM, Kabirifar K, Yazdani R, Asgari Gashteroodkhani T. A novel artificial intelligent approach: comparison of machine learning tools and algorithms based on optimization DEA Malmquist productivity index for eco-efficiency evaluation. Int J Energy Sect Manag. (2021) 15(3):523–50. 10.1108/IJESM-02-2020-0003 [DOI] [Google Scholar]
  • 72.Olanrewaju OA. Integrated index decomposition analysis-artificial neural network-data envelopment analysis (IDA-ANN-DEA): implementation guide. Energy Effic. (2021) 14(7):71. 10.1007/s12053-021-09990-9 [DOI] [Google Scholar]
  • 73.Xu Y, Park YS, Park JD. Measuring the response performance of US states against COVID-19 using an integrated DEA, CART, and logistic regression approach. Healthcare. (2021) 9(3):268. 10.3390/healthcare9030268 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 74.Zhong K, Wang Y, Pei J, Tang S, Han Z. Super efficiency SBM-DEA and neural network for performance evaluation. Inf Process Manag. (2021) 58(6):102728. 10.1016/j.ipm.2021.102728 [DOI] [Google Scholar]
  • 75.Zhu N, Zhu C, Emrouznejad A. A combined machine learning algorithms and DEA method for measuring and predicting the efficiency of Chinese manufacturing listed companies. J Manag Sci Eng. (2021) 6(4):435–48. 10.1016/j.jmse.2020.10.001 [DOI] [Google Scholar]
  • 76.Ali S, Shirazi F. A transformer-based machine learning approach for sustainable e-waste management: a comparative policy analysis between the Swiss and Canadian systems. Sustainability. (2022) 14(20):13220. 10.3390/su142013220 [DOI] [Google Scholar]
  • 77.Liu X, Cao F, Fan S. Does human capital matter for China’s green growth?—examination based on econometric model and machine learning methods. Int J Environ Res Public Health. (2022) 19(18):11347. 10.3390/ijerph191811347 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 78.Mirmozaffari M, Yazdani R, Shadkam E, Khalili SM, Mahjoob M, Boskabadi A. An integrated artificial intelligence model for efficiency assessment in pharmaceutical companies during the COVID-19 pandemic. Sustain Oper Comput. (2022) 3:156–67. 10.1016/j.susoc.2022.01.003 [DOI] [Google Scholar]
  • 79.Niu H, Zhang Z, Luo M. Evaluation and prediction of low-carbon economic efficiency in China, Japan and South Korea: based on DEA and machine learning. Int J Environ Res Public Health. (2022) 19(19):12709. 10.3390/ijerph191912709 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 80.Petridis K, Tampakoudis I, Drogalas G, Kiosses N. A support vector machine model for classification of efficiency: an application to M&A. Res Int Bus Finance. (2022) 61:101633. 10.1016/j.ribaf.2022.101633 [DOI] [Google Scholar]
  • 81.Tsaples G, Papathanasiou J, Georgiou AC. An exploratory DEA and machine learning framework for the evaluation and analysis of sustainability composite indicators in the EU. Math. (2022) 10(13):2277. 10.3390/math10132277 [DOI] [Google Scholar]
  • 82.Wahyudi S, Asrol M. Designing a supplier evaluation model in the cheese industry using hybrid method. Acad J Manuf Eng. (2022) 20(2):27–35. [Google Scholar]
  • 83.Zarrin M, Schoenfelder J, Brunner JO. Homogeneity and best practice analyses in hospital performance management: an analytical framework. Health Care Manag Sci. (2022) 25(3):406–25. 10.1007/s10729-022-09590-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 84.Zhang Z, Xiao Y, Niu H. DEA And machine learning for performance prediction. Math. (2022) 10(10):1776. 10.3390/math10101776 [DOI] [Google Scholar]
  • 85.Aparicio J, Esteve M, Kapelko M. Measuring dynamic inefficiency through machine learning techniques. Expert Syst Appl. (2023) 228:120417. 10.1016/j.eswa.2023.120417 [DOI] [Google Scholar]
  • 86.Duras T, Javed F, Månsson K, Sjölander P, Söderberg M. Using machine learning to select variables in data envelopment analysis: simulations and application using electricity distribution data. Energy Econ. (2023) 120:106621. 10.1016/j.eneco.2023.106621 [DOI] [Google Scholar]
  • 87.Rajaprasad SVS, Mukkamala R. Prediction of safety performance by using machine learning algorithms: evidence from Indian construction project sites. Int J Sustain Constr Eng Technol. (2023) 14(4):40–8. 10.30880/ijscet.2023.14.04.004 [DOI] [Google Scholar]
  • 88.Yu X, Lou W. An exploration of prediction performance based on projection pursuit regression in conjunction with data envelopment analysis: a comparison with artificial neural networks and support vector regression. Math. (2023) 11(23):4775. 10.3390/math11234775 [DOI] [Google Scholar]
  • 89.Nishtha PJ, Setia G. Performance prediction of DMUs using integrated DEA-SVR approach with imprecise data: application on Indian banks. Soft Comput. (2023) 27(9):5325–55. 10.1007/s00500-022-07739-9 [DOI] [Google Scholar]
  • 90.Bogetoft P, Ramírez-Ayerbe J, Morales DR. Counterfactual analysis and target setting in benchmarking. Eur J Oper Res. (2024) 315(3):1083–95. 10.1016/j.ejor.2024.01.005 [DOI] [Google Scholar]
  • 91.Çakır S. Best output prediction in OECD railways using DEA in conjunction with machine learning algorithms. Ann Oper Res. (2024) 335(1):59–77. 10.1007/s10479-023-05668-w [DOI] [Google Scholar]
  • 92.Chivardi C, Zamudio Sosa A. Factors influencing the technical efficiency of diabetes care at primary care level in Mexico. Health Policy Plan. (2024) 39(3):318–26. 10.1093/heapol/czad122 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 93.Khoubrane Y, Ramli NA, Khairi SSM. Performance measurement: machine learning as a complement to DEA for continuous efficiency estimation. Mal J Fund Appl Sci. (2024) 20(2):288–301. 10.11113/mjfas.v20n2.3310 [DOI] [Google Scholar]
  • 94.Omrani H, Emrouznejad A, Teplova T, Amini M. Efficiency evaluation of electricity distribution companies: integrating data envelopment analysis and machine learning for a holistic analysis. Eng Appl Artif Intell. (2024) 133:108636. 10.1016/j.engappai.2024.108636 [DOI] [Google Scholar]
  • 95.Perroni MG, Veiga CPD, Forteski E, Marconatto DAB, da Silva WV, Senff CO, et al. Integrating relative efficiency models with machine learning algorithms for performance prediction. SAGE Open. (2024) 14(2):21582440241257800. 10.1177/21582440241257800 [DOI] [Google Scholar]
  • 96.Rezaee MJ, Onari MA, Saberi M. A data-driven decision support framework for DEA target setting: an explainable AI approach. Eng Appl Artif Intell. (2024) 127:107222. 10.1016/j.engappai.2023.107222 [DOI] [Google Scholar]
  • 97.Santamato V, Tricase C, Faccilongo N, Iacoviello M, Pange J, Marengo A. Machine learning for evaluating hospital mobility: an Italian case study. Appl Sci. (2024) 14(14):6016. 10.3390/app14146016 [DOI] [Google Scholar]
  • 98.Shi Y, Zhao W. An integrated machine learning and DEA-predefined performance outcome prediction framework with high-dimensional imbalanced data. INFOR Inf Syst Oper Res. (2024) 62(1):100–29. 10.1080/03155986.2023.2168943 [DOI] [Google Scholar]
  • 99.Zofio JL, Aparicio J, Barbero J, Zabala-Iturriagagoitia JM. Benchmarking performance through efficiency analysis trees: improvement strategies for Colombian higher education institutions. Socioecon Plann Sci. (2024) 92:101845. 10.1016/j.seps.2023.101845 [DOI] [Google Scholar]
  • 100.Boubaker S, Le TD, Ngo T, Manita R. Predicting the performance of MSMEs: a hybrid DEA-machine learning approach. Ann Oper Res. (2025) 350(2):555–77. 10.1007/s10479-023-05230-8 [DOI] [Google Scholar]
  • 101.Czyżewski B, Staniszewski J, Staniszewska J, Guth M. Does increasing agricultural efficiency contribute to food security—trade-offs of value addition in crop production? Sustain Dev. (2025) 33:939–70. 10.1002/sd.70043 [DOI] [Google Scholar]
  • 102.de Oliveira MB, Pereira MA, Figueira JR. An integrated approach to hospital efficiency using machine learning and slacks-based super-efficiency evaluation. Decis Anal J. (2025) 17:100640. 10.1016/j.dajour.2025.100640 [DOI] [Google Scholar]
  • 103.Dipierro AR, De Witte K. The underlying signals of efficiency in European universities: a combined efficiency and machine learning approach. Stud High Educ. (2025) 50(6):1306–25. 10.1080/03075079.2024.2370948 [DOI] [Google Scholar]
  • 104.Guillen MD, Charles V, Aparicio J. Enhanced efficiency assessment in manufacturing: leveraging machine learning for improved performance analysis. Omega (Westport). (2025) 134:103300. 10.1016/j.omega.2025.103300 [DOI] [Google Scholar]
  • 105.He J, Lau W-Y, Ng K-H, David LD. Turning green into gold: how does green total factor productivity boost economic growth? Oecon Copernic. (2025) 16(3):921–75. 10.24136/oc.3808 [DOI] [Google Scholar]
  • 106.Joo Y. Comparative efficiency analysis of OECD health systems: fDH vs. Machine learning approaches with efficiency analysis trees (EAT and RFEAT). Cost Eff Resour Alloc. (2025) 23(1):4. 10.1186/s12962-025-00607-x [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 107.Mazandaran NF, Karimi B, Shahverdiani S. Ranking the financial inefficiency factors of companies with the combined approach of data envelopment analysis and neural network. Studia Univ Vasile Goldiș Arad Ser Științ Econ. (2025) 35(2):65–85. 10.2478/sues-2025-0008 [DOI] [Google Scholar]
  • 108.Soffan S, Bramantoro A, Alzahrani AA. Combination of machine learning and data envelopment analysis to measure the efficiency of the tax service office. PeerJ Comput Sci. (2025) 11:e2672. 10.7717/peerj-cs.2672 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 109.Sun YC, Cosgun O, Sharman R. Optimizing telehealth utilization during COVID-19: enhancing efficiency and equity through data envelopment analysis and machine learning. Oper Res. (2025) 25(4):109. 10.1007/s12351-025-00978-2 [DOI] [Google Scholar]
  • 110.Yılmaz F, Şenel İK, İnce Ö. Global efficiency assessment in COVID-19 contagion control and treatment. World Med Health Policy. (2025) 17:669–87. 10.1002/wmh3.70030 [DOI] [Google Scholar]
  • 111.Greenacre MJ. Interpreting multiple correspondence analysis. Appl Stoch Models Data Anal. (1991) 7(2):195–210. 10.1002/asm.3150070208 [DOI] [Google Scholar]
  • 112.Conduah AK, Ofoe S, Siaw-Marfo D. Data privacy in healthcare: global challenges and solutions. Digit Health. (2025) 11:20552076251343959. 10.1177/20552076251343959 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 113.Wolfe A. Institute of medicine report: crossing the quality chasm: a new health care system for the 21st century. Policy Polit Nurs Pract. (2001) 2(3):233–5. 10.1177/152715440100200312 [DOI] [Google Scholar]
  • 114.Oderkirk J, Ronchi E, Klazinga N. International comparisons of health system performance among OECD countries: opportunities and data privacy protection challenges. Health Policy. (2013) 112(1–2):9–18. 10.1016/j.healthpol.2013.06.006 [DOI] [PubMed] [Google Scholar]
  • 115.Kitchenham B. Guidelines for Performing Systematic Literature Reviews in Software Engineering (EBSE Technical Report EBSE-2007-01). Staffordshire: Keele University and Durham University; (2007). [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

The original contributions presented in the study are included in the article/Supplementary Material, further inquiries can be directed to the corresponding author.


Articles from Frontiers in Medical Technology are provided here courtesy of Frontiers Media SA

RESOURCES