Skip to main content
PLOS Digital Health logoLink to PLOS Digital Health
. 2025 Nov 20;4(11):e0001061. doi: 10.1371/journal.pdig.0001061

Explainable machine learning model for predicting cesarean section following induction of labor: Development and external validation using real-world data

Yanan Hu 1,‡, Xin Zhang 2,‡, Valerie Slavin 3,4, Joanne Enticott 1, Emily Callander 1,5,*
Editor: Onicio Batista Leal-Neto,6
PMCID: PMC12633899  PMID: 41264549

Abstract

Induction of labor (IOL) is a common yet complex clinical procedure associated with varying risks, including cesarean section (CS). Accurate prediction models may help support more informed, personalized decision-making. This study aimed to develop and validate an explainable machine learning prediction model for CS following IOL. We used population-based administrative perinatal datasets from two Australian states (New South Wales (NSW) and Queensland) covering all births between 2016 and 2019 for model development. Temporal validation was conducted using 2020 births from NSW, and geographical validation using 2016–2018 births from Victoria. We included women with singleton, cephalic, term, live births who attempted IOL and had no prior CS. Seven models (logistic regression, random forest, gradient boosting, LightGBM, XGBoost, CatBoost, and AdaBoost) were developed with hyperparameter tuning and feature selection. Performance was assessed using the area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve, calibration plot (overall and across sociodemographic subgroups), decision curve analysis, Brier Score, and model parsimony. SHAP (SHapley Additive exPlanations) values were used to explain predictor contributions. A total of 180,700 women were included in model development (mean age 31 ± 5 years; CS = 20.8%). The optimal model, developed using XGBoost with ten predictors, achieved AUROCs of 0.76 (95% CI: 0.75–0.77) and 0.75 (95% CI: 0.74–0.76) in temporal (n = 14,527; CS = 22.5%) and geographical (n = 14,755; CS = 19.0%) validations, respectively. The most influential predictors were nulliparity, pre-pregnancy body mass index, and maternal age, while diabetes and hypertension (pre-existing or pregnancy-related) contributed least. Women with higher predicted CS probabilities had increased inpatient costs and maternal morbidity, regardless of actual mode of birth. The final model is accessible via an interactive web application (https://csai-8ccf2690242c.herokuapp.com/). This model demonstrates strong predictive performance using routinely collected maternal factors. Further co-design and implementation research is needed before potential clinical adoption.

Author summary

An increasing number of pregnant women are having their labor induced. One key concern in this process is the potential need for a cesarean section. To support more personalized and informed decision-making, our study focuses on the first essential step: developing and validating machine learning models that predict the likelihood of cesarean section using routinely collected information available before induction. Leveraging large-scale, real-world data from Australian maternity care, our final model demonstrated strong predictive performance and was designed to be transparent and explainable. We have deployed the best-performing model as a publicly accessible, user-friendly web application (https://csai-8ccf2690242c.herokuapp.com/). This tool provides an individualized prediction and establishes a foundation for future research on clinical implementation, user experience, and real-world impact. Ultimately, it may help guide early treatments, reduce unnecessary obstetric interventions, and improve the efficiency of healthcare resource use.

Introduction

As a woman’s pregnancy approaches term, decisions often need to be made by women with support from clinicians on the mode and timing of birth. This complex decision-making process involves balancing the potential benefits and harms for both women and babies of induction of labor (IOL), pre-labor cesarean section (CS), or awaiting spontaneous onset of labor. One main concern associated with IOL is the potential cascade of interventions, including the likelihood of CS [1]. While prior association studies have extensively explored the relative risks of CS after IOL, either compared with expectant management or spontaneous onset of labor, the absolute, personalized probability of CS cannot be derived from their findings. Importantly, each family brings a unique set of values, preferences, and previous experiences to pregnancy and birth, with different acceptable levels of risk.

Epidemiological studies have also identified various risk factors for CS following IOL [2–5], however, these studies did not shed light on how the presence or absence of each factor (including both risk and protective factors), known before the start of IOL, affects the absolute probability (as opposed to relative risk) of CS in a stepwise and interactive manner. Prediction models are thus needed to explore both the direction and magnitude of each predictor on the predicted probability of CS for future pregnant women.

Recent systematic reviews have identified 23 prediction models of CS following IOL, all used conventional statistical methods (logistic or Bayesian regression) [6,22]. It is necessary to perform a comparative analysis of various methods to assess their difference in performance, as interactions among multiple predictors might not be captured by a single modelling algorithm. Aside from the single modelling algorithm, most prior prediction models included predictors that may not be routinely measured in clinical practice for all women or were known during or after IOL (e.g., duration of IOL or cervical status at the start of IOL). These factors are not predictive for CS before IOL is planned, hence are less valuable for informing women and clinicians prior to planning the labor management. Moreover, most previous studies had a high or unclear methodological risk of bias and poor reporting. These limitations have undermined the reliability and applicability of current models in clinical practice [7].

Our study aimed to fill this evidence gap by developing, temporally and externally validating machine learning models predicting the probability of CS following IOL, using predictors being routinely collected and known before the start of IOL.

Methods

This study was designed and reported to align with the Transparent Reporting of a multivariable prediction model of Individual Prognosis Or Diagnosis + Artificial Intelligence (TRIPOD+AI) Statement [8].

Dataset

We utilized population-based retrospective cohorts of women who gave birth in three states: New South Wales (NSW), Queensland (QLD), and Victoria (VIC), which together account for 78% of annual births in Australia. The datasets were sourced from the Perinatal Data Collection (PDC) in each state, a statutory surveillance system covering all live births, and stillbirths of at least 20 weeks’ gestation and/or at least 400 grams in weight. Midwives and other birth attendants, using information obtained from mothers and from hospital or other records, completed notification forms for each birth, including labor type and mode of birth. CS was directly defined based on the mode of birth variable in the PDC data dictionary. The administrative perinatal datasets were linked with the hospital admitted patient dataset, which records all inpatient admissions in private and public hospitals.

Women who had singleton, cephalic, live births, at term (37+0–41+6 weeks of gestation), following attempted IOL were included. Women with a history of CS were excluded. The same eligibility criteria were applied to both training and validation datasets.

All eligible women who gave birth in NSW and QLD between 2016 and 2019 were used for model training; in NSW between January and July 2020 were used for temporal validation; in VIC between 2016 and 2018 were used for geographical external validation.

Ethics statement

The project received human research ethics approval from the New South Wales Health Service Human Research Ethics Committee (HREC) (HREC/ETH00684/2020.11) on 22 December 2020, and the Australian Institute of Health and Welfare Ethics Committee (EO2020/4/1167) on 29 March 2021. We also received Public Health Act Approval (PHA 20–00684) on 26 February 2021 for a waiver of consent for data collection. No identifiable patient information was provided to the research team.

Handling of missing data

Due to the small proportion of missing data (< 3%) in some candidate predictors and complete data for the outcome (CS), no data imputation was conducted as recommended in the current literature [9,10]. Instead, missing values were grouped as ‘unknown’ for categorical variables or assigned an unrealistic outlier value of 99 for continuous variables. Continuous variables were not categorized to avoid potential loss of information. This approach allowed the model to recognize missingness as potentially informative, while maintaining applicability in real-world settings where user inputs may also be incomplete.

Model training

Eighteen variables known before the start of IOL and available across the datasets were selected as candidate predictors. No a priori selection based on prior literature or clinical relevance was conducted, as predictor selection was data driven. These included pre-pregnancy body mass index (BMI), maternal age at time of giving birth, woman’s country of birth, rurality and socioeconomic status of woman’s usual residence, smoking status (before or after 20 weeks), gravidity, parity, diabetes (pre-existing or gestational), hypertension (pre-existing or gestational), weeks of gestation at first antenatal visit or at time of birth, total number of antenatal visits, and birthplace (private or public hospital). Detailed description of candidate predictors is available in Table A in S1 File.

We employed seven classification algorithms to develop our models (detailed in Table B in S1 File): logistic regression, random forest, gradient boosting [11], Light Gradient-Boosting Machine (LightGBM) [12], eXtreme Gradient Boosting (XGBoost) [13], Categorical Boosting (CatBoost) [14], and Adaptive Boosting (AdaBoost) [15]. Logistic regression was included as a baseline for comparison. Hyperparameter tuning (detailed in Table C in S1 File) and predictor selection were conducted within a nested cross-validation pipeline. Finally, all models were retrained using data from all included women. More details of sample size calculation and model training were available in Section A in S1 File.

Model explainability

SHapley Additive exPlanations (SHAP) beeswarm and waterfall plots were employed to explain the output of our model [16].

Model performance

Model performance was evaluated using area under the receiver operating characteristic curve (AUROC), area under the precision-recall curve (AUPRC), calibration plot (at population level and across sociodemographic subgroups), and Brier Score, with 95% confidence interval (CI) calculated based on the 2.5th and 97.5th percentiles of the 1,000 bootstrapped values.

Clinical utility

Decision curve analysis was conducted to evaluate the clinical utility of our models in comparison to default strategies of treating all or no women [17]. This analysis considers the consequences of the decisions made on the basis of our prediction model, which differs from discrimination and calibration measurement. In this context, treatment refers to any action that women or clinicians might consider to improve the health of women with a high predicted CS probability. The specific choice of different treatments is beyond the scope of this study.

Cost assignment

The cost of each public hospital service event was assigned from the average cost of the Australian Refined Diagnosis Related Group (AR-DRG) reported in the Independent Health and Aged Care Pricing Authority’s National Hospital Cost Data Collection (NHCDC) [18] and adjusted in accordance with the adjustments specified in the National Efficiency Price Determination [19]. For admissions in private hospitals, the costs were assigned based on the average cost for each AR-DRG classification identified from the Private Hospital Data Bureau Annual Reports [20]. All costs were inflated based on the Reserve Bank of Australia Inflation Calculator [21] and presented in 2023/24 Australian dollars.

Interactive figures

Interactive visualizations of all performance measurement figures were created, enabling exploration of the x and y values of each data point (e.g., sensitivity, specificity, and precision) by hovering over and filtering or highlighting specific models by clicking on model names in the legend. Recognizing that every woman may have a different risk tolerance, our models predict individualized probabilities of CS rather than making binary classifications (CS or not). Therefore, classification metrics at a single threshold are not presented. Instead, all combinations of these metrics across the full range of thresholds are made available through the interactive figures. This interactivity enhances clarity and offers a more intuitive way to engage with the underlying data.

SAS V9.4 was used for data pre-processing and Python 3.11 was used for model development, validation, and evaluation.

Table D in S1 File outlines the glossary for terms used in our study, including the technical terminologies used in the fields of medicine, statistics, and machine learning in order to be accessible for a broad readership.

Results

Table E in S1 File presents the sociodemographic and obstetric characteristics of our training (n = 180,700) and validation cohorts (temporal: n = 14,527; geographical: n = 14,755). Women included in the development dataset had a mean age of 30.7 years, a mean pre-pregnancy BMI of 26.3 kg/m2, with 67.4% born in Australia, 72.7% living in major cities, 53.6% being nulliparous, and 27.6% giving birth in a private hospital. The prevalence of pre-existing diabetes, pre-existing hypertension, gestational diabetes, gestational hypertension, and preeclampsia was 1%, 1.1%, 18.4%, 5.5%, and 2.8%, respectively.

The rate of CS was similar across the training, temporal validation, and geographical validation cohorts (20.8%, 22.5%, and 19%, respectively). The training and temporal validation cohorts shared a comparable distribution of other maternal characteristics. Our geographical validation cohort only consisted of women without any medical conditions or pregnancy complications, resulting in a slightly different distribution.

The final selected model was developed using XGBoost. Although it did not rank first for each performance metric across all datasets, it consistently achieved robust AUROC, AUPRC, and other metrics, while using the fewest predictors (n = 10) and the shortest training time (1 hour) (Fig 1 and Table F in S1 File). This balance of stable performance, parsimony, and computational efficiency enhances its practical value and real-world applicability. The AUROC achieved at 0.757 (95% CI: 0.747–0.765) and 0.747 (95% CI: 0.738–0.755) during temporal and geographical validation, respectively. In decision curve analysis, the XGBoost model had higher clinical utility than ‘treat all’ and ‘treat none’ strategies across a reasonable range of threshold probabilities between 0% and 50%. For instance, at a probability threshold of 23%, where the utility of identifying true positives is 3.4 times greater (odds ratio: 77%/23%) than the utility of avoiding unnecessary treatment for false positives, our model is equivalent to identifying 8·9% of women in the temporal cohort who may benefit from early targeted treatment (e.g., closer monitoring) while minimizing unnecessary treatment for false positives, compared to ‘treat none’ strategy where no women receive treatment.

Fig 1. Model performance comparison radar chart.

Fig 1

The top three contributors for higher CS following IOL were nulliparity, higher pre-pregnancy BMI, and older maternal age, whereas the two least contributing predictors were preeclampsia and pre-existing diabetes (Fig 2A). The calculation pathway for a randomly selected woman was displayed in Fig 2B.

Fig 2. The XGBoost model predictors’ contribution and effect in the training cohort.

Fig 2

In the temporal validation cohort, the model calibrated well across five socioeconomic subgroups (Fig 3). Maternal intrapartum inpatient costs showed a steady increase with predicted probabilities (Fig 4A), with the highest decile incurring nearly double the costs of the lowest decile ($10,341 vs $5,459). Similarly, maternal and neonatal lengths of stay exhibited an increasing trend starting from the 3rd decile (Fig 4C and 4D). In contrast, neonatal inpatient costs during the first month after birth remained relatively stable across deciles, except for the lowest decile, which was associated with lower costs (Fig 4B).

Fig 3. The XGBoost model calibration across sociodemographic subgroups in the temporal validation cohort.

Fig 3

Fig 4. Estimated costs by the XGBoost model predicted probability levels in the temporal validation cohort.

Fig 4

Distribution of predicted probabilities, composite maternal and neonatal morbidity rate, and graphical abstract are available in Figs B–D in S1 File, respectively. The web links for interactive performance figures are available in Table F in S1 File.

Discussion

Main findings

Our study developed, temporally and externally validated, and compared seven prediction models of primary CS at term following IOL, using real-world, population-based administrative perinatal datasets and machine learning algorithms. Our final selected model was developed using the XGBoost classifier with ten routinely collected predictors known before the start of IOL. Along with this superior performance, our model output was explained by quantifying and visualizing the cumulative contribution of each predictor, which gives more holistic and precise information to potential users. Additionally, associated costs were assessed to illustrate the potential cost savings of targeted preventive treatments from the health system perspective. Maternal and neonatal morbidity rates were also evaluated across predicted probability groups, highlighting the association between higher predicted probability and an increased likelihood of adverse outcomes, irrespective of the ultimate actual mode of birth.

The best-performing model was presented as a web application (Fig E in S1 File), named the Caesarean Section After Induction (CSAI) tool––a user-friendly, interactive, and dynamic online calculator––outlining the calculation pathway for each personalized probability (accessible at: https://csai-8ccf2690242c.herokuapp.com/). S2 File provides a video to demonstrate how potential users can interact with the web application.

Strengths and limitations

By encompassing all births from all clinical settings, the data reflect the heterogeneity in clinical practice of IOL. Meanwhile, we utilized SHAP plots to provide explainable visualizations of how individual predictor contributes to the final predicted probability of CS, enabling women and clinicians to understand the calculation pathway, thereby enhancing women-specific treatment planning and decision-making. Another strength is our open-source data dictionary, code, and trained models, ensuring transparency and facilitating future research on various topics (e.g., external validation and clinical impact). The models were both temporally and geographically validated using large, heterogeneous, and more recent datasets, proving their robustness and generalizability. Notwithstanding, both the training and validation datasets were collected in Australia, which has a universal health care system. As such, the generalizability to other settings may be restricted, particularly in countries with different structures of health care systems (e.g., the United States and low-resource settings). Moreover, although women’s region of birth was included as a predictor, it may obscure more granular socioeconomic and health-related characteristics, such as education level, income, health literacy, cultural or religious practices, and access to care, which could further affect the generalizability of the model.

Our study is also prone to some inherent limitations of historical data. For instance, we proxied the timing of IOL using the weeks of gestation at birth. Whilst a small fraction of women experienced a slow IOL process that lasted more than 24 hours and consequently gave birth in the next week of gestation, this is unlikely to have a substantial impact on our results. We retrospectively identified women who had gestational hypertension. Future pregnant women might develop this condition immediately preceding or during labor, even though the incidence is quite low. Finally, we were unable to include other predictors that might be routinely collected in other settings (e.g., weight gain during pregnancy or BMI at birth) given their non-availability in our dataset. However, these variables were not the most important predictors in previous models, hence, their exclusion was not expected to significantly influence our model performance.

Interpretation

In contrast to previous prediction models [6,22], our study investigated alternative modelling methods (i.e., machine learning algorithms), addressed several methodological limitations, including the insufficient sample size with the outcome of interest, selection of predictors based on univariable analysis, and inclusion of predictors being not routinely measured in clinical practice or known only during or after IOL. We also assessed model performance using comprehensive metrics, including fairness and clinical utility. It is essential to point out that only one external validation study examined the clinical utility of four previous prediction models, based on a small dataset (n = 468) [6]. The results of the decision curve should not be used to set the range of threshold probability for the model. Instead, a pre-determined, clinically reasonable range of threshold probabilities should be used to evaluate which model has the highest net benefit across that range [23]. In our case, the reasonable range of threshold probability for IOL against other labor management has not been determined, warranting future qualitative research involving clinicians and women.

Additionally, the heterogeneity of identified predictors in previous prediction models makes external validations and clinical applications challenging. To enhance transparency and facilitate future external validation, we provided a comprehensive data dictionary of our predictors, along with open-source data preprocessing, model development, validation, explanation, evaluation, and final trained models.

Our XGBoost model demonstrated superior robustness compared to most previously temporally or externally validated models, as evidenced by the minimal gap in AUROC between the development and validation cohorts (Table G in S1 File). The narrow range of the 95% CI during bootstrapping further supports our model’s low bias and optimism. This could be attributed to the comprehensive nature of our population-based dataset, which lessens selection bias and makes the findings more generalizable to the broader population.

Previously, only Rossi et al have developed and temporally validated their model based on a population-based retrospective cohort, including all live births in the United States between 2012 and 2017 [24]. The AUROC of this model slightly declined from 0.787 in development to 0.780 during temporal validation. Owing to the absence of maternal weight at birth in our datasets, external validation of this model was not feasible. Among all previous prediction models, the model developed by Danilack et al in 2020 has the best discriminative ability, achieving an AUROC of 0.82, 95% CI: 0.79–0.86 on the external cohort [25]. However, the external cohort was a hospital not included in the development cohort, rather than an independent dataset.

Top predictors contributing to a higher probability of CS following IOL in our XGBoost model align with previous models: nulliparity, older maternal age, higher BMI, and later gestational age [6,22]. Of note, in our XGBoost model, both pre-existing and pregnancy-developed diabetes and hypertension are of relatively low contribution. This is likely attributable to their correlation with other key demographic factors, such as BMI, maternal age, and region of birth, which are included in our model and exhibit greater predictive magnitude. This finding is consistent with a previous model [26].

The development and validation of prediction models is just the initial step and needs to be followed by a number of essential procedures before being adopted and implemented into clinical practice. Thus, prospective clinical impact studies, ideally randomized controlled trials, comparing the integration of our CS prediction models into routine maternal care to labor management without the prediction model, were recommended to determine the readiness of our CS prediction models before supporting women’s care [27]. Health outcomes, clinical usefulness, cost-effectiveness, and women’s experience and satisfaction are all vital outcomes to be measured. For instance, despite the model developed by Levine 2018 [28] having methodological limitations (selected predictors based on univariable analysis and used modified Bishop score as a predictor, which cannot be known early enough before the start of IOL to support decision-making or planning), it has been implemented as a standard of care at one urban academic hospital in the United States. The findings of the implementation reported lower rates of maternal morbidity and CS, and improved women’s perception of the quality of care received, without compromising neonatal outcomes [29].

Nonetheless, several challenges remain for the successful clinical implementation of machine learning–based decision support tools [30]. Foremost among these are the limited explainability and transparency of complex algorithms, which constrain trust among both clinicians and women. In addition, the absence of standardized frameworks for evaluating algorithmic bias, fairness, and explainability continues to impede widespread adoption. Integrating prediction models into existing electronic health record (EHR) systems presents further challenges, including compatibility with diverse data infrastructures and secure data exchange. Collectively, these barriers highlight the immaturity of current methodological and implementation science in this domain. Addressing them will require sustained interdisciplinary collaboration encompassing technical innovation, rigorous evaluation, user-centered co-design, ethical and regulatory governance, and policy development, before such models, including ours, can be deployed at scale in a reliable and responsible manner.

Conclusions

The CSAI prediction tool, using ten routinely collected maternal characteristics, offers objective, individualized, equitable, and explainable probability of CS following IOL. With further co-design and implementation research, it could be used to guide early treatments towards women at high predicted probability, potentially averting unnecessary obstetric interventions and improving the efficiency of healthcare resource use.

Supporting information

S1 File. Supplemental material.

(DOCX)

pdig.0001061.s001.docx (1.5MB, docx)
S2 File. Demo video.

(MP4)

Download video file (2.7MB, mp4)

Acknowledgments

The authors acknowledge the following: New South Wales (NSW) Ministry of Health as the source for the NSW Perinatal and NSW Admitted Patients Data Collections; and the Centre for Health Record Linkage (CHeReL) for the provision of data linkage. Queensland Health as the source for the Queensland Perinatal Data Collections; and the Statistical Analysis and Linkage Unit (Queensland Health) for the provision of data linkage. Consultative Councils Unit and the Consultative Council on Obstetric and Paediatric Mortality and Morbidity (CCOPMM) as the source for the Victorian Perinatal Data Collection; and the Centre for Victorian Data Linkage (Victorian Department of Health) for the provision of data linkage. We are grateful to CCOPMM for providing access to the data used for this project and for the assistance of the staff at Safer Care Victoria. The conclusions, findings, opinions, and views or recommendations expressed in this paper are strictly those of the author(s). They do not necessarily reflect those of CCOPMM.

Data Availability

De-identified data from this study cannot be shared publicly due to the ethics restrictions imposed by the Research Ethics Committee and the data are owned by third-party organizations. Requests for access to the individual-level data may be made directly to the respective data custodians with appropriate ethics and relevant approvals (please visit: https://www.health.qld.gov.au/hsu/how-to-access-data-from-ssb (Queensland Data Request), https://vahi.vic.gov.au/ourwork/data-linkage/apply (Victorian Data Request), and https://www.cherel.org.au/our-services (New South Wales Data Request)). Detailed codes for data preprocessing, model development and validation, final trained models, web application development, and perinatal data collection manuals are available at https://github.com/Yanan-Hu/CSAI.

Funding Statement

YH receives support from the Australian Government Research Training Program (RTP) Scholarship. The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Hu Y, Homer CSE, Ellwood D, Slavin V, Vogel JP, Enticott J, et al. Likelihood of primary cesarean section following induction of labor in singleton cephalic pregnancies at term, compared with expectant management: An Australian population-based, historical cohort study. Acta Obstet Gynecol Scand. 2024;103(5):946–54. doi: 10.1111/aogs.14785 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 2.Tarimo CS, Mahande MJ, Obure J. Prevalence and risk factors for caesarean delivery following labor induction at a tertiary hospital in North Tanzania: a retrospective cohort study (2000-2015). BMC Pregnancy Childbirth. 2020;20(1):173. doi: 10.1186/s12884-020-02861-8 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 3.Batinelli L, Serafini A, Nante N, Petraglia F, Severi FM, Messina G. Induction of labour: clinical predictive factors for success and failure. J Obstet Gynaecol. 2018;38(3):352–8. doi: 10.1080/01443615.2017.1361388 [DOI] [PubMed] [Google Scholar]
  • 4.Jeong Y, Choo SP, Yun J, Kim EH. Effect of maternal age on maternal and perinatal outcomes including cesarean delivery following induction of labor in uncomplicated elderly primigravidae. Medicine (Baltimore). 2021;100(34):e27063. doi: 10.1097/MD.0000000000027063 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.Bjorklund J, Wiberg-Itzel E, Wallstrom T. Is there an increased risk of cesarean section in obese women after induction of labor? A retrospective cohort study. PLoS One. 2022;17(2):e0263685. doi: 10.1371/journal.pone.0263685 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 6.López-Jiménez N, García-Sánchez F, Hernández-Pailos R, Rodrigo-Álvaro V, Pascual-Pedreño A, Moreno-Cid M, et al. Risk of caesarean delivery in labour induction: a systematic review and external validation of predictive models. BJOG. 2022;129(5):685–95. doi: 10.1111/1471-0528.16947 [DOI] [PubMed] [Google Scholar]
  • 7.Efthimiou O, Seo M, Chalkou K, Debray T, Egger M, Salanti G. Developing clinical prediction models: a step-by-step guide. BMJ. 2024;386:e078276. doi: 10.1136/bmj-2023-078276 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Collins GS, Moons KGM, Dhiman P, Riley RD, Beam AL, Van Calster B, et al. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385:e078378. doi: 10.1136/bmj-2023-078378 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Sisk R, Sperrin M, Peek N, van Smeden M, Martin GP. Imputation and missing indicators for handling missing data in the development and deployment of clinical prediction models: A simulation study. Stat Methods Med Res. 2023;32(8):1461–77. doi: 10.1177/09622802231165001 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Gao S, Albu E, Stijnen P, Rademakers F, Cossey V, Debaveye Y, et al. Comparing methods for handling missing data in electronic health records for dynamic risk prediction of central-line associated bloodstream infection. arXiv preprint arXiv:250606707. 2025. [DOI] [PMC free article] [PubMed]
  • 11.Pedregosa F, Varoquaux G, Gramfort A, Michel V, Thirion B, Grisel O, et al. Scikit-learn: Machine learning in Python. J Mach Learn Res. 2011;12:2825–30. [Google Scholar]
  • 12.Ke G, Meng Q, Finley T, Wang T, Chen W, Ma W, et al. Lightgbm: A highly efficient gradient boosting decision tree. Adv Neural Inf ProcessSys. 2017;30. [Google Scholar]
  • 13.Chen T, Guestrin C, editors. Xgboost: A scalable tree boosting system. In: Proceedings of the 22nd ACM SIGKDD International Conference on Knowledge Discovery and Data Mining, 2016. [Google Scholar]
  • 14.Prokhorenkova L, Gusev G, Vorobev A, Dorogush AV, Gulin A. CatBoost: unbiased boosting with categorical features. Adv Neural Inf Proces Syst. 2018;31. [Google Scholar]
  • 15.Hastie T, Rosset S, Zhu J, Zou H. Multi-class AdaBoost. Stat Interface. 2009;2(3):349–60. doi: 10.4310/sii.2009.v2.n3.a8 [DOI] [Google Scholar]
  • 16.Lundberg SM, Lee SI. A unified approach to interpreting model predictions. Adv Neural Inf Process Syst. 2017;30. [Google Scholar]
  • 17.Vickers AJ, Elkin EB. Decision curve analysis: a novel method for evaluating prediction models. Med Decis Making. 2006;26(6):565–74. doi: 10.1177/0272989X06295361 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 18.Independent Health and Aged Care Pricing Authority IHACPA. National hospital cost data collection (NHCDC) public sector report 2019–20. 2022.
  • 19.Independent Health and Aged Care Pricing Authority (IHACPA). National Efficient Price Determination 2019–20. 2020. Contract No.: 18 November.
  • 20.Australian Government Department of Health and Aged Care. PHDB annual report 2019–20. 2020. Contract No.: 19 November.
  • 21.Reserve Bank of Australia. Inflation Calculator. 2024. Available from: https://www.rba.gov.au/calculator/financialYearDecimal.html [Google Scholar]
  • 22.Hu Y, Zhang X, Gokhale S, Slavin V, Enticott J, Callander E. Prediction models for cesarean section following induction of labor: A systematic review of methodology and reporting quality. Preprint. 2025. doi: 10.21203/rs.3.rs-7331090/v1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Vickers AJ, van Calster B, Steyerberg EW. A simple, step-by-step guide to interpreting decision curve analysis. Diagn Progn Res. 2019;3:18. doi: 10.1186/s41512-019-0064-7 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Rossi RM, Requarth E, Warshak CR, Dufendach KR, Hall ES, DeFranco EA. Risk Calculator to Predict Cesarean Delivery Among Women Undergoing Induction of Labor. Obstet Gynecol. 2020;135(3):559–68. doi: 10.1097/AOG.0000000000003696 [DOI] [PubMed] [Google Scholar]
  • 25.Danilack VA, Hutcheon JA, Triche EW, Dore DD, Muri JH, Phipps MG, et al. Development and Validation of a Risk Prediction Model for Cesarean Delivery After Labor Induction. J Womens Health (Larchmt). 2020;29(5):656–69. doi: 10.1089/jwh.2019.7822 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 26.Rossi RM, Requarth EW, Warshak CR, Dufendach K, Hall ES, DeFranco EA. Predictive Model for Failed Induction of Labor Among Obese Women. Obstet Gynecol. 2019;134(3):485–93. doi: 10.1097/AOG.0000000000003377 [DOI] [PubMed] [Google Scholar]
  • 27.Drubay D, Van Calster B, Michiels S. Development and Validation of Risk Prediction Models. In: Piantadosi S, Meinert CL, editors. Principles and Practice of Clinical Trials. Cham: Springer International Publishing; 2022. p. 2003–24. [Google Scholar]
  • 28.Levine LD, Downes KL, Parry S, Elovitz MA, Sammel MD, Srinivas SK. A validated calculator to estimate risk of cesarean after an induction of labor with an unfavorable cervix. Am J Obstet Gynecol. 2018;218(2):254.e1-254.e7. doi: 10.1016/j.ajog.2017.11.603 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 29.Hamm RF, McCoy J, Oladuja A, Bogner HR, Elovitz MA, Morales KH, et al. Maternal Morbidity and Birth Satisfaction After Implementation of a Validated Calculator to Predict Cesarean Delivery During Labor Induction. JAMA Netw Open. 2020;3(11):e2025582. doi: 10.1001/jamanetworkopen.2020.25582 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 30.Antoniadi AM, Du Y, Guendouz Y, Wei L, Mazo C, Becker BA, et al. Current Challenges and Future Opportunities for XAI in Machine Learning-Based Clinical Decision Support Systems: A Systematic Review. Appl Sci. 2021;11(11):5088. doi: 10.3390/app11115088 [DOI] [Google Scholar]
PLOS Digit Health. doi: 10.1371/journal.pdig.0001061.r001

Decision Letter 0

Onicio Leal-Neto

25 Aug 2025

-->PDIG-D-25-00438-->-->Explainable machine learning model for predicting cesarean section following induction of labor: Development and external validation using real-world data-->-->PLOS Digital Health-->--> -->-->Dear Dr. Hu,-->--> -->-->Thank you for submitting your manuscript to PLOS Digital Health. After careful consideration, we feel that it has merit but does not fully meet PLOS Digital Health's publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.-->--> -->-->Please submit your revised manuscript within 30 days Sep 24 2025 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at digitalhealth@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pdig/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.-->--> -->-->Please include the following items when submitting your revised manuscript:-->-->* A rebuttal letter that responds to each point raised by the editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers '. This file does not need to include responses to any formatting updates and technical items listed in the 'Journal Requirements' section below.-->-->* A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes '.-->-->* An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript '.-->--> -->-->If you would like to make changes to your financial disclosure, competing interests statement, or data availability statement, please make these updates within the submission form at the time of resubmission. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.-->--> -->-->We look forward to receiving your revised manuscript.-->--> -->-->Kind regards,-->--> -->-->Onicio Batista Leal-Neto-->-->Academic Editor-->-->PLOS Digital Health-->--> -->-->Onicio Leal-Neto-->-->Academic Editor-->-->PLOS Digital Health-->--> -->-->Leo Anthony Celi-->-->Editor-in-Chief-->-->PLOS Digital Health-->-->orcid.org/0000-0001-6712-6626-->--> -->--> -->-->Journal Requirements: -->--> -->-->If the reviewer comments include a recommendation to cite specific previously published works, please review and evaluate these publications to determine whether they are relevant and should be cited. There is no requirement to cite these works unless the editor has indicated otherwise. -->--> -->-->Additional Editor Comments (if provided): -->--> -->--> -->--> -->-->[Note: HTML markup is below. Please do not edit.]-->--> -->-->Reviewers' Comments: -->--> -->-->Reviewer's Responses to Questions

-->Comments to the Author

1. Does this manuscript meet PLOS Digital Health’s publication criteria ? Is the manuscript technically sound, and do the data support the conclusions? The manuscript must describe methodologically and ethically rigorous research with conclusions that are appropriately drawn based on the data presented.-->

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

-->2. Has the statistical analysis been performed appropriately and rigorously?-->

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

-->3. Have the authors made all data underlying the findings in their manuscript fully available (please refer to the Data Availability Statement at the start of the manuscript PDF file)?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception. The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.-->

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

-->4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS Digital Health does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.-->

Reviewer #1: Yes

Reviewer #2: Yes

Reviewer #3: Yes

**********

-->5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)-->

Reviewer #1: The authors set out to describe the development of a Clinical Decision Support Tool. In this endevaour the authors proceeded rigorously. As far as the predictors and generalisability of their research goes, the main hinderance would be the usage of region to mask potential socioeconomic and associated health factors. Although these factors are important to consider, they as the authors themself state obscure factors such a gestation diabetes. Their findings such as the risk contribution of nulliparous mothers aligns with previous clinical research not just modelling efforts. Prospective clinical trials will be required for validation and definition of cut-offs to the risk probabilities calculated.

Reviewer #2: Based on my comprehensive review of this manuscript on machine learning models for predicting cesarean section following induction of labor, the statistical analysis demonstrates high technical competence and methodological rigor with several notable strengths but also areas for improvement. The study's greatest strengths lie in its robust design using large, population-based datasets from three Australian states (n=180,700 for development), comprehensive comparison of seven different algorithms from logistic regression to advanced boosting methods, and excellent validation strategy incorporating both temporal (2020 data) and geographical (Victoria) external validation. The authors appropriately employed nested cross-validation with hyperparameter tuning, evaluated performance using multiple metrics (AUROC, AUPRC, calibration plots, Brier score) with proper confidence intervals via bootstrapping, and provided exceptional transparency through open-source code and models. The model's performance remained stable across validation sets (AUROC: 0.757 → 0.747), and the use of SHAP values for explainability enhances clinical interpretability. However, several areas warrant attention: the missing data handling strategy of assigning arbitrary values (99 for continuous variables) rather than principled imputation methods is methodologically suboptimal despite low missingness (<3%); the moderate class imbalance (20.8% cesarean rate) isn't explicitly addressed through appropriate techniques; and the manuscript would benefit from more detailed justification of why XGBoost was superior beyond performance metrics and better discussion of clinical implementation challenges. Additionally, while the comprehensive performance evaluation is excellent, the authors could strengthen their approach by considering interaction terms for key predictors, providing confidence intervals for SHAP values, and conducting sensitivity analyses comparing their missing data approach to proper imputation methods. Despite these areas for enhancement, the work adheres to TRIPOD+AI guidelines, addresses an important clinical question with appropriate statistical techniques, and provides a valuable, practical tool for clinical decision-making. The development of the interactive web application (CSAI tool) represents excellent translation of research into practice, though integration considerations for electronic health record systems could be better addressed. Overall, this represents high-quality research that advances the field of obstetric prediction modeling, with the suggested improvements being refinements rather than fundamental methodological concerns, supporting a recommendation for acceptance with minor revisions.

Reviewer #3: Brief description:

This paper developed and validated an explainable machine learning model to predict the likelihood of cesarean section (CS) following induction of labor (IOL) using large-scale, population-based perinatal data from Australia. They evaluate seven ML algorithms using various performance metrics, including AUROC, AUPRC, calibration plots, decision curve analysis, Brier Score, and model parsimony. Additionally, they identify key predictors using SHAP values. The key predictors include nulliparity, higher pre-pregnancy BMI, and older maternal age. Finally, they provide a public web application offering individualized predictions to support personalized decision-making of IOL.

Suggested improvements:

• Given the CS rate (~20%) and resulting class imbalance, AUROC alone may be insufficient to reflect clinical utility. Please also report F1-score, sensitivity, specificity, and confusion matrices for both temporal and geographical validations.

• According to Table S6, XGBoost is not consistently the top performer in AUROC or AUPRC across datasets. Could you please clarify the decision criteria for selecting XGBoost as the final model?

• Were predictors chosen purely because they were available in the dataset, or based on prior literature and clinical relevance? Please cite supporting references for included variables where possible.

• The manuscript should explicitly describe how the outcome (CS) was ascertained from linked datasets (e.g., CPT codes or other computable phenotypes).

• There are two different front colors used in the text.

**********

-->6. PLOS authors have the option to publish the peer review history of their article (what does this mean? ). If published, this will include your full peer review and any attached files.

Do you want your identity to be public for this peer review? If you choose “no”, your identity will remain anonymous but your review may still be made public.

For information about this choice, including consent withdrawal, please see our Privacy Policy .-->

Reviewer #1: No

Reviewer #2: Yes:  Tooba Adil

Reviewer #3: No

**********

-->--> -->-->[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]-->--> -->-->Figure resubmission: -->--> -->-->While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step. If there are other versions of figure files still present in your submission file inventory at resubmission, please replace them with the PACE-processed versions.-->--> -->-->Reproducibility: -->--> -->-->To enhance the reproducibility of your results, we recommend that authors of applicable studies deposit laboratory protocols in protocols.io, where a protocol can be assigned its own identifier (DOI) such that it can be cited independently in the future. Additionally, PLOS ONE offers an option to publish peer-reviewed clinical study protocols. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols-->

PLOS Digit Health. doi: 10.1371/journal.pdig.0001061.r003

Decision Letter 1

Onicio Leal-Neto

6 Oct 2025

Explainable machine learning model for predicting cesarean section following induction of labor: Development and external validation using real-world data

PDIG-D-25-00438R1

Dear Dr. Hu,

We're pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you'll receive an e-mail detailing the required amendments. When these have been addressed, you'll receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at https://www.editorialmanager.com/pdig/ click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. For billing related questions, please contact billing support at https://plos.my.site.com/s/.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they'll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact digitalhealth@plos.org.

Kind regards,

Onicio Batista Leal-Neto

Academic Editor

PLOS Digital Health

Additional Editor Comments (optional):

Reviewers' comments:

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File. Supplemental material.

    (DOCX)

    pdig.0001061.s001.docx (1.5MB, docx)
    S2 File. Demo video.

    (MP4)

    Download video file (2.7MB, mp4)
    Attachment

    Submitted filename: Response to Reviewers.docx

    pdig.0001061.s004.docx (456.7KB, docx)

    Data Availability Statement

    De-identified data from this study cannot be shared publicly due to the ethics restrictions imposed by the Research Ethics Committee and the data are owned by third-party organizations. Requests for access to the individual-level data may be made directly to the respective data custodians with appropriate ethics and relevant approvals (please visit: https://www.health.qld.gov.au/hsu/how-to-access-data-from-ssb (Queensland Data Request), https://vahi.vic.gov.au/ourwork/data-linkage/apply (Victorian Data Request), and https://www.cherel.org.au/our-services (New South Wales Data Request)). Detailed codes for data preprocessing, model development and validation, final trained models, web application development, and perinatal data collection manuals are available at https://github.com/Yanan-Hu/CSAI.


    Articles from PLOS Digital Health are provided here courtesy of PLOS

    RESOURCES