Skip to main content
Brain & Spine logoLink to Brain & Spine
letter
. 2026 Sep 21;6:107449. doi: 10.1016/j.bas.2026.107449

Letter to the editor concerning “Development and validation of a machine learning model utilizing the ACS-NSQIP database for predicting early postoperative Re-operation in lumbar microdiscectomy” by M.M. Dagli et al.

Jin Yan a,1, Yang Liu b,1, Kaiyuan Yang b, Boyan Su b,⁎
PMCID: PMC13634286  PMID: 42831084

We read with interest the article by Dagli et al. (2026), which developed a machine-learning model for 30-day re-operation following surgical-site infection (SSI) after lumbar microdiscectomy and reported an area under the receiver operating characteristic curve (AUROC) of 0.996. Rare-event prediction in spine surgery is an important and under-addressed problem, and the authors’ use of nested cross-validation, Bayesian optimisation and bootstrap confidence intervals is welcome. We are concerned, however, that the reported discrimination is almost entirely recoverable from a single postoperative variable that carries information contained in the endpoint itself.

The outcome was re-operation following postoperative SSI, yet “any postoperative SSI” was retained as a predictor and was, by a wide margin, the leading SHAP feature (their Fig. 3). Table 2 of the article allows a direct check. All 462 outcome-positive patients had an SSI, whereas 597 of 79,408 controls had an SSI. Classifying every patient with an SSI as predicted to undergo re-operation therefore yields 462 true positives, 597 false positives, 78,811 true negatives and no false negatives. This one-variable rule attains an accuracy of 0.9925, specificity 0.9925, sensitivity 1.000, positive predictive value (PPV) 0.4363, negative predictive value (NPV) 1.000 and, treating binary SSI status as the score, an AUROC of 0.9962. These values reproduce the published model almost exactly (accuracy 0.993, specificity 0.993, PPV 0.436–0.437, NPV 1.000, AUROC 0.996).

Nested cross-validation, bootstrapping and SMOTE address model tuning, uncertainty and class imbalance, respectively; none restores temporal separation between predictors and the outcome. Prognostic models should be built from information available at the time the prognosis is made (Efthimiou et al., 2024), and including variables generated afterwards constitutes timing-based label leakage (Davis et al., 2024). TRIPOD + AI, to which the authors state adherence, asks that predictors be defined together with how and when they were measured relative to the intended moment of prediction (Collins et al., 2024); this timing is not reported.

The distinction determines what the model can be used for. The Discussion proposes perioperative counselling, targeted prevention and tailored follow-up, yet postoperative SSI status is by definition unavailable before an SSI has occurred. If the intended moment of prediction is instead the point of SSI diagnosis, the relevant population is the 1059 patients who developed an SSI; within that population “any SSI” is constant, and the present analysis does not demonstrate discrimination between the 462 patients who underwent re-operation and the 597 who did not.

A leakage-free reanalysis is possible using the existing data. For a perioperative prediction target, the model could be refitted using only variables available by the end of the index operation, with cross-validated discrimination, precision–recall performance and calibration reported. For prediction at SSI diagnosis, the analysis could instead be restricted to infected patients and exclude variables downstream of that point. Either analysis would offer a clinically interpretable contribution to rare-event modelling in spine surgery. Until leakage-excluded performance is reported, we would caution against interpreting an AUROC of 0.996 as evidence of a clinically deployable perioperative risk-stratification tool.

Declaration of generative AI and AI-assisted technologies in the manuscript preparation process

During the preparation of this work, the authors used OpenAI Codex solely to improve the readability and language of the manuscript. After using this tool, the authors reviewed and edited the content as needed and take full responsibility for the content of the published article.

Ethical considerations

Not applicable. This Letter reports no original research involving human participants or animals; all data discussed are contained in the published article by Dagli et al. (2026).

Author contributions

J.Y. and Y.L.: conception of the Letter, audit of the published source data, quantitative reconstruction, manuscript drafting, manuscript revision, and approval of submission. K.Y.: independent verification of the source data and calculations, methodological review, manuscript revision, and approval of submission. B.S.: supervision, critical revision of the manuscript, and approval of submission. All authors approved the final version and agree to be accountable for the work.

Data availability

No new data were generated. All values used in this Letter are taken from Tables 2 and 3 of the article by Dagli et al. (2026).

Funding

This work received no specific grant from any funding agency in the public, commercial, or not-for-profit sectors.

Declaration of competing interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

Footnotes

References

  1. Collins G.S., Moons K.G.M., Dhiman P., et al. TRIPOD+AI statement: updated guidance for reporting clinical prediction models that use regression or machine learning methods. BMJ. 2024;385 doi: 10.1136/bmj-2023-078378. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Dagli M.M., Gujral J., Wathen C.A., Ghenbot Y., Arena J.D., Golubovsky J.L., Ahmad H.S., Massaad E., Shin J., Yoon J.W., Ozturk A.K., Welch W.C. Development and validation of a machine learning model utilizing the ACS-NSQIP database for predicting early postoperative Re-operation in lumbar microdiscectomy. Brain Spine. 2026;6 doi: 10.1016/j.bas.2026.106108. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Davis S.E., Matheny M.E., Balu S., Sendak M.P. A framework for understanding label leakage in machine learning for health care. J. Am. Med. Inform. Assoc. 2024;31:274–280. doi: 10.1093/jamia/ocad178. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Efthimiou O., Seo M., Chalkou K., Debray T., Egger M., Salanti G. Developing clinical prediction models: a step-by-step guide. BMJ. 2024;386 doi: 10.1136/bmj-2023-078276. [DOI] [PMC free article] [PubMed] [Google Scholar]

Associated Data

This section collects any data citations, data availability statements, or supplementary materials included in this article.

Data Availability Statement

No new data were generated. All values used in this Letter are taken from Tables 2 and 3 of the article by Dagli et al. (2026).


Articles from Brain & Spine are provided here courtesy of Elsevier

RESOURCES