Skip to main content
PLOS One logoLink to PLOS One
. 2022 Jul 1;17(7):e0270916. doi: 10.1371/journal.pone.0270916

Economic impact of a machine learning-based strategy for preparation of blood products in brain tumor surgery

Thara Tunthanathip 1,*, Sakchai Sae-heng 1, Thakul Oearsakul 1, Anukoon Kaewborisutsakul 1, Chin Taweesomboonyat 1
Editor: Venkatesh Shankar Madhugiri2
PMCID: PMC9249218  PMID: 35776752

Abstract

Background

Globally, blood donation has been disturbed due to the pandemic. Consequently, the optimization of preoperative blood preparation should be a point of concern. Machine learning (ML) is one of the modern approaches that have been applied by physicians to help decision-making. The main objective of this study was to identify the cost differences of the ML-based strategy compared with other strategies in preoperative blood products preparation. A secondary objective was to compare the effectiveness indexes of blood products preparation among strategies.

Methods

The study utilized a retrospective cohort design conducted on brain tumor patients who had undergone surgery between January 2014 and December 2021. Overall data were divided into two cohorts. The first cohort was used for the development and deployment of the ML-based web application, while validation, comparison of the effectiveness indexes, and economic evaluation were performed using the second cohort. Therefore, the effectiveness indexes of blood preparation and cost difference were compared among the ML-based strategy, clinical trial-based strategy, and routine-based strategy.

Results

Over a 2-year period, the crossmatch to transfusion (C/T) ratio, transfusion probability (Tp), and transfusion index (Ti) of the ML-based strategy were 1.10, 57.0%, and 1.62, respectively, while the routine-based strategy had a C/T ratio of 4.67%, Tp of 27.9%%, and Ti of 0.79. The overall costs of blood products preparation among the ML-based strategy, clinical trial-based strategy, and routine-based strategy were 30, 061.56$, 57,313.92$, and 136,292.94$, respectively. From the cost difference between the ML-based strategy and routine-based strategy, we observed cost savings of 92,519.97$ (67.88%) for the 2-year period.

Conclusion

The ML-based strategy is one of the most effective strategies to balance the unnecessary workloads at blood banks and reduce the cost of unnecessary blood products preparation from low C/T ratio as well as high Tp and Ti. Further studies should be performed to confirm the generalizability and applicability of the ML-based strategy.

Introduction

Brain tumor surgery is one type of operation that presents the risk of intraoperative transfusions such as meningioma, suprasellar tumors, cerebellopontine angle tumors, and skull-based procedures [13]. However, the literature review showed excessive blood products preparation has been observed in neurosurgical operations, which was estimated from the high crossmatch to transfusion (C/T) ratio. Chotisukarat et al. reported a C/T ratio for brain tumor operation at 5.0 [2], while Saringcarinkul et al. reported C/T ratios for meningioma, suprasellar tumor, and cerebellopontine angle tumor operations at 4.0, 4.2, and 8.7, respectively [3]. Over-ordering of preoperative blood products preparation can lead to an unnecessarily increased workload at blood banks as well as expired blood products. Hence, several management approaches have been studied to enhance the effectiveness of blood transfusions, such as patient blood management programs for the early detection and proper management of preoperative anemia [4], optimization of hemoglobin levels for transfusion [5], and preoperative autologous donation [6].

The pandemic caused by the Coronavirus (COVID-19) has negatively affected blood donations, which have decreased globally to approximately half that of typical periods [79]. Hence, the effectiveness of the protocol for preoperative blood products preparation should be a concern in situations involving limited resources. There are several strategies used to calculate the Maximum Surgical Blood Order Schedule (MSBOS) as follows: Procedure-based guideline [10, 11], 1.5 times the transfusion index [3, 7], and routine protocol [12].

Nowadays, machine learning (ML) has been studied in clinical research to support decision-making [13, 14]. However, how machine learning is used in general practice remains a challenge [15]. For example, an ML-based screening system for COVID-19 has been developed [16, 17] and subsequently implemented in clinical practice via mobile phone [18]. Additionally, Tunthanathip et al. used a random forest algorithm to optimize cranial computed tomography in children after a traumatic brain injury via a web application [19, 20].

The economic perspective is one of the outcomes that could be evaluated by ML implications because the over-requisition of preoperative blood products preparation has been reported in prior studies, which tends to increase the burdens on blood banks, as well as the wastage of blood products and unnecessary costs. Consequently, this research aimed to identify the cost differences of the ML-based strategy compared with other strategies in preoperative blood products preparation. Besides, a secondary objective was to compare the effectiveness indexes for blood products preparation among the strategies.

Methods

Study design and study population

The study utilized a retrospective cohort design conducted on patients who had been diagnosed with a brain tumor and undergone surgery between January 2014 and December 2021 at a single-center hospital. However, patients whose medical records contained incomplete transfusion data or who received a blood transfusion before surgery were excluded. Baseline clinical characteristics, preoperative hematologic laboratories, and operational data were collected from electronic-based medical records.

Strategies for preoperative blood products preparation

In the present study, three strategies for preoperative blood products preparation were compared as follows: ML-based strategy, clinical trial-based strategy, and routine-based strategy.

ML-based strategy

The first strategy for preoperative blood products preparation was developed by the training of the ML predictive model that forecasted the number of units of blood products from several datasets.

Total data in the present study comprised two major cohorts of data that corresponded with two processes of workflow as follows: 1) Development of predictive models and deployment of the ML-based web application, and 2) validation of the web application, as shown in Fig 1.

Fig 1. Workflow of the ML-based strategy for preoperative blood preparation.

Fig 1

Abbreviations: ANN = artificial neural network, AUC = Area under the ROC curve, DT = Decision tree, GBC = gradient boosting classifier, MAE = Mean Absolute Error, ML = machine learning, NB = naïve Bayes, NPV = negative predictive value, PPV = positive predictive value, R2 = R-squared, RF = random forest, RMSE = Root Mean Squared Error, SVM = support vector machine.

The first cohort involved data from 1,267 patients diagnosed with brain tumors between January 2014 and December 2019, which was divided into a training dataset and a testing dataset using the 70:30 random splitting method. Consequently, 887 patients were included in the training dataset, while the testing dataset comprised 380 patients for intraoperative blood transfusion predictability. Details concerning the development and deployment of the ML-based web application are described in the Supplement.

The second cohort comprised data from 414 patients who had undergone brain tumor surgery between January 2020 and December 2021. Data for this cohort was used for validation of the predictive models that were built via the web application, as shown in Fig 2. The tool is simple to use by scanning the quick response (QR) code or getting the uniform resource locator (URL) on laptops or smartphones, after which the web application will be ready to use. The web application was developed and deployed for estimating the cost differences between strategies. Additionally, the results of web application validation are reported in the Supplement.

Fig 2. Screenshot of the ML-based application for preoperative blood preparation.

Fig 2

The tool is used via QR code or https://neurosxpsu.shinyapps.io/crossmatch/. To use the web application, input the new patient’s parameters and press the red bottom for the number of PRC units, then input the calculated PRC units and press the yellow bottom for the number of FFP units.

Clinical trial-based strategy

Transfusion protocol in neurosurgery varies across institutions; no standard guideline has been recommended for practice in neurosurgical operations from a prior systematic review [21]. For comparison, we referred to an analogous strategy from previous clinical trials [22, 23] that mentioned the number of packed red cell (PRC) and FFP units based on the FFP: PRC ratio of 1:1.

Routine-based strategy

A routine-based strategy based on routine crossmatch at our institute was used as a reference group for comparison. A summary of preoperative blood products preparation for each strategy is shown in Table 1. Moreover, the cost per unit of blood products preparation for comparison among strategies is presented in Table 2.

Table 1. The strategy of preoperative blood preparation.

Strategy PRC FFP
Machine learning-based strategy Number of PRC units according to web application* Number of FFP units according to web application
Clinical trial-based strategy Major operations = 2 units FFP preparation according to the FFP: PRC ratio = 1:1§
Endoscopic transsphenoidal approach = 1 unit
Minor operations = = TS
Routine-based strategy Major operations = 4 units Major operation = 4 units
Minor operationTS

* When ML application calculated the result as 0 unit of PRC, typing screening was used for preparation and safety for unexpected vigorous bleeding.

† Major operations were craniotomy, craniectomy, suboccipital and rectosigmoid approaches.

‡ Minor operations were burr hole with biopsy and ETV with biopsy.

§ Nascimento et al. [22] and Holcomb et al. [23]

Abbreviations: FFP = fresh frozen plasma, MSBOS = Maximum Surgical Blood Ordering Schedule, PRC = Packed red cell, TS = preoperative type and screen

Table 2. Cost of blood product preparation per unit.

Blood product Cost per unit, USD*
Type and screen 10.34
Packed red cells 47.58
Fresh Frozen Plasma (1U = 250ml) 34.72

* Exchange rate 1 USD = 33.77 THB. (2/12/2021)

Operational definitions of the effectiveness indexes

According to the secondary objective, a comparison of the effectiveness indexes among strategies was performed; these indexes are defined as follows: [24]

C/T ratio is defined as the number of units crossmatched/number of units transfused, with a C/T ratio of 2 or less indicating effective blood utilization [25, 26].

Transfusion probability (Tp) is defined as the total number of patients transfused/total number of patients cross-matched × 100. A Tp of 30% and above indicates effective blood usage [24, 26].

Transfusion index (Ti) is defined as the number of units transfused/number of patients cross-matched. A Ti of 0.5 or more indicates effective blood usage [2426].

Statistical analysis

Categorical factors were presented as frequencies and percentages using descriptive statistics, whereas continuous factors were performed by mean and standard deviation.

Using data from the second cohort, the comparison of cost and effectiveness indexes among strategies was analyzed. In detail, the routine-based strategy concerned the reference group, and independent t-tests were performed to compare the mean between groups. Therefore, a p-value < 0.05 was determined as statistically significant. Statistical analysis was performed using R version 4.0.5 (The R Foundation for Statistical Computing; Vienna, Austria).

The two independent means test formula was used as well as for sample size calculation [27]. From the study of Alghamdi et al. [25], a comparison of the cost difference between a prior crossmatch strategy and a new strategy reported figures of 55,560$ and 43,316$. Moreover, we defined the acceptable standard deviation for both groups at 35,000$. Therefore, the minimum total sample size needed to test the hypothesis was 387 patients.

Ethical considerations

The human research ethics committee of Faculty of Medicine, Prince of Songkla University approved this research (REC 64-477-10-1). Informed consent from patients was not required due to the nature of the retrospective study design. However, patients’ identification numbers were encoded before analysis.

Results

The patients’ baseline characteristics and preoperative laboratories for the second cohort are presented in Table 3. The mean age was 46.36 ± 17.3 years, and the majority of patients were female (57.5%). The major underlying diseases were hypertension, dyslipidemia, and diabetes mellitus. Moreover, a preoperative seizure was observed in 10.6% of cases. Of all cases, 38.2% were meningioma, while glioma and pituitary adenomas were 30.7% and 11.4%, respectively. The mean tumor diameter was 3.13 ± 0.90, whereas the mean preoperative midline shift was 0.45 ± 0.30. By operation, more than half of all surgeries involved craniotomy with tumor removal, while the endoscopic transsphenoidal approach was performed in 12.3% of cases.

Table 3. Baseline characteristics of the second cohort (2020–2021, N = 414).

Characteristics Total (%)
Sex
    Male 176 (42.5)
    Female 238 (57.5)
Mean age-year (SD) 46.36 (17.3)
Age-year
    0–15 35 (8.5)
    >15–60 299 (72.2)
    >60 80 (19.3)
Underlying disease
    Hypertension 78 (18.8)
    Dyslipidemia 62 (15.0)
    Diabetes mellitus 39 (9.4)
    Liver disease 12 (2.9)
    Renal failure 5 (1.2)
    Preoperative seizure 44 (10.6)
Preoperative current medication
    Antiplatelet 9 (2.2)
    Clexane 2 (0.5)
    Warfarin 4 (1.0)
American Society of Anesthesiologists classification
    1 1 (0.2)
    2 111 (26.8)
    3 296 (71.5)
    4 6 (1.4)
Tumor classification
    Meningioma 158 (38.2)
    Glioma 127 (30.7)
    Pituitary adenoma 47 (11.4)
    Schwannoma 28 (6.8)
    Metastasis 25 (6.0)
    Lymphoma 4 (1.0)
    Other 25 (6.0)
Mean diameter of tumor -cm (SD) 3.13 (0.9)
Mean preoperative midline shift -cm (SD) 0.45 (0.3)
Neurosurgical operation
    Craniotomy 228 (55.1)
    Craniectomy 39 (9.4)
    Suboccipital or rectosigmoid approach 53 (12.8)
    Endoscopic transsphenoidal approach 51 (12.3)
    Burr hole with biopsy 37 (8.9)
    Endoscopic third ventriculostomy with biopsy 6 (1.4)
Emergency operation 65 (15.7)
Mean body mass index- kg/m 2 24.00 (4.65)
Mean preoperative hematocrit-% 38.9 (4.64)
Mean preoperative hemoglobin- g/dL 12.84 (1.62)
Mean platelet count- x10 3 /μL 289.35 (89.71)
Mean white blood cell count- x10 3 /μL 9.88 (4.67)
Mean neutrophil /lymphocyte ratio 5.12 (7.43)
Mean partial thromboplastin time ratio 0.93 (0.13)
Mean international normalized ratio 1.02 (0.08)

Among strategies with a 2-year time period, C/T ratio, Tp, and Ti are established in Table 4. The ML-based strategy had the lowest values for all effectiveness indexes compared to other strategies, while the routine-based strategy demonstrated a high C/T ratio and Tp that were over the reference for effective blood utilization. When comparing the indexes among strategies with quarters of the period, the mean difference of all indexes between the ML-based strategy and routine-based strategy was potentially significant, as shown in Fig 3 (p<0.001). Moreover, the mean difference of the C/T ratio and Tp between the ML-based strategy and clinical trial-based strategy was statistically significant (p 0.001 and p<0.001, respectively).

Table 4. Crossmatch to transfusion ratio, transfusion probability, transfusion index of packed red cell.

Strategy Number of cases Crossmatch PRC by strategies Transfused PRC C/T ratio Tp Ti
Unit Case Unit Case
Machine learning-based strategy 414 357 200 324 114 1.10 57.0 1.62
Clinical trial-based strategy 414 691 371 324 114 2.13 30.7 0.87
Routine-based strategy 414 1514 408 324 114 4.67 27.9 0.79

Abbreviations: C/T = crossmatch to transfusion, PRC = packed red cell, S = Strategy, Tp = transfusion probability, Ti = transfusion index

Fig 3. Comparison of the effectiveness index for packed red cell preparation among strategies by quarters.

Fig 3

(A) Crossmatch to transfusion ratio, (B) transfusion probability, (C) transfusion index. Abbreviations: C/T ratio = Crossmatch to transfusion ratio, Ti = transfusion index, Tp = transfusion probability, Ref = effectiveness criteria for each index, S1 = Machine learning-based strategy, S2 = Clinical trial-based strategy, S3 = Routine-based strategy.

The cost and cost differences among strategies were calculated to estimate the economic impact. The overall costs of blood products preparation among the ML-based strategy, clinical trial-based strategy, and routine-based strategy were 3,0061.56$, 57,313.92$, and 136,292.94$, respectively. From the cost difference between the ML-based strategy and routine-based strategy, cost savings of 92,519.97$ (67.88%) were apparent when implementing the ML-based strategy instead of the routine-based strategy in the practice for the 2-year period. In addition, cost savings of 47.88% were observed when the ML-based strategy was implemented instead of the clinical trial-based strategy, as shown in Fig 4.

Fig 4. Cost and cost difference of preoperative blood product preparation among strategies.

Fig 4

Abbreviations: S1 = Machine learning-based strategy, S2 = Clinical trial-based strategy, S3 = Routine-based strategy.

Discussion

The results of the present study observed an imbalance between preoperative blood products preparation and actual utilization intraoperatively in brain tumor surgery over a 2-year period, in concordance with other research reports. Saringcarinkul et al. [2] studied the effectiveness indexes of 377 patients who had undergone neurosurgical operations and found that almost all brain tumor surgeries had C/T ratios over the effectiveness threshold, whereas Chotisukarat et al. [3] found C/T ratios for brain tumor operations ranged from 5–12 and Tp ranged from 7–20%. In routine practice, neurosurgeons typically request more units of preoperative blood products for safety in cases of unexpected bleeding intraoperatively, leading to over-preparation. The Ti is one of the effectiveness indexes for preoperative blood preparation, but this index with a cutoff value of 0.5 may be the low threshold to detect the effectiveness of blood utilization because all strategies for preoperative blood preparation had Ti over the cutoff value. The concordant results were similar to what had been shown in previous studies [2, 3].

In the pandemic era, the management of limited resources should be taken into consideration since the rate of blood donation has declined globally. Several methods have been proposed to decrease the unnecessary crossmatch in the literature. Palmer et al. [28] proposed a patient-specific blood ordering system to reduce unnecessary crossmatch; this approach had sensitivity, specificity, positive predictive value, and negative predictive value of 41%, 93%, 55%, and 89%, respectively. Lam et al. [29] studied the effectiveness of a prospective physician self-audit transfusion-monitoring system for reducing unnecessary crossmatch. Although several hospitals allow the return of PRC from the ward to the blood bank if not used for transfusion, the time wasted for cross-matched preparation and unnecessary workload should be reduced. In the present study, the ML-based strategy was observed to be an effective approach to mitigate the over-requesting of preoperative blood preparation. This strategy had the lowest C/T ratio, and the highest Tp and Ti when compared with other strategies. Because the predictability of the ML-based tool exhibited an acceptable level of performance, our results are concordant with earlier studies. Chang et al. [30] used ML with various algorithms for predicting blood transfusions in orthopedic surgery; the tool had sensitivity from 69.0–79.2%, specificity from 62.3–71.7%, and accuracy from 70.3–72.2%. Moreover, Huang et al. [31] predicted PRC transfusions in patients with pelvic fracture surgery and reported that an extreme gradient boosting algorithm enabled the best predictability with sensitivity of 93%, specificity of 97%, and accuracy of 95.1%.

In the present study, the benefits of the ML-based strategy were also assessed from the economic perspective. The significant impact of cost savings was observed when the ML-based strategy was compared to the routine-based strategy. The economic benefits were subsequently impacted by the high accuracy performance of the ML-based tool. To the best of the authors’ knowledge, the present study is the first to mention the economic impact of the ML approach for MSBOS via a web application, which is one e-health platform for simplifying usage in general practice. However, the limitations of the study should also be discussed. We used local parameters for establishing costs among strategies because we needed to reflect the economic burden from the routine-based strategy in our region. Thus, generalizability is limited. Moreover, external validation of ML in terms of economic impact should be conducted at different times and places to confirm the applicability of the tool and the economic benefits as unnecessary cost savings. In addition, the present study used the same cohort to estimate cost differences among strategies. A randomized controlled trial or prospective observational study with patients assigned to different strategies may be more reflective of the real-world situation than a retrospective study design [32, 33].

Conclusion

The ML-based strategy is an effective approach to balance the unnecessary workloads at blood banks and reduce the cost of unnecessary blood products preparation from low C/T ratio, high Tp, and high Ti. Further studies should be performed to confirm the generalizability and applicability of this strategy.

Supporting information

S1 File

(DOCX)

S1 Data

(CSV)

Data Availability

All relevant data are within the paper and its Supporting Information files.

Funding Statement

A grant was provided by the Faculty of Medicine, Prince of Songkla University. (Grant no. 64-477-10-1). The funders had no role in study design, data collection, analysis, decision to publish, or preparation of the manuscript.

References

  • 1.Kisilevsky A, Gelb AW, Bustillo M, Flexman AM. Anaemia and red blood cell transfusion in intracranial neurosurgery: a comprehensive review. Br J Anaesth. 2018;120(5):988–998. doi: 10.1016/j.bja.2017.11.108 [DOI] [PubMed] [Google Scholar]
  • 2.Chotisukarat H, Akavipat P, Sookplung P, Damrongbul K. Effectiveness index of preoperative blood preparation for elective neurosurgery at Prasat Neurological Institute. Thai J Anesthesiol. 2017;43: 232–240. [Google Scholar]
  • 3.Saringcarinkul A, Chuasuwan S. Maximum Surgical Blood Order Schedule for Elective Neurosurgery in a University Teaching Hospital in Northern Thailand. Asian J Neurosurg. 2018;13(2):329–335. doi: 10.4103/ajns.AJNS_104_16 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 4.Meybohm P, Fischer DP, Geisen C, et al. Safety and effectiveness of a Patient Blood Management (PBM) program in surgical patients—the study design for a multi-centre prospective epidemiologic non-inferiority trial. BMC Health Serv Res. 2014;14:576. doi: 10.1186/s12913-014-0576-3 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 5.McGirr A, Pavenski K, Sharma B, Cusimano MD. Blood conservation in neurosurgery: erythropoietin and autologous donation. Can J Neurol Sci. 2014;41(5):583–589. doi: 10.1017/cjn.2014.14 [DOI] [PubMed] [Google Scholar]
  • 6.Goebel U. Patient blood management in intracranial neurosurgery-do we have sufficient data to define a transfusion threshold? Comment on Br J Anaesth 2018; 120: 988–98. Br J Anaesth. 2018;121(4):974–976. doi: 10.1016/j.bja.2018.05.067 [DOI] [PubMed] [Google Scholar]
  • 7.Stanworth SJ, New HV, Apelseth TO, Brunskill S, Cardigan R, Doree C, et al. Effects of the COVID-19 pandemic on supply and use of blood for transfusion. Lancet Haematol. 2020;7(10):e756–e764. doi: 10.1016/S2352-3026(20)30186-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 8.Loua A, Kasilo OMJ, Nikiema JB, Sougo ASS, Kniazko S, Annan EA. Impact of the COVID-19 pandemic on blood supply and demand in the WHO African Region. Vox Sang. 2021;116:774–784. doi: 10.1111/vox.13071 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 9.Chandler T, Neumann-Böhme S, Sabat I, Barros PP, Brouwer W, Exel JV, et al. Blood donation in times of crisis: Early insight into the impact of COVID-19 on blood donors and their motivation to donate across European countries. Vox Sang 2021;116(10):1031–1041. doi: 10.1111/vox.13103 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 10.Mcpherson RA, Pincus MR. Guidelines for ordering blood for elective surgery also referred to as maximum surgical blood order schedule (MSBOS). In: Mcpherson RA, Pincus MR, editors. Henry’s Clinical Diagnosis and Management by Laboratory Methods 24 ed. Missouri: Elsevier, 2021. pp. 1664–1665. [Google Scholar]
  • 11.Universiti Kebangsaan Malaysia. Guidelines on Blood and Blood Components Transfusion: Maximum Surgical Blood Order Schedule (MSBOS) For Elective Surgery. [Cited 2021 Sep 28]. In: Hospital Canselor Tuanku Muhriz [Internet]. Kuala Lumpur: Hospital Canselor Tuanku Muhriz; 2021. Available from: https://hctm.ukm.my/makmal/wp-content/uploads/2020/10/2-MSBOS-ed.5.pdf [Google Scholar]
  • 12.Panichakul K, Changsam K, Chau-In W, Wongswadiwat M, Sumanont S. An appropriate use of routine cross-match of pre-operative blood preparation for elective knee and hip surgery. Srinagarind Med J. 2014;29: 423–428. [Google Scholar]
  • 13.Verdonk C, Verdonk F, Dreyfus G. How machine learning could be used in clinical practice during an epidemic. Crit Care. 2020;24(1):265. doi: 10.1186/s13054-020-02962-y [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 14.Tunthanathip T, Sae-Heng S, Oearsakul T, Sakarunchai I, Kaewborisutsakul A, Taweesomboonyat C. Machine learning applications for the prediction of surgical site infection in neurological operations. Neurosurg Focus. 2019;47(2):E7. doi: 10.3171/2019.5.FOCUS19241 [DOI] [PubMed] [Google Scholar]
  • 15.Tunthanathip T, Oearsakul T. Application of machine learning to predict the outcome of pediatric traumatic brain injury. Chin J Traumatol. 2021;24(6):350–355. doi: 10.1016/j.cjtee.2021.06.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 16.Yao Y, Sun G, Matsui T, Hakozaki Y, Waasen SV, Schiek M. Multiple vital-sign-based infection screening outperforms thermography independent of the classification algorithm. IEEE Trans Biomed Eng. 2016;63(5):1025–1033. doi: 10.1109/TBME.2015.2479716 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 17.Dagdanpurev S, Abe S, Sun G, Nishimura H, Choimaa L, Hakozaki Y, et al. A novel machine-learning-based infection screening system via 2013–2017 seasonal influenza patients’ vital signs as training datasets. J Inf Secur. 2019;78(5):409–421. doi: 10.1016/j.jinf.2019.02.008 [DOI] [PubMed] [Google Scholar]
  • 18.Colubri A, Hartley MA, Siakor M, Wolfman V, Felix A, Sesay T, et al. Machine-learning prognostic models from the 2014–16 Ebola outbreak: data-harmonization challenges, validation strategies, and mHealth applications. EClinicalMedicine 2019;11:54–64. doi: 10.1016/j.eclinm.2019.06.003 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 19.Tunthanathip T, Duangsuwan J, Wattanakitrungroj N, Tongman S, Phuenpathom N. Comparison of intracranial injury predictability between machine learning algorithms and the nomogram in pediatric traumatic brain injury. Neurosurg Focus. 2021;51(5):E7. doi: 10.3171/2021.8.FOCUS2155 [DOI] [PubMed] [Google Scholar]
  • 20.Tunthanathip T, Duangsuwan J, Wattanakitrungroj N, Tongman S, Phuenpathom N. Clinical Nomogram Predicting Intracranial Injury in Pediatric Traumatic Brain Injury. J Pediatr Neurosci. 2020;5(4):409–415. doi: 10.4103/jpn.JPN_11_20 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 21.Bagwe S, Chung LK, Lagman C, et al. Blood transfusion indications in neurosurgical patients: A systematic review. Clin Neurol Neurosurg. 2017;155:83–89. doi: 10.1016/j.clineuro.2017.02.006 [DOI] [PubMed] [Google Scholar]
  • 22.Nascimento B, Callum J, Tien H, Pinto R, Lin Y, Rizoli S. Effect of a fixed-ratio (1:1:1) transfusion protocol versus laboratory-results-guided transfusion in patients with severe trauma: a randomized feasibility trial. CMAJ. 2013;185(12):E583–E589. doi: 10.1503/cmaj.121986 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 23.Holcomb JB, Tilley BC, Baraniuk S, Fox EE, Wade CE, Podbielski JM, et al. Transfusion of plasma, platelets, and red blood cells in a 1:1:1 vs a 1:1:2 ratio and mortality in patients with severe trauma: the PROPPR randomized clinical trial. JAMA 2015;313(5):471–482. doi: 10.1001/jama.2015.12 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 24.Zewdie K, Genetu A, Mekonnen Y, Worku T, Sahlu A, Gulilalt D. Efficiency of blood utilization in elective surgical patients. BMC Health Services Research 2019;19(1):804. doi: 10.1186/s12913-019-4584-1 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 25.Alghamdi S, Gonzalez B, Howard L, Zeichner S, LaPietra A, Rosen G, et al. Reducing blood utilization by implementation of a type-and-screen transfusion policy a single-institution experience. Am J Clin Pathol 2014;141(6):892–895. doi: 10.1309/AJCPX69VENSKOTYW [DOI] [PubMed] [Google Scholar]
  • 26.Karaca B, Namdaroglu S, Arı A, Bağrıaçık N. Crossmatch to Transfusion Ratio as a New Quality Indicator in Blood Banking. J Hematol Transfus. 7(1): 1085. Available from: https://www.jscimedcentral.com/Hematology/hematology-7-1085.pdf [Google Scholar]
  • 27.Malone HE, Nicholl H, Coyne I. Fundamentals of estimating sample size. Nurse Res. 2016;23(5):21–25. doi: 10.7748/nr.23.5.21.s5 [DOI] [PubMed] [Google Scholar]
  • 28.Palmer T, Wahr JA, O’Reilly M, Greenfield ML. Reducing unnecessary cross-matching: a patient-specific blood ordering system is more accurate in predicting who will receive a blood transfusion than the maximum blood ordering system. Anesth Analg. 2003;96(2): 369–75. doi: 10.1097/00000539-200302000-00013 [DOI] [PubMed] [Google Scholar]
  • 29.Lam HT, Schweitzer SO, Petz L, Kanter MH, Bernstein DA, Brauer S, et al. Effectiveness of a prospective physician self-audit transfusion-monitoring system. Transfusion. 1997;37(6):577–584. doi: 10.1046/j.1537-2995.1997.37697335151.x [DOI] [PubMed] [Google Scholar]
  • 30.Chang CM, Hung JH, Hu YH, Lee PJ, Shen CC. Prediction of Preoperative Blood Preparation for Orthopedic Surgery Patients: A Supervised Learning Approach. Appl Sci. 2018;8(9):1559. doi: 10.3390/app8091559 [DOI] [Google Scholar]
  • 31.Huang X, Wang Y, Chen B, Huang Y, Wang X, Chen L, et al. Ability of a Machine Learning Algorithm to Predict the Need for Perioperative Red Blood Cells Transfusion in Pelvic Fracture Patients: A Multicenter Cohort Study in China. Front Med (Lausanne). 2021;8:694733. doi: 10.3389/fmed.2021.694733 [DOI] [PMC free article] [PubMed] [Google Scholar]
  • 32.Tunthanathip T, Oearsakul T. Machine Learning Approaches for Prognostication of Newly Diagnosed Glioblastoma. Int J Nutr Pharmacol Neurol Dis 2021;11:57–63. doi: 10.4103/ijnpnd.ijnpnd_93_20 [DOI] [Google Scholar]
  • 33.Taweesomboonyat C, Kaewborisutsakul A, Tunthanathip T, Saeheng S, Oearsakul T. Necessity of In-hospital Neurological Observation for Mild Traumatic Brain Injury Patients with Negative Computed Tomography Brain Scans. JHSMR 2020;28:267–274. doi: 10.31584/jhsmr.2020746 [DOI] [Google Scholar]

Decision Letter 0

Venkatesh Shankar Madhugiri

4 Apr 2022

PONE-D-22-00205Economic Impact of a Machine Learning-Based Strategy for Preparation of Blood Products in Brain Tumor SurgeryPLOS ONE

Dear Dr. Tunthanathip,

Thank you for submitting your manuscript to PLOS ONE. After careful consideration, we feel that it has merit but does not fully meet PLOS ONE’s publication criteria as it currently stands. Therefore, we invite you to submit a revised version of the manuscript that addresses the points raised during the review process.

==============================

ACADEMIC EDITOR:Please revise the manuscript in line with the reviewers' comments.

==============================

Please submit your revised manuscript by May 19 2022 11:59PM. If you will need more time than this to complete your revisions, please reply to this message or contact the journal office at plosone@plos.org. When you're ready to submit your revision, log on to https://www.editorialmanager.com/pone/ and select the 'Submissions Needing Revision' folder to locate your manuscript file.

Please include the following items when submitting your revised manuscript:

  • A rebuttal letter that responds to each point raised by the academic editor and reviewer(s). You should upload this letter as a separate file labeled 'Response to Reviewers'.

  • A marked-up copy of your manuscript that highlights changes made to the original version. You should upload this as a separate file labeled 'Revised Manuscript with Track Changes'.

  • An unmarked version of your revised paper without tracked changes. You should upload this as a separate file labeled 'Manuscript'.

If you would like to make changes to your financial disclosure, please include your updated statement in your cover letter. Guidelines for resubmitting your figure files are available below the reviewer comments at the end of this letter.

If applicable, we recommend that you deposit your laboratory protocols in protocols.io to enhance the reproducibility of your results. Protocols.io assigns your protocol its own identifier (DOI) so that it can be cited independently in the future. For instructions see: https://journals.plos.org/plosone/s/submission-guidelines#loc-laboratory-protocols. Additionally, PLOS ONE offers an option for publishing peer-reviewed Lab Protocol articles, which describe protocols hosted on protocols.io. Read more information on sharing protocols at https://plos.org/protocols?utm_medium=editorial-email&utm_source=authorletters&utm_campaign=protocols.

We look forward to receiving your revised manuscript.

Kind regards,

Venkatesh Shankar Madhugiri

Academic Editor

PLOS ONE

Journal Requirements:

When submitting your revision, we need you to address these additional requirements.

1. Please ensure that your manuscript meets PLOS ONE's style requirements, including those for file naming. The PLOS ONE style templates can be found at

https://journals.plos.org/plosone/s/file?id=wjVg/PLOSOne_formatting_sample_main_body.pdf  and

https://journals.plos.org/plosone/s/file?id=ba62/PLOSOne_formatting_sample_title_authors_affiliations.pdf

2. Please include your tables as part of your main manuscript and remove the individual files. Please note that supplementary tables (should remain/ be uploaded) as separate "supporting information" files.’

3. Please include your full ethics statement in the ‘Methods’ section of your manuscript file. In your statement, please include the full name of the IRB or ethics committee who approved or waived your study, as well as whether or not you obtained informed written or verbal consent. If consent was waived for your study, please include this information in your statement as well.

4. Thank you for stating the following financial disclosure:

“The Faculty of Medicine, Prince of Songkla University. (Grant no. 64-477-10-1)”

Please state what role the funders took in the study.  If the funders had no role, please state: "The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript."

If this statement is not correct you must amend it as needed.

Please include this amended Role of Funder statement in your cover letter; we will change the online submission form on your behalf.

5. In your Data Availability statement, you have not specified where the minimal data set underlying the results described in your manuscript can be found. PLOS defines a study's minimal data set as the underlying data used to reach the conclusions drawn in the manuscript and any additional data required to replicate the reported study findings in their entirety. All PLOS journals require that the minimal data set be made fully available. For more information about our data policy, please see http://journals.plos.org/plosone/s/data-availability.

Upon re-submitting your revised manuscript, please upload your study’s minimal underlying data set as either Supporting Information files or to a stable, public repository and include the relevant URLs, DOIs, or accession numbers within your revised cover letter. For a list of acceptable repositories, please see http://journals.plos.org/plosone/s/data-availability#loc-recommended-repositories. Any potentially identifying patient information must be fully anonymized.

Important: If there are ethical or legal restrictions to sharing your data publicly, please explain these restrictions in detail. Please see our guidelines for more information on what we consider unacceptable restrictions to publicly sharing data: http://journals.plos.org/plosone/s/data-availability#loc-unacceptable-data-access-restrictions. Note that it is not acceptable for the authors to be the sole named individuals responsible for ensuring data access.

We will update your Data Availability statement to reflect the information you provide in your cover letter.

Additional Editor Comments (if provided):

Please see reviewers comments and address the issues raised by them.

[Note: HTML markup is below. Please do not edit.]

Reviewers' comments:

Reviewer's Responses to Questions

Comments to the Author

1. Is the manuscript technically sound, and do the data support the conclusions?

The manuscript must describe a technically sound piece of scientific research with data that supports the conclusions. Experiments must have been conducted rigorously, with appropriate controls, replication, and sample sizes. The conclusions must be drawn appropriately based on the data presented.

Reviewer #1: Partly

Reviewer #2: Yes

**********

2. Has the statistical analysis been performed appropriately and rigorously?

Reviewer #1: Yes

Reviewer #2: Yes

**********

3. Have the authors made all data underlying the findings in their manuscript fully available?

The PLOS Data policy requires authors to make all data underlying the findings described in their manuscript fully available without restriction, with rare exception (please refer to the Data Availability Statement in the manuscript PDF file). The data should be provided as part of the manuscript or its supporting information, or deposited to a public repository. For example, in addition to summary statistics, the data points behind means, medians and variance measures should be available. If there are restrictions on publicly sharing data—e.g. participant privacy or use of data from a third party—those must be specified.

Reviewer #1: Yes

Reviewer #2: Yes

**********

4. Is the manuscript presented in an intelligible fashion and written in standard English?

PLOS ONE does not copyedit accepted manuscripts, so the language in submitted articles must be clear, correct, and unambiguous. Any typographical or grammatical errors should be corrected at revision, so please note any specific errors here.

Reviewer #1: Yes

Reviewer #2: Yes

**********

5. Review Comments to the Author

Please use the space provided to explain your answers to the questions above. You may also include additional comments for the author, including concerns about dual publication, research ethics, or publication ethics. (Please upload your review as an attachment if it exceeds 20,000 characters)

Reviewer #1: Economic Impact of a Machine Learning-Based Strategy for Preparation of Blood Products in Brain Tumor Surgery

The main objective of this study was to identify the cost differences of the ML-based strategy compared with other strategies in preoperative blood products preparation.

For the reader it is hardly possible to compare the strategies. No lab parameters could be found as well as no evidence-based strategies. Therefore, the different strategies must be discussed in more detail.

In some university hospitals it is allowed to take back packed red blood cells (pRBC) from the ward to the blood bank (established quality management system). This is not allowed in the US, but in Europe. Maybe you can talk with the responsible persons in your hospital. This must not be considered here.

ML is the strategy of choice and should be introduced wherever it is possible. Does it work also in catastrophes (Blackout)? Perhaps you can prepare another paper to answer this question.

Here some hints:

Introduction

References 2, 3 of blood transfusion in neurosurgery in Thailand with limited meaningfulness. See for example:

Curr Opin Anaesthesiol. 2014 Oct; 27(5): 470–473. doi: 10.1097/ACO.0000000000000109

McGirr, A, Pavenski, K, Sharma, B, Cusimano, M. Blood conservation in neurosurgery: erythropoietin and autologous donation. Can J Neurol Sci. 2014;41(5):583-589.

Meybohm, P., Fischer, D.P., Geisen, C. et al. Safety and effectiveness of a Patient Blood Management (PBM) program in surgical patients - the study design for a multi-centre prospective epidemiologic non-inferiority trial. BMC Health Serv Res 14, 576 (2014). https://doi.org/10.1186/s12913-014-0576-3

Goebel, BJA Patient blood management in intracranial neurosurgery—do we have sufficient data to define a transfusion threshold? Comment on Br J Anaesth 2018; 120: 988-98

No reference is given although it is used as supplementary data

Please, make an update of the literature

Guidelines

Reference 18, 19 are no guidelines, but clinical trials.

Clinical Neurology and Neurosurgery, Volume 155, April 2017, Pages 83-89: Evidence-based outcomes for transfusion thresholds and indications are limited.

Please, discuss the advantages and limits of your references in respect of missing guidelines.

Costs

$3,0061.56, $57,313.92, and $136,292.94

Please, correct the error and use US-$. How did you calculate the costs? Since the prices of packed red blood cells are very different in different countries, I recommend giving percentages with reference to one of the basic methods.

Conclusions are too general

The pandemic has caused a reduction in blood donation activity. Maybe this is true in Thailand, but not in other countries due to different rules to live with the pandemics.

This general conclusion is not valid. It is an assumption, but not shown with data. It seems that partly the opposite is the case.

ML-based strategy offers a way to calculate preoperative crossmatch and effectively reduce the cost of unnecessary blood products preparation via a web application.

Cross match does not mean that the pRBC are on the ward and either transfused or lost if not needed. As long as the pRBC are in the refrigerater on ward or stil in the blood depot of the blood bank the pRBC can be used also for other patients.

Please, formulate more precisely.

Reviewer #2: In these retrospective study the authors aimed to analyzed patient who received surgery from January 2014 and December 2021. Through the analysis of multiple preoperative parameters that may affect the RBC transfusion volume, they used ML algorithms to build up the artificial intelligence (AI) model to predict the accurate RBC demand quantity and compared each result with those predicted by clinicians and to evaluate the economic impact. Their results were shown that the ML methods is more accurate than clinician experience in predicting preoperative RBC transfusion, which reduce the unnecessary cost of blood preparation.

This seems a promising study, can be accepted

**********

6. PLOS authors have the option to publish the peer review history of their article (what does this mean?). If published, this will include your full peer review and any attached files.

If you choose “no”, your identity will remain anonymous but your review may still be made public.

Do you want your identity to be public for this peer review? For information about this choice, including consent withdrawal, please see our Privacy Policy.

Reviewer #1: No

Reviewer #2: No

[NOTE: If reviewer comments were submitted as an attachment file, they will be attached to this email and accessible via the submission site. Please log into your account, locate the manuscript record, and check for the action link "View Attachments". If this link does not appear, there are no attachment files.]

While revising your submission, please upload your figure files to the Preflight Analysis and Conversion Engine (PACE) digital diagnostic tool, https://pacev2.apexcovantage.com/. PACE helps ensure that figures meet PLOS requirements. To use PACE, you must first register as a user. Registration is free. Then, login and navigate to the UPLOAD tab, where you will find detailed instructions on how to use the tool. If you encounter any issues or have any questions when using PACE, please email PLOS at figures@plos.org. Please note that Supporting Information files do not need this step.

Decision Letter 1

Venkatesh Shankar Madhugiri

20 Jun 2022

Economic Impact of a Machine Learning-Based Strategy for Preparation of Blood Products in Brain Tumor Surgery

PONE-D-22-00205R1

Dear Dr. Tunthanathip

We are pleased to inform you that your manuscript has been judged scientifically suitable for publication and will be formally accepted for publication once it meets all outstanding technical requirements.

Within one week, you will receive an e-mail detailing the required amendments. When these have been addressed, you will receive a formal acceptance letter and your manuscript will be scheduled for publication.

An invoice for payment will follow shortly after the formal acceptance. To ensure an efficient process, please log into Editorial Manager at http://www.editorialmanager.com/pone/, click the 'Update My Information' link at the top of the page, and double check that your user information is up-to-date. If you have any billing related questions, please contact our Author Billing department directly at authorbilling@plos.org.

If your institution or institutions have a press office, please notify them about your upcoming paper to help maximize its impact. If they’ll be preparing press materials, please inform our press team as soon as possible -- no later than 48 hours after receiving the formal acceptance. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information, please contact onepress@plos.org.

Kind regards,

Venkatesh Shankar Madhugiri

Academic Editor

PLOS ONE

Acceptance letter

Venkatesh Shankar Madhugiri

24 Jun 2022

PONE-D-22-00205R1

Economic Impact of a Machine Learning-Based Strategy for Preparation of Blood Products in Brain Tumor Surgery

Dear Dr. Tunthanathip:

I'm pleased to inform you that your manuscript has been deemed suitable for publication in PLOS ONE. Congratulations! Your manuscript is now with our production department.

If your institution or institutions have a press office, please let them know about your upcoming paper now to help maximize its impact. If they'll be preparing press materials, please inform our press team within the next 48 hours. Your manuscript will remain under strict press embargo until 2 pm Eastern Time on the date of publication. For more information please contact onepress@plos.org.

If we can help with anything else, please email us at plosone@plos.org.

Thank you for submitting your work to PLOS ONE and supporting open access.

Kind regards,

PLOS ONE Editorial Office Staff

on behalf of

Dr. Venkatesh Shankar Madhugiri

Academic Editor

PLOS ONE

Associated Data

    This section collects any data citations, data availability statements, or supplementary materials included in this article.

    Supplementary Materials

    S1 File

    (DOCX)

    S1 Data

    (CSV)

    Attachment

    Submitted filename: Response to reviewer.docx

    Data Availability Statement

    All relevant data are within the paper and its Supporting Information files.


    Articles from PLoS ONE are provided here courtesy of PLOS

    RESOURCES