To the Editor
Perioperative statistical risk stratification is widespread. Such tools inform intraoperative and postoperative care as part of the National Emergency Laparotomy Audit (NELA)1.
Patients with chronic subdural haematomas (cSDH) are often elderly with significant comorbidity2. Despite this, there is a paucity of literature pertaining to risk stratification models in this cohort3. At our centre, as part of a multidisciplinary improvement initiative (the ‘Improving Care in Elderly Neurosurgery Initiative’ (ICENI)4) (Project ID:PRN7705) we demonstrated a significant association between postoperative complications and length of stay2. As a further analysis within this cohort of operated cSDH, we explore the potential of using retrospective electronic health record (EHR) data to generate prognostic statistical models for the identification of two end-organ complications (myocardial injury –troponin above the upper limit of normal and acute kidney injury (AKI) –a rise in serum creatinine of ≥ 1.5 times baseline). Outcomes were chosen based on data availability and veracity as well as clinical relevance. The integrated nature of our EHR permitted incorporation of variables reflecting intraoperative management. This enabled an exploratory analysis of models that, analogous to NELA, could be used preoperatively and updated postoperatively.
Logistic regression models were built using variables available prior to (age, American society of Anesthesiologists (ASA) score, creatinine, antithrombotic use, inter-hospital transfer, pre-operative physiological state, and comorbidities), and end of (opioid dose, length of wait, time with mean arterial pressure, (MAP) <80mmHg, time with end tidal carbon dioxide (ETCO2) outside of 3-5kPa, and volatile v intravenous anaesthetic maintenance), surgery. Physiological state was encapsulated on each admission day using the electronic postoperative morbidity score (ePOMS)5(details in supplemental digital content). Full details of variable generation are published elsewhere2. Missing data was handled by multiple imputation6. This was used in two ways. Firstly, m=40 imputed datasets were formed to permit univariable screening (carrying forward all with p <0.2) and sequential simplification of the multivariable model using pooled likelihood ratio tests (LRT). These models were subsequently internally validated using k-fold (k=10) cross-validation using a ‘fold then impute’ strategy to minimise bias7. Model building and LRT results are in Supplemental Digital Content. All analysis was conducted in R v3.5.38.
This study utilised a previously identified, retrospective cohort of 531 consecutive cases of primary operation for cSDH between October 2014 and January 2019, with appropriate outcome data2. 53 individuals suffered myocardial injury, 24 AKI. 69 had at least one ‘end-organ’ complication. After multivariable model building (See Supplemental Digital Content Figure S2) an admission model containing ASA, an indicator of tertiary transfer, anti-thrombotic use, and admissions ePOMS score was formed (Model 1 in Table 1). These were supplemented with significant day of surgery variables and the process repeated. The resulting model contained ASA, tertiary transfer, anti-thrombotic use, day of surgery ePOMS, intraoperative fentanyl dose, and time out of ETCO2 range (Model 2 in Table 1). Models yielded AUCs of 0.81(SD=0.01) and 0.85 (SD=0.01) after cross-validation (Supplemental Digital Content Figures S3 and S4).
Table 1.
Final models built from admission variables (Model 1) and after the addition of intraoperative events (Model 2) for identifying end-organ complications (myocardial injury or acute kidney injury) in a cohort of n = 531 patients undergoing surgery for chronic subdural haematoma. AUC Model 1: 0.81(SD = 0.01), AUC Model 2: 0.85(SD=0.04) ASA = American Society of Anesthesiologists, AUC = Area under the receiver operator characteristic curve, ePOMS = Electronic postoperative morbidity score, ETCO2 = End tidal carbon dioxide, kPa = Kilopascals, min = minutes
| Variable | Odds Ratio [95% Confidence Interval] | p |
|---|---|---|
| Model 1: Preoperative model | ||
| ASA | 2.188 [1.351 − 3.546] | 0.002 |
| Tertiary Transfer | 0.411 [0.174 − 0.975] | 0.044 |
| Anti-thrombotic use | 3.143 [1.726 − 5.722] | <0.001 |
| Admission ePOMS (per 1 domain increase) | 1.300 [1.086 − 1.544] | 0.004 |
| Model 2: Postoperative model | ||
| ASA | 2.091 [1.242 − 3.521] | 0.006 |
| Tertiary Transfer | 0.284 [0.115 − 0.706] | 0.007 |
| Anti-thrombotic use | 3.626 [1.903 − 6.907] | <0.001 |
| Day of Surgery ePOMS (per 1 domain increase) | 1.395 [1.131 − 1.720] | 0.002 |
| Intraoperative Fentanyl (per 25mcg) | 0.839 [0.759 − 0.926] | <0.001 |
| Time outside of ETCO2 range 3-5kPa (per 10 min) | 1.325 [1.095 − 1.603] | 0.004 |
Our work, despite being a single centre study and lacking external validity, demonstrates the possibility of using routinely-collected data to generate statistical models for the identification of postoperative complications after cSDH surgery. The retrospective nature of our data and the limitations of diagnostic and operative coding in cSDH2 means we have not been able to include all potentially relevant explanatory variables (e.g. severity of cSDH). This is one of many challenges in developing prognostic models in cSDH. For instance, the apparent protective association for transferred patients reflects right censoring, due to the absence of complication data after discharge from our centre. Improved data linkage between centres is required to accurately generate models to predict complications in such patients.
Our pre-surgery model could be calculated in any centre as the increment in discriminatory performance in model 2, although statistically significant, is likely clinically unimportant. For example, the apparent protective association with fentanyl dose could be identifying a subset of patients, deemed able to tolerate higher doses by their anaesthetist. The increased odds seen with variation in ETCO2 could represent patients with low cardiac output or raised intracranial pressure (requiring hyperventilation).
Further work in larger cohorts, with appropriately linked outcome data, is required to validate our approach and build on the exploratory analysis reported here to determine clinical utility.
Supplementary Material
Acknowledgements
This research was funded, in whole or in part, by the Wellcome Trust, Grant number: 204017/Z/16/Z. A CC BY or equivalent licence is applied to the Author Accepted Manuscript (AAM) arising from this submission, in accordance with the grant’s open access conditions.
Sources of support
DJS is supported by a Wellcome Trust Clinician PhD Fellowship, overarching grant number grant:204017/Z/16/Z.
The research was supported by the National Institute for Health Research (NIHR) Brain Injury MedTech Co-operative based at Cambridge University Hospitals NHS Foundation Trust and University of Cambridge. The views expressed are those of the author(s) and not necessarily those of the NHS, NIHR or the Department of Health and Social Care.
Footnotes
Conflicts of interest:
All authors assert no conflict of interest
Previous presentation:
Elements of this work were previously presented at the SBNS/NACCS Brain Injury Day, Royal Geographical Society, London, 6th December 2019
References
- 1.National Emergency Laparotomy Audit Risk Tool. [cited 2020 Oct 22]. [Internet]. Available from: https://data.nela.org.uk/riskcalculator/
- 2.Stubbs DJ, Davies BM, Bashford T, et al. Identification of factors associated with morbidity and postoperative length of stay in surgically managed chronic subdural haematoma using electronic health records: a retrospective cohort study. BMJ Open. 2020;10:e037385. doi: 10.1136/bmjopen-2020-037385. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kwon CS, Al-Awar O, Richards O, Izu A, Lengvenis G. Predicting Prognosis of Patients with Chronic Subdural Hematoma: A New Scoring System. World Neurosurg. 2018;109:e707–14. doi: 10.1016/j.wneu.2017.10.058. [DOI] [PubMed] [Google Scholar]
- 4.The ‘Improving Care in Elderly Neurosurgery Initiative’ (ICENI) [cited 2020 Dec 4]. [Internet]. Available from: https://www.improving-care.in/neurosurgery.
- 5.Stubbs DJ, Bowen JL, Furness RC, et al. Development and Validation of an Electronic Postoperative Morbidity Score. Anesth Analg. 2019;129:935–942. doi: 10.1213/ANE.0000000000003953. [DOI] [PubMed] [Google Scholar]
- 6.Sterne JAC, White IR, Carlin JB, et al. Multiple imputation for missing data in epidemiological and clinical research: Potential and pitfalls. BMJ. 2009;339:157–60. doi: 10.1136/bmj.b2393. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Wahl S, Boulesteix AL, Zierer A, Thorand B, Avan de Wiel M. Assessment of predictive performance in incomplete data by combining internal validation and multiple imputation. BMC Med Res Methodol. 2016;16:1–18. doi: 10.1186/s12874-016-0239-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.R Core Team. R: A Language and Environment for Statistical Computing. R Foundation for Statistical Computing; Vienna, Austria: 2013. [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
