Abstract
Objective
To develop a nonenhanced CT-based radiomic signature for the differentiation of iodinated contrast extravasation from intraparenchymal haemorrhage (IPH) following mechanical thrombectomy.
Methods
Patients diagnosed with acute ischaemic stroke who underwent mechanical thrombectomy in 4 institutions from December 2017 to June 2020 were included in this retrospective study. The study population was divided into a training cohort and a validation cohort. The nonenhanced CT images taken after mechanical thrombectomy were used to extract radiomic features. The maximum relevance minimum redundancy (mRMR) algorithm was used to eliminate confounding variables. Afterwards, least absolute shrinkage and selection operator (LASSO) logistic regression was used to generate the radiomic signature. The diagnostic performance of the radiomic signature was evaluated by the area under the curve (AUC), accuracy, specificity, sensitivity, positive predictive value (PPV), and negative predictive value (NPV).
Results
A total of 166 intraparenchymal areas of hyperattenuation from 101 patients were used. The areas of hyperattenuation were randomly allocated to the training and validation cohorts at a ratio of 7:3. The AUC of the radiomic signature was 0.848 (95% confidence interval (CI) 0.780–0.917) in the training cohort and 0.826 (95% CI 0.705–0.948) in the validation cohort. The accuracy of the radiomic signature was 77.6%, with a sensitivity of 76.7%, a specificity of 78.9%, a PPV of 85.2%, and a NPV of 68.2% in the validation cohort.
Conclusions
The radiomic signature constructed based on initial post-operative nonenhanced CT after mechanical thrombectomy can effectively differentiate IPH from iodinated contrast extravasation.
Key Points
• Radiomic features were extracted from intraparenchymal areas of hyperattenuation on initial post-operative CT scans after mechanical thrombectomy.
• The nonenhanced CT-based radiomic signature can differentiate IPH from iodinated contrast extravasation early.
• The radiomic signature may help prevent unnecessary rescanning after mechanical thrombectomy, especially in cases where contrast extravasation is highly suggestive.
Keywords: Radiomics; Tomography, X-ray computed; Thrombectomy; Intracranial haemorrhage; Extravasation of diagnostic and therapeutic materials
Introduction
Mechanical thrombectomy has a high recanalisation rate for large vessel occlusion, significantly improves the functional independence of patients [1–7], and may provide the opportunity for recanalisation of patients who do not meet the strict eligibility criteria for intravenous thrombolysis [8]. However, the rate of symptomatic intracerebral haemorrhage after mechanical thrombectomy ranges from 0 to 7.7% [9]. Early haemorrhagic transformation after treatment may continue to evolve, leading to a marked deterioration in some patients [10–12]. Therefore, the early identification of intraparenchymal haemorrhage (IPH) after mechanical thrombectomy provides the possibility to limit haemorrhagic growth, which can provide significant value in the management of post-operative patients [12, 13].
Following mechanical thrombectomy, nonenhanced computed tomography (CT) scans are often performed to determine the success of therapy, especially the presence of intracerebral haemorrhage. In this case, intraparenchymal hyperattenuation on CT after mechanical thrombectomy is a common occurrence. However, it is difficult to distinguish intracerebral haemorrhage from contrast extravasation on CT because of the similar radiologic appearance of both pathologies. The contrast remains visible on imaging for 24 + h before it is cleared from circulation [14]. Therefore, the persistence of hyperattenuation on CT after 24 h can be considered haemorrhage [15]. However, patients presenting with hyperattenuation between 0 and 24 h after mechanical thrombectomy fit within a diagnostic grey area. As such, life-saving treatments such as anticoagulation or antiplatelet therapy are often delayed [16, 17].
Radiomics is a powerful method to extract key parameters from medical images and is a powerful tool for guiding diagnosis and treatment in modern medicine [18–20]. Currently, the application of radiomics in intracerebral haemorrhage is a growing field, and quantitative analysis of haematoma heterogeneity using radiomics is a feasible method [21–24]. As contrast material and blood contents have different viscosities, radiomics may be used to determine the composition of hyperattenuation on CT following mechanical thrombectomy.
This study was designed to determine the possibility of using radiomics to delineate IPH (haemorrhage alone and mixed haemorrhage and iodinated contrast material) from iodinated contrast extravasation.
Materials and methods
Patient selection
This retrospective study was approved by our institutional review board, which waived the requirement for informed consent. From December 2017 to June 2020, 257 patients with acute ischaemic stroke who underwent mechanical thrombectomy at four institutions were retrospectively enrolled, including 30 patients from The First Affiliated Hospital of Zhejiang Chinese Medical University, 55 patients from the Affiliated Jinhua Hospital, Zhejiang University School of Medicine, 114 patients from The Second Affiliated Hospital and Yuying Children’s Hospital of Wenzhou Medical University, and 58 patients from the Lishui Hospital of Zhejiang University. The inclusion criteria were as follows: (1) patients underwent nonenhanced head CT after mechanical thrombectomy; (2) initial post-operative nonenhanced head CT was performed within 1 h after mechanical thrombectomy; and (3) intraparenchymal area of hyperattenuation, which was defined as an area with an objectively higher density than the surrounding grey or white matter [25], could be seen on the initial nonenhanced head CT after mechanical thrombectomy. The exclusion criteria were as follows: (1) the follow-up time of nonenhanced head CT after mechanical thrombectomy was less than 24 h; (2) artefacts (e.g. metal artefacts or motion artefacts) [26] affected the intraparenchymal areas of hyperattenuation in CT images; and (3) patients underwent craniotomy after mechanical thrombectomy, which made it difficult to identify the intraparenchymal area of hyperattenuation.
All intraparenchymal areas of hyperattenuation of the included patients were randomly divided into training and validation cohorts (7:3). Stratified random sampling was used to keep the same proportion of IPH and iodinated contrast extravasation in both the training and validation cohorts.
Image interpretation
The intraparenchymal area of hyperattenuation was considered to represent iodinated contrast extravasation if the area of hyperattenuation was entirely or almost entirely cleared within 24–48 h after the procedure. If the area of hyperattenuation persisted or increased for more than 48 h, it was classified as IPH [25, 27]. The intraparenchymal area of hyperattenuation may remain after 24–48 h in patients with renal dysfunction [28]. According to the pharmacokinetics of iodinated contrast agents and CT imaging of intracranial haemorrhage [28–30], the hyperattenuating area of patients with renal dysfunction was considered to represent contrast extravasation if it was entirely or almost entirely cleared within 7 days after the procedure. All nonenhanced CT images were analysed by two experienced radiologists.
CT data acquisition
All images of the initial post-operative nonenhanced head CT were obtained from 7 multislice CT scanners (Aquilion ONE, Toshiba Medical Systems; Brilliance 16 or Brilliance iCT, Philips Healthcare; SOMATOM Definition AS + , SOMATOM Emotion 16 or SOMATOM Force, Siemens Healthcare; uCT 710, United Imaging Healthcare). The scanning parameters were as follows: tube voltage: SOMATOM Force 90 kVp, SOMATOM Emotion 16 130 kVp, other CT scanners 120 kVp; tube current: SOMATOM Definition AS + 226 mA, uCT 710 228 mA, Aquilion ONE 230 mA, Brilliance 16 250 mA, Brilliance iCT 400 mA, other CT scanners automatic tube current modulation; matrix size: 512 × 512; field of view (FOV): Brilliance 16 250 mm, other CT scanners FOV was adapted to the patient size; section thickness: Brilliance 16 and SOMATOM Definition AS + 6 mm, SOMATOM Emotion 16 9.6 mm, other CT scanners 5 mm; section interval: Brilliance 16 and SOMATOM Definition AS + 6 mm, SOMATOM Emotion 16 9.6 mm, other CT scanners 5 mm.
ROI segmentation
All regions of interest (ROIs) were determined using ITK-SNAP 3.6.0 [31]. One radiologist (reader A, with 6 years of experience in diagnostic neuroradiology and blinded to the ultimate diagnosis) manually segmented the images along the intraparenchymal areas of the hyperattenuation contour on each transverse section (Fig. 1). Referring to a guideline of selecting and reporting intraclass correlation coefficients (ICCs) for reliability research [32], thirty lesions were randomly selected to evaluate the intraobserver and interobserver agreement of feature extraction. The 30 lesions were re-segmented by reader A 1 month later to evaluate the intraobserver agreement. A senior radiologist (reader B, with more than 10 years of experience in diagnostic neuroradiology, also blinded to the ultimate diagnosis) re-segmented the 30 lesions to evaluate the interobserver agreement. Intraclass and interclass ICCs were used to determine the intraobserver and interobserver agreement of feature extraction. Any ICCs larger than 0.80 were considered to indicate good agreement.
Radiomic feature extraction
A total of 1316 radiomic features were extracted using the PyRadiomics module inserted in AK software (Artificial Intelligence Kit; GE Healthcare) [33]. All extracted features can be subdivided into the following classes: first order statistics, shape-based, grey level co-occurrence matrix (GLCM), grey level size zone matrix (GLSZM), grey level run length matrix (GLRLM), neighbouring grey tone difference matrix (NGTDM), and grey level dependence matrix (GLDM). A detailed description of the radiomic features can be found on the PyRadiomics documentation website (http://pyradiomics.readthedocs.io).
Radiomic model engineering
The features obtained were normalized, and the unit limit was removed. For radiomic features with high reproducibility (intraobserver and interobserver ICCs > 0.80), the maximum relevance minimum redundancy (mRMR) algorithm was used to assist in the removal of confounding factors. The extracted features were indexed in accordance with their relevance-redundancy indexes. Afterwards, the top ten features were retained. Least absolute shrinkage and selection operator (LASSO) logistic regression [34] was then applied to determine the best features to build the radiomic signature. Features with nonzero coefficients were chosen using tenfold cross-validation. The radiomics score (Rad-score) was generated by calculating the weighted sum of the features to determine the probability of haemorrhage. The radiomic signature was constructed based on the training cohort and evaluated in the validation cohort.
Statistical analysis
Statistical analyses were performed using SPSS 24.0 software and R software (version 3.5.0; www.R-project.org). The receiver operating characteristic (ROC) curve was used to determine the diagnostic performance of both cohorts. The area under the curve (AUC), accuracy, sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were then determined using the Youden index [35]. Calibration curves along with the Hosmer–Lemeshow test were used to determine the calibration of the radiomic signature [36].
Results
Demographics
A total of 166 intraparenchymal areas of hyperattenuation from 101 patients were selected for this study (Fig. 2). All the areas of hyperattenuation were randomly assigned to the training cohort (n = 117) and the validation cohort (n = 49). Of the 166 intraparenchymal areas of hyperattenuation, 64 were IPH and 102 were iodinated contrast extravasation. Of the 101 patients, 64 were males and 37 were females. The mean age of the patients was 72.0 ± 11.0 years (range 39–92 years).
Radiomic signature construction
Of the 1316 radiomic features, 981 features with intraobserver and interobserver ICCs > 0.80 were retained. Of the 981 stable radiomic features, redundant and irrelevant features were eliminated by mRMR, and 10 features were retained. The mean intraobserver and interobserver ICCs of the retained features were 0.950 (95% confidence interval (CI) 0.907–0.994) and 0.974 (95% CI 0.938–1.000), respectively. On the basis of the training cohort, the 9 most significant features were selected to build the radiomic signature by LASSO logistic regression. The equation was as follows:
The feature names and corresponding coefficients are displayed in Fig. 3. Figure 4 shows the waterfall plots of the radiomic signature to differentiate IPH from iodinated contrast extravasation. The cutoff value of radiomic signature was − 0.365.
Diagnostic ability of the radiomic signature
In the training cohort, the AUC of the radiomic signature was 0.848 (95% CI 0.780–0.917, p < 0.001). In the validation cohort, the AUC of the radiomic signature was 0.826 (95% CI 0.705–0.948, p < 0.001). Further information can be found in Table 1 and Fig. 5a and b. The calibration curve indicated a strong level of agreement between the actual and predicted diagnoses in both cohorts (Fig. 5c, d). The results of the Hosmer–Lemeshow test were not statistically significant, with a p value of 0.692 for the training cohort and 0.633 for the validation cohort.
Table 1.
AUC | 95% CI | Accuracy (%) | Sensitivity (%) | Specificity (%) | PPV (%) | NPV (%) | |
---|---|---|---|---|---|---|---|
Training cohort | 0.848 | 0.780–0.917 | 76.9% | 75.0% | 80.0% | 85.7% | 66.7% |
Validation cohort | 0.826 | 0.705–0.948 | 77.6% | 76.7% | 78.9% | 85.2% | 68.2% |
AUC area under the curve, CI confidence interval, NPV negative predictive value, PPV positive predictive value
Discussion
Intracerebral haemorrhage is a common complication following mechanical thrombectomy. IPH with a mass effect can cause clinical deterioration and greatly impair prognosis [37, 38]. The identification of IPH after mechanical thrombectomy is of great significance for the adjustment of treatment [12, 13]. In the early phase after mechanical thrombectomy, conventional CT has a limited ability to differentiate IPH from iodinated contrast extravasation [11, 39–41]. From a pathophysiological standpoint, contrast extravasation is caused by a breakdown of the blood–brain barrier [42]. The early differentiation between IPH and iodinated contrast extravasation is important for the adjustment of therapy after mechanical thrombectomy, which will determine whether anticoagulation or antiplatelet therapy should be performed as early as possible [16, 17]. Therefore, this study attempted to use radiomics to help rapidly diagnose the composition of hyperattenuation to guide further treatment.
In this study, a preliminarily constructed radiomic signature based on initial post-operative nonenhanced CT after mechanical thrombectomy to differentiate IPH from iodinated contrast extravasation was used. ROC analysis revealed that the performance of the radiomic model was high. In the training and validation cohorts, the AUCs of this radiomic signature were 0.848 and 0.826, respectively. The results indicated that there was a significant difference in heterogeneity between IPH and iodinated contrast extravasation. The selected radiomic features may be able to predict the differences between IPH and contrast extravasation on nonenhanced CT images.
Conventional CT imaging is a cornerstone of diagnostic imaging due to its ease of access. Xu et al. determined that noncontrast CT performed immediately following mechanical thrombectomy can predict parenchymal haemorrhage at 24 h with metallic hyperdensity, but this sign was only visible in some patients [41]. It is still difficult to differentiate IPH from iodinated contrast extravasation based on conventional CT. Our radiomic signature was constructed based on routine CT scans and can be used to diagnose all intraparenchymal areas of hyperattenuation, proving its versatility. Magnetic resonance imaging (MRI) is costly in both time and financial capital in terms of obtaining interpretable images [17]. However, dual-energy CT is able to reliably diagnose intracerebral haemorrhage vs. contrast extravasation [25, 27, 43]. This radiomic signature may serve as a practical solution for clinics without dual-energy CT scanners or situations where dual-energy CT examinations were not performed. The predictive result of the radiomic signature can be obtained based on the initial post-operative nonenhanced CT to prevent unnecessary rescanning, especially in cases where contrast extravasation is highly suggestive. Therefore, the use of radiomics on nonenhanced CT images to differentiate IPH from iodinated contrast extravasation can improve both the accuracy of and access to diagnostic tools.
The CT images used to construct the radiomic signature were obtained from 7 multislice CT scanners at 4 institutions, resulting in a variety of CT acquisition parameters. The use of multivendor images to evaluate artificial intelligence algorithms is advocated [44]. However, differences between scanners and between image acquisition settings limit the predictive potential of radiomic models [45–47]. The predictive ability of radiomic models may be improved by using stringent image acquisition protocols or correcting for the parameters of the scanner during data analysis [45, 47]. Therefore, further optimisation of CT acquisition parameters may improve the performance of radiomic signature–based diagnostic systems.
While the findings presented herein offer promising insight, several limitations are present. As a small study, the sample size is one issue. As this study was retrospective, follow-up CT data after mechanical thrombectomy were often insufficient. Therefore, further external validation should be performed in a prospective study with a larger cohort. Second, all ROIs in this study were manually segmented, which is an intensive process. Automatic segmentation still has a long way to go before its accuracy and reproducibility rival those of manual segmentation. Finally, the diagnostic performance of our algorithm in distinguishing contrast extravasation from IPH was not validated. The diagnostic performance of radiomic models constructed by other algorithms needs to be further studied.
In conclusion, our nonenhanced CT-based radiomic signature can effectively differentiate IPH from iodinated contrast extravasation in the early phase after mechanical thrombectomy, which may be helpful for the post-operative management of patients.
Abbreviations
- AUC
Area under the curve
- CI
Confidence interval
- CT
Computed tomography
- FOV
Field of view
- GLCM
Grey level co-occurrence matrix
- GLDM
Grey level dependence matrix
- GLRLM
Grey level run length matrix
- GLSZM
Grey level size zone matrix
- ICC
Interclass correlation coefficient
- IPH
Intraparenchymal haemorrhage
- LASSO
Least absolute shrinkage and selection operator
- MRI
Magnetic resonance imaging
- mRMR
Maximum relevance minimum redundancy
- NPV
Negative predictive value
- NGTDM
Neighbouring grey tone difference matrix
- PPV
Positive predictive value
- ROC
Receiver operating characteristic
- ROI
Region of interest
Funding
This study has received funding by the Medical Health Science and Technology Project of Zhejiang Provincial Health Commission (No. 2020KY671).
Declarations
Guarantor
The scientific guarantor of this publication is Yifan Guo.
Conflict of interest
The authors of this manuscript declare relationships with the following companies: GE Healthcare. Peipei Pang contributed to the development of radiomics models described in the study.
Statistics and biometry
One of the authors (Peipei Pang) has significant statistical expertise.
Informed consent
Written informed consent was waived by the Institutional Review Board.
Ethical approval
Institutional Review Board approval was obtained.
Methodology
• retrospective
• diagnostic or prognostic study
• multicentre study
Footnotes
Xiaojun Chen and Yuanzhe Li contributed equally to this work.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Haibo Chen, Email: 11730367@qq.com.
Yifan Guo, Email: szyygyf@163.com.
References
- 1.Berkhemer OA, Fransen PS, Beumer D, et al. A randomized trial of intraarterial treatment for acute ischemic stroke. N Engl J Med. 2015;372:11–20. doi: 10.1056/NEJMoa1411587. [DOI] [PubMed] [Google Scholar]
- 2.Lambrinos A, Schaink AK, Dhalla I, et al. Mechanical thrombectomy in acute ischemic stroke: a systematic review. Can J Neurol Sci. 2016;43:455–460. doi: 10.1017/cjn.2016.30. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Goyal M, Demchuk AM, Menon BK, et al. Randomized assessment of rapid endovascular treatment of ischemic stroke. N Engl J Med. 2015;372:1019–1030. doi: 10.1056/NEJMoa1414905. [DOI] [PubMed] [Google Scholar]
- 4.Saver JL, Goyal M, Bonafe A, et al. Stent-retriever thrombectomy after intravenous t-PA vs. t-PA alone in stroke. N Engl J Med. 2015;372:2285–2295. doi: 10.1056/NEJMoa1415061. [DOI] [PubMed] [Google Scholar]
- 5.Kang DH, Jung C, Yoon W, et al. Endovascular thrombectomy for acute basilar artery occlusion: a multicenter retrospective observational study. J Am Heart Assoc. 2018;7:e009419. doi: 10.1161/JAHA.118.009419. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Smith WS, Sung G, Starkman S, et al. Safety and efficacy of mechanical embolectomy in acute ischemic stroke: results of the MERCI trial. Stroke. 2005;36:1432–1438. doi: 10.1161/01.STR.0000171066.25248.1d. [DOI] [PubMed] [Google Scholar]
- 7.Meinel TR, Kaesmacher J, Chaloulos-Iakovidis P, et al. Mechanical thrombectomy for basilar artery occlusion: efficacy, outcomes, and futile recanalisation in comparison with the anterior circulation. J Neurointerv Surg. 2019;11:1174–1180. doi: 10.1136/neurintsurg-2018-014516. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Hao Z, Yang C, Xiang L, Wu B, Liu M. Risk factors for intracranial hemorrhage after mechanical thrombectomy: a systematic review and meta-analysis. Expert Rev Neurother. 2019;19:927–935. doi: 10.1080/14737175.2019.1632191. [DOI] [PubMed] [Google Scholar]
- 9.Munich SA, Vakharia K, Levy EI. Overview of mechanical thrombectomy techniques. Neurosurgery. 2019;85:S60–s67. doi: 10.1093/neuros/nyz071. [DOI] [PubMed] [Google Scholar]
- 10.IMS Study Investigators Combined intravenous and intra-arterial recanalisation for acute ischemic stroke: the Interventional Management of Stroke Study. Stroke. 2004;35:904–911. doi: 10.1161/01.STR.0000121641.77121.98. [DOI] [PubMed] [Google Scholar]
- 11.Jang YM, Lee DH, Kim HS, et al. The fate of high-density lesions on the non-contrast CT obtained immediately after intra-arterial thrombolysis in ischemic stroke patients. Korean J Radiol. 2006;7:221–228. doi: 10.3348/kjr.2006.7.4.221. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Anonymous Intracerebral hemorrhage after intravenous t-PA therapy for ischemic stroke. The NINDS t-PA Stroke Study Group. Stroke. 1997;28:2109–2118. doi: 10.1161/01.STR.28.11.2109. [DOI] [PubMed] [Google Scholar]
- 13.Greer DM, Koroshetz WJ, Cullen S, Gonzalez RG, Lev MH. Magnetic resonance imaging improves detection of intracerebral hemorrhage over computed tomography after intra-arterial thrombolysis. Stroke. 2004;35:491–495. doi: 10.1161/01.STR.0000114201.11353.C5. [DOI] [PubMed] [Google Scholar]
- 14.Yedavalli V, Sammet S. Contrast extravasation versus hemorrhage after thrombectomy in patients with acute stroke. J Neuroimaging. 2017;27:570–576. doi: 10.1111/jon.12446. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 15.Payabvash S, Qureshi MH, Khan SM, et al. Differentiating intraparenchymal hemorrhage from contrast extravasation on post-procedural noncontrast CT scan in acute ischemic stroke patients undergoing endovascular treatment. Neuroradiology. 2014;56:737–744. doi: 10.1007/s00234-014-1381-8. [DOI] [PubMed] [Google Scholar]
- 16.Mokin M, Kan P, Kass-Hout T, et al. Intracerebral hemorrhage secondary to intravenous and endovascular intraarterial revascularization therapies in acute ischemic stroke: an update on risk factors, predictors, and management. Neurosurg Focus. 2012;32:E2. doi: 10.3171/2012.1.FOCUS11352. [DOI] [PubMed] [Google Scholar]
- 17.Whitney E, Khan YR, Alastra A, Schiraldi M, Siddiqi J. Contrast extravasation post thrombectomy in patients with acute cerebral stroke: a review and recommendations for future studies. Cureus. 2020;12:e10616. doi: 10.7759/cureus.10616. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 18.Lambin P, Leijenaar RTH, Deist TM, et al. Radiomics: the bridge between medical imaging and personalized medicine. Nat Rev Clin Oncol. 2017;14:749–762. doi: 10.1038/nrclinonc.2017.141. [DOI] [PubMed] [Google Scholar]
- 19.Lambin P, Rios-Velazquez E, Leijenaar R, et al. Radiomics: extracting more information from medical images using advanced feature analysis. Eur J Cancer. 2012;48:441–446. doi: 10.1016/j.ejca.2011.11.036. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Gillies RJ, Kinahan PE, Hricak H. Radiomics: images are more than pictures, they are data. Radiology. 2016;278:563–577. doi: 10.1148/radiol.2015151169. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Li H, Xie Y, Wang X, Chen F, Sun J, Jiang X. Radiomics features on non-contrast computed tomography predict early enlargement of spontaneous intracerebral hemorrhage. Clin Neurol Neurosurg. 2019;185:105491. doi: 10.1016/j.clineuro.2019.105491. [DOI] [PubMed] [Google Scholar]
- 22.Zhu DQ, Chen Q, Xiang YL, et al. Predicting intraventricular hemorrhage growth with a machine learning-based, radiomics-clinical model. Aging (Albany NY) 2021;13:12833–12848. doi: 10.18632/aging.202954. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 23.Ma C, Zhang Y, Niyazi T, et al. Radiomics for predicting hematoma expansion in patients with hypertensive intraparenchymal hematomas. Eur J Radiol. 2019;115:10–15. doi: 10.1016/j.ejrad.2019.04.001. [DOI] [PubMed] [Google Scholar]
- 24.Song Z, Guo D, Tang Z, et al. Noncontrast computed tomography-based radiomics analysis in discriminating early hematoma expansion after spontaneous intracerebral hemorrhage. Korean J Radiol. 2021;22:415–424. doi: 10.3348/kjr.2020.0254. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Tijssen MP, Hofman PA, Stadler AA, et al. The role of dual energy CT in differentiating between brain haemorrhage and contrast medium after mechanical revascularisation in acute ischaemic stroke. Eur Radiol. 2014;24:834–840. doi: 10.1007/s00330-013-3073-x. [DOI] [PubMed] [Google Scholar]
- 26.Barrett JF, Keat N. Artifacts in CT: recognition and avoidance. Radiographics. 2004;24:1679–1691. doi: 10.1148/rg.246045065. [DOI] [PubMed] [Google Scholar]
- 27.Gupta R, Phan CM, Leidecker C, et al. Evaluation of dual-energy CT for differentiating intracerebral hemorrhage from iodinated contrast material staining. Radiology. 2010;257:205–211. doi: 10.1148/radiol.10091806. [DOI] [PubMed] [Google Scholar]
- 28.Bourin M, Jolliet P, Ballereau F. An overview of the clinical pharmacokinetics of x-ray contrast media. Clin Pharmacokinet. 1997;32:180–193. doi: 10.2165/00003088-199732030-00002. [DOI] [PubMed] [Google Scholar]
- 29.Lorusso V, Taroni P, Alvino S, Spinazzi A. Pharmacokinetics and safety of iomeprol in healthy volunteers and in patients with renal impairment or end-stage renal disease requiring hemodialysis. Invest Radiol. 2001;36:309–316. doi: 10.1097/00004424-200106000-00002. [DOI] [PubMed] [Google Scholar]
- 30.Kidwell CS, Wintermark M. Imaging of intracranial haemorrhage. Lancet Neurol. 2008;7:256–267. doi: 10.1016/S1474-4422(08)70041-3. [DOI] [PubMed] [Google Scholar]
- 31.Yushkevich PA, Piven J, Hazlett HC, et al. User-guided 3D active contour segmentation of anatomical structures: significantly improved efficiency and reliability. Neuroimage. 2006;31:1116–1128. doi: 10.1016/j.neuroimage.2006.01.015. [DOI] [PubMed] [Google Scholar]
- 32.Koo TK, Li MY. A guideline of selecting and reporting intraclass correlation coefficients for reliability research. J Chiropr Med. 2016;15:155–163. doi: 10.1016/j.jcm.2016.02.012. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 33.van Griethuysen JJM, Fedorov A, Parmar C, et al. Computational radiomics system to decode the radiographic phenotype. Cancer Res. 2017;77:e104–e107. doi: 10.1158/0008-5472.CAN-17-0339. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 34.Tibshirani R. Regression shrinkage and selection via the Lasso. J R Stat Soc Series B Stat Methodol. 1996;58:267–288. [Google Scholar]
- 35.Hughes G. Youden’s index and the weight of evidence. Methods Inf Med. 2015;54:198–199. doi: 10.3414/ME14-04-0003. [DOI] [PubMed] [Google Scholar]
- 36.Kramer AA, Zimmerman JE. Assessing the calibration of mortality benchmarks in critical care: the Hosmer-Lemeshow test revisited. Crit Care Med. 2007;35:2052–2056. doi: 10.1097/01.CCM.0000275267.64078.B0. [DOI] [PubMed] [Google Scholar]
- 37.Berger C, Fiorelli M, Steiner T, et al. Hemorrhagic transformation of ischemic brain tissue: asymptomatic or symptomatic? Stroke. 2001;32:1330–1335. doi: 10.1161/01.STR.32.6.1330. [DOI] [PubMed] [Google Scholar]
- 38.Paciaroni M, Agnelli G, Corea F, et al. Early hemorrhagic transformation of brain infarction: rate, predictive factors, and influence on clinical outcome: results of a prospective multicenter study. Stroke. 2008;39:2249–2256. doi: 10.1161/STROKEAHA.107.510321. [DOI] [PubMed] [Google Scholar]
- 39.Nakano S, Iseda T, Kawano H, Yoneyama T, Ikeda T, Wakisaka S. Parenchymal hyperdensity on computed tomography after intra-arterial reperfusion therapy for acute middle cerebral artery occlusion: incidence and clinical significance. Stroke. 2001;32:2042–2048. doi: 10.1161/hs0901.095602. [DOI] [PubMed] [Google Scholar]
- 40.Kim JT, Heo SH, Cho BH, et al. Hyperdensity on non-contrast CT immediately after intra-arterial revascularization. J Neurol. 2012;259:936–943. doi: 10.1007/s00415-011-6281-9. [DOI] [PubMed] [Google Scholar]
- 41.Xu C, Zhou Y, Zhang R, et al. Metallic hyperdensity sign on noncontrast CT immediately after mechanical thrombectomy predicts parenchymal hemorrhage in patients with acute large-artery occlusion. AJNR Am J Neuroradiol. 2019;40:661–667. doi: 10.3174/ajnr.A6008. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 42.Sun Y, Su Y, Chen Z, He Y, Zhang Y, Chen H. Contrast extravasation after endovascular treatment in posterior circulation stroke. World Neurosurg. 2019;130:e583–e587. doi: 10.1016/j.wneu.2019.06.156. [DOI] [PubMed] [Google Scholar]
- 43.Phan CM, Yoo AJ, Hirsch JA, Nogueira RG, Gupta R. Differentiation of hemorrhage from iodinated contrast in different intracranial compartments using dual-energy head CT. AJNR Am J Neuroradiol. 2012;33:1088–1094. doi: 10.3174/ajnr.A2909. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 44.Bluemke DA, Moy L, Bredella MA, et al. Assessing radiology research on artificial intelligence: a brief guide for authors, reviewers, and readers-from the Radiology Editorial Board. Radiology. 2020;294:487–489. doi: 10.1148/radiol.2019192515. [DOI] [PubMed] [Google Scholar]
- 45.Mackin D, Fave X, Zhang L, et al. Measuring computed tomography scanner variability of radiomics features. Invest Radiol. 2015;50:757–765. doi: 10.1097/RLI.0000000000000180. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Zhovannik I, Bussink J, Traverso A, et al. Learning from scanners: bias reduction and feature correction in radiomics. Clin Transl Radiat Oncol. 2019;19:33–38. doi: 10.1016/j.ctro.2019.07.003. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 47.Berenguer R, Pastor-Juan MDR, Canales-Vázquez J, et al. Radiomics of CT features may be nonreproducible and redundant: influence of CT acquisition parameters. Radiology. 2018;288:407–415. doi: 10.1148/radiol.2018172361. [DOI] [PubMed] [Google Scholar]