Abstract
Purpose
To evaluate the diagnostic capabilities of a supplementary color ramped iodine density map compared to virtual monoenergetic images (VMIs) at 74 keV in the diagnosis of acute bowel ischemia (ABI).
Methods
Data for this study were prospectively gathered and retrospectively evaluated. Patients referred to the Department of Diagnostic Radiology between October 2020 and August 2022 on the suspicion of ABI and underwent surgery < 12 h following fast kV-switching venous phase abdominal dual-energy CT (DECT) were consecutively included. Images were evaluated by two board-certified radiologists and two radiology residents. First round included only 74 keV VMIs resembling conventional 120 kVp images, and the second round included a supplementary iodine density map. Readers were asked to register presence of ABI as well as their confidence in their diagnosis based on a 5-point Likert scale. Sensitivity, specificity, positive predictive value (PPV), and negative predictive value (NPV) were calculated for each observer with the surgical findings as the gold-standard. McNemar’s and Wilcoxon signed-rank test were used to compare registrations and diagnostic confidence across assessment rounds.
Results
A total of 29 patients resulting in 31 DECT scans were included. Fourteen cases of ischemic/necrotic bowel were reported following surgery. Sensitivity and NPV were decreased with the use of supplementary iodine map images compared to 120 kVp-like images without supplementary iodine map images for three of four observers (round 1 range: 71.4–92.9% and 78.0–94.8%; round 2 range: 57.1–78.6% and 70.1–83.3%, respectively), while specificity and PPV were increased for three of four observers (round 1 range: 64.7–94.1% and 67.4–93.1%; round 2 range: 88.2–94.1% and 73.8–91.1%, respectively). However, no significant difference in ABI diagnosis or diagnostic confidence was found (p-value range: 0.07–1.00 and 0.23–0.58, respectively).
Conclusion
No significant difference for the diagnosis of ABI was found using supplementary iodine mapping. Our study may suggest a trend of increased specificity and decreased sensitivity, hence, the use of supplementary iodine mapping should be carefully considered.
Keywords: Computed tomography, Dual-energy CT, Bowel ischemia
Introduction
Acute bowel ischemia (ABI) is a condition where a sudden reduction or interruption of the blood flow to the small or large intestine results in bowel ischemia and eventual necrosis and perforation [1]. ABI may be caused by arterial or venous occlusion, non-occlusive ischemia or bowel strangulation/obstruction [2]. ABI is a rare diagnosis constituting approximately 0.09–0.2% of surgical admissions [3]. However, due to high mortality rates associated with intervention of ABI (60–80%), the diagnosis of ABI has a high priority among abdominal surgeons [3, 4].
One of the most important prognostic factors for patient outcome is related to the duration of the intestinal hypoperfusion [5]. Although ABI due to arterial and venous occlusion as well as non-occlusive ischemia can be diagnosed with high sensitivity (93%) and specificity (96%) using multiphase CT, sensitivity for ABI secondary to obstruction or strangulation is associated with a significantly lower sensitivity (49%) [6]. Considering that small bowel obstruction (SBO) accounts for 12–16% of acute abdominal pain admissions, the all-cause sensitivity for ABI is presumably significantly lower than 90% [7].
Multiple CT features contribute to the diagnosis of ABI, however, one of the most specific signs for ABI is diminished enhancement of the bowel wall, which may be found in all causes for ABI [8–10]. The sensitivity of bowel wall hypo-enhancement may be as low as 48%, which can be explained by the difficulties associated with the identification of subtle differences in gray scale attenuation [9, 11].
With the emergence of dual-energy CT (DECT), several studies have indicated that iodine mapping and iodine quantification can aid in the diagnosis of ABI [12, 13]. DECT uses data from high and low energy photons to separate materials based on their atomic number. Due to the high atomic number of iodine, the attenuation of iodine contrast increases relatively more with decreased photon energy compared to other tissues in the body. DECT allows for the separation of iodine from soft tissue or water with the reconstruction of iodine maps, that can be a potential aid in various clinical tasks [14, 15].
In this study, we aimed to assess the diagnostic performance of supplementary iodine density map derived from DECT image acquisition compared to conventional CT images for the evaluation of ABI. Secondly, we investigated how iodine density maps affected the diagnostic performance of residents versus experienced abdominal radiologists. We hypothesized that DECT may increase the sensitivity, specificity, and the confidence of ABI diagnoses. The radiological findings with and without DECT iodine reconstructions were compared to surgical findings serving as the gold-standard.
Methods
This study was approved by the Regional Committee on Health Research Ethics and the Regional Knowledge Centre on Data Protection Compliance (P-2020-663). Data were prospectively collected.
Patients
Two main criteria were required for inclusion in the study. First, patients had to be referred to the Department of Diagnostic Radiology on the suspicion of ABI and undergo a venous phase DECT or multiphase ABI protocol including a venous phase DECT and a conventional non-contrast and arterial phase scan. Second, patients had to undergo abdominal surgery no more than 12 h following the image acquisition. Surgical findings were based on a visual and/or palpatory assessment of the bowel, and findings as stated in the surgical report were used as reference. Second look assessments were also included if available. Included patients were considered as independent samples.
Patients referred between October 2020 and August, 2022 were screened for inclusion. The same patient could be included multiple times if inclusion criteria were met. For these patients, statistical independence was assumed. Patient scans were excluded if image quality was severely affected by motion- or metal artifacts. Patient demographics and surgical findings were obtained through the regional electronic journal, Sundhedsplatformen (Epic Systems, Madison, Wisconsin, US). Dose reports including CT dose index volume (CTDIvol) and dose length product (DLP) were obtained within the local picture archiving and communication system (PACS).
Scan parameters
All patients were scanned in a second-generation 256-slice CT (Revolution CT; GE Healthcare, Chicago, IL, USA). For the conventional non-contrast and arterial phase scan a kVp of 120 was used with a tube current between 80 and 600 mA (SmartmA) and a noise index of 13 and 14, respectively. For the venous phase acquisition, fast kV-switching (80/140 kV) was applied using Gemstone Spectral Imaging (GSI) Assist (GE Healthcare, Chicago, IL, USA) with a noise index of 14. Rotation speed, pitch, and beam width for all phases were set to 0.5 s, 0.992, and 80 mm, respectively.
Omnipaque 350 mg/mL (Iohexol, GE Healthcare, Chicago, IL, USA) was administered through an 18-gauge plastic cannula in the antecubital vein. Contrast volume was 1.4 mL/kg at a flow rate of 4 mL/s. The arterial and venous phase delay were set to 7 and 45 s following HU threshold triggering within the aorta at 100 HU.
Image reconstruction
Images were reconstructed using an adaptive statistical iterative reconstruction (ASIR-V) algorithm with a blending factor of 60% [16]. A standard abdominal kernel was applied. The data file for the venous phase scan as well as 0.625 mm sliced images for all scan phases were transferred to the advanced workstation (AW) server for image analysis. DECT images were reconstructed at 74 kiloelectron volt (keV) to resemble 120 kVp images.
Image analysis
Images were evaluated by four observers, two third year residents and two board-certified radiologists with 7 and > 20 years of clinical experience, respectively. Images were assessed on the AW server to blind observers from the list of previous examinations, referral text, radiology report and markers set by the reporting radiologist. All observers evaluated the images independently over two rounds. A gap of 6 weeks was set between the assessment of the last patient in the first round and first patient in the second round to blind observers from their previous assessments.
Round 1 included conventional 120 kVp-like images (venous phase and conventional non-contrast/arterial phase if available) and round 2 included iodine density reconstructions as well as the 120 kVp-like reconstructions presented in the first round. Each observer was given a patient list, which was intra- and inter-reader randomized by simple randomization across the two assessment rounds. A custom workflow within the AW server was setup for the second assessment round. This workflow included a virtual unenhanced (VUE) image overlayed by an iodine (water) map with a rainbow color ramp allowing the observer to freely overlay the iodine density map on top of the VUE image (Fig. 1). The color ramp provides a semiquantitative measure for the iodine concentration, which by default was set to − 12 to 55 3 based on previous experience at our institution. Observers were briefly (1 h) introduced to the AW server and how to navigate and adjust slice thickness, color ramp settings, window level, and multi-planar reconstruction prior to the assessment rounds.
For each assessment round, observers were asked whether they suspected ABI to be present or not. If ABI was suspected, the observers were asked to register the affected region(s) defined by the following list: duodenum, jejunum, ileum, small bowel, caecum, ascending colon, transverse colon, descending colon, sigmoid colon, and rectum. Furthermore, observers were asked to rate their diagnostic confidence on a five-point Likert scale (1 = ABI cannot be excluded, 3 = moderate diagnostic confidence for ABI, 5 = high diagnostic confidence for ABI) similar to a previous study by Lourenco et al. [12, 17]. This confidence rating was only registered for patients in which ABI was suspected.
Statistical analysis
Sensitivity, specificity, negative predictive value (NPV), and positive predictive value (PPV) were calculated for each observer with and without DECT reconstructions. Furthermore, McNemar’s test was used to assess whether a significant difference was observed between the two assessment rounds, while Wilcoxon signed-rank test was used to evaluate changes in confidence rating for the same observer. A significance level of 0.05 was applied.
Inter-observer agreement was evaluated using kappa statistics (< 0 = poor; 0.0–0.20 = slight agreement; 0.21–0.40 = fair agreement; 0.41–0.60 = moderate agreement; 0.61–0.80 = substantial agreement; and 0.81–1.0 = almost perfect agreement) [18]. Statistical analyses were performed in R version 4.0.1 (R Foundation for Statistical Computing, Vienna, Austria) with RStudio version 1.2.1093 (RStudio, Boston, MA, USA).
Results
Ninety-three patients underwent CT according to the ABI protocol, and a total of 29 patients, 16 men and 13 women (mean age 64 ± 12 years, range: 32–87 years), were included in this study (Fig. 2). Two patients were scanned and consequently operated twice with a separation time between first and second round of image acquisition and subsequent surgery of 4 and 18 days, respectively. This resulted in a total of 31 evaluated image datasets with matching surgical reports. Median time from image acquisition to surgical intervention (as defined by the registration time of the surgical report) was 4 h and 35 min. Fourteen patients were found to have ischemic/necrotic bowel following surgery and the mortality rate was 71% (n = 10). Affected bowel sections included the colon (n = 4), small bowel (n = 4), and mixed (n = 6). No patients underwent second look operation following registered surgical procedures, however, one of the included surgeries was a second look operation. Eight patients underwent venous phase DECT (mean CTDIvol = 11.8 ± 1.5 and mean DLP 132.1 ± 8.0), while the remaining 23 patients underwent multi-phase scan (mean CTDIvol = 30.0 ± 6.8 and mean DLP 1742.4 ± 485.0).
Subjective image interpretation
For all observers, sensitivity either was maintained or decreased using supplementary iodine map: (round 1 range: 71.4–92.9%; round 2 range: 57.1–78.6%), while specificity was increased for three observers (round 1 range: 64.7–94.1%; round 2 range: 88.2–94.1%). Likewise, PPV was increased for the same three observers (round 1 range: 67.4–93.1%; round 2 range: 73.8–91.1%), while NPV was maintained or decreased (round 1 range: 78.0–94.8%; round 2 range: 70.1–83.3%). An overview of the performance of the four observers in the two rounds is shown in Table 1.
Table 1.
Sensitivity* (95%CI; TP/[TP + FP]) | Specificity* (95%CI; TN/[TN + FP]) | PPV* (95%CI; TP/[TP + FP]) | NPV* (95%CI; TN/[TN + FN]) | Average confidence | |
---|---|---|---|---|---|
Conventional 120 kVp-like images | |||||
Radiologist 1 | 85.7 (56–100; 12/14) | 64.7 (46–83; 11/17) | 67.4 (45–88; 12/18) | 84.6.0 (65–100; 11/13) | 3.9 |
Radiologist 2 | 78.6 (52–100; 11/14) | 88.2 (57–100; 15/17) | 84.6 (65–100; 11/13) | 83.3 (66–100; 15/18) | 4.2 |
Resident 1 | 71.4 (48–94; 10/14) | 82.4 (54–100; 14;17) | 76.9 (54–100; 10/13) | 78.0 (59–96; 14/18) | 3.4 |
Resident 2 | 92.9 (60–100; 13/14) | 94.1 (61–100; 16/17) | 92.9 (79–100; 13/14) | 94.1 (83–100; 16/17) | 4.0 |
Conventional 120 kVp-like images + Iodine map | |||||
Radiologist 1 | 57.1 (44–70; 8/14) | 82.4 (54–100; 14/17) | 72.7 (46–99; 8/11) | 70.0 (47–87; 14/20) | 4.3 |
Radiologist 2 | 71.4 (48–94; 10/14) | 94.1 (83–100; 16/17) | 90.9 (74–100; 10/11) | 80.0 (67–100; 16/20) | 4.0 |
Resident 1 | 71.4 (48–94; 10/14) | 88.2 (78–98; 15/17) | 84.6 (62–100; 11/13) | 78.9 (59–95; 15/19) | 3.2 |
Resident 2 | 78.6 (52–100; 11/14) | 88.2 (78–98; 15/17) | 84.6 (65–100; 11/13) | 83.3 (75–100; 15/18) | 4.2 |
TP true positive, TN true negative, FP false positive, FN false negative
*Values given in percentages
McNemars test demonstrated no significant difference between the two evaluation rounds for all observers (p > 0.05; range: 0.1–1.0, Table 2). Additionally, no significant difference was found in the confidence rating across the two rounds for all observers (p > 0.2; range: 0.2–0.6, Table 2). For the registered bowel segment(s), 96% of the registrations correlated with the affected segment(s) as stated in the surgical report. Only two registrations by resident 2 in round 1 did not match surgical findings: One registration of ABI suspicion in the descending colon was surgically identified to the caecum and terminal ileum, and a second registration within the caecum and ascending colon was identified to the small bowel.
Table 2.
Diagnosis of ABI (McNemar) p-value |
Observer rated confidence (Wilcoxon) p-value |
|
---|---|---|
Radiologist 1 | 0.07 | 0.23 |
Radiologist 2 | 0.48 | 0.57 |
Resident 1 | 1.0 | 0.57 |
Resident 2 | 1.0 | 0.58 |
Inter-observer agreement showed overall substantial agreement for 10/12 comparisons for conventional and iodine map evaluations (range: 0.59–0.93 and 0.49–0.87, respectively, Table 3). Two remaining comparisons between radiologist 1 and resident 2 demonstrated moderate agreement (κ = 0.59 and 0.49, Table 3).
Table 3.
Conventional images | Iodine map | |
---|---|---|
Rad1/Rad2 | 0.72 | 0.68 |
Rad1/Res1 | 0.79 | 0.69 |
Rad1/Res2 | 0.59 | 0.49 |
Rad2/Res1 | 0.93 | 0.87 |
Rad2/Res2 | 0.86 | 0.80 |
Res1/Res2 | 0.80 | 0.67 |
Rad1 Radiologist 1, Rad2 Radiologist 2, Res1 Resident 1, Res2 Resident 2
Discussion
Overall, we found no significant difference between the use of conventional images compared to conventional images combined with iodine maps. This study found that specificity may be increased using iodine map images as a supplementary reconstruction to conventional multiphase images, however, a decrease in sensitivity was also identified. Our findings suggest that systematic use of iodine density maps may lead to misdiagnosis of ABI when compared to surgical findings.
Few studies have evaluated the clinical benefits of using iodine maps as a supplementary reconstruction to conventional reconstructions for the diagnosis of ABI. To our knowledge, only one study by Lourenco et al. evaluated the clinical performance of iodine maps, demonstrating a maintained or increased sensitivity and specificity as well as increased confidence in the diagnosis of ABI for one of two observers [12].
These findings were only partially reproduced in our study, as we identified increased specificity and PPV for three of four observers, suggesting a decreased false positive rate. Following round two, the average specificity and PPV increased from 82.4 to 88.2% and 80.8 to 83.5%, respectively. This may be attributed to the improved visualization of bowel wall perfusion. Sensitivity, however, was decreased for three of four observers using iodine maps resulting in an average reduction from 82.2 to 69.6% following round two. Additionally, no significant difference was found in the confidence of ABI diagnosis for any observers. Interestingly, for two of four observers the average confidence rating decreased with the use of iodine mapping, demonstrating that there were cases where the iodine map rendered the observer less confident or led to a misdiagnosis compared to the primary evaluation. Several factors may explain this observation. First, natural intra-reader variability across time cannot be excluded [19]. Second, limitations related to the underlying physics of DECT, and material decomposition may affect the observational outcome [20]. An example may be the understanding of paired Compton and photoelectric contribution for two material decomposition maps, where materials such as calcium or similar materials can demonstrate a paired effect (Fig. 3). In these cases, the same material may attenuate in both iodine(water) and VUE images. Additionally, several other known artifacts have been described in relation to bowel wall assessment using iodine density maps such as pseudo hyperenhancement caused by air-filled bowel segments, peristalsis related artifacts, and streak artifacts from metal [20]. Third, the added number of reconstructions may decrease the overall assessment thoroughness leading to missed diagnoses, which also was suggested by a recent study [21].
Previous studies demonstrated increased conspicuity of ABI with DECT reconstructions such as iodine mapping [13]. This was also the case for a few patients in this study (Fig. 4), though most ischemic cases seemed to be easily identified in the conventional 120 kVp-like images. Furthermore, there were cases where all observers reported strong suspicion of ischemia with increased confidence using the iodine map, but where the surgical findings found no signs of ischemia (Fig. 5). As this particular patient survived and did not undergo second look operation, the mismatch between radiological and surgical findings could be explained by temporary hypoperfusion and reperfusion.
No significant difference was found between the reporting of resident level physicians and experienced radiologists in this study. The overall most correct evaluation for suspected ABI diagnosis was performed by resident 2 (Table 1). However, it is also relevant to add that the only two bowel segment registrations, which did not match the surgical findings, was registered by resident 2 during the first evaluation round with low confidence for both cases.
In this study, two patients were included twice, which may cause dependency concerns. We performed a Post-hoc sensitivity analysis (not shown), where the extra datasets from the two patients were excluded from the McNemar and Wilcoxon analyses. This did not significantly affect the results, and for this reason paired datasets were included in the presented analyses.
It is not evident from this study that iodine mapping using a semi-quantitative color scale improves the diagnosis of ABI. With the increasing workload for radiologists, the approach of evaluating all patients with iodine maps and DECT reconstructions may not be sensible [22]. This may be time inefficient and as demonstrated in this study lead to reduced sensitivity, which is crucial in the diagnosis of ABI. An emphasis on the technical aspects as well as the limitations of DECT may benefit radiologists and radiology residents to better assess on a case-to-case basis, whether DECT reconstructions may or may not be of use.
There are certain limitations to consider in this study. Firstly, although observers were blinded to the surgical report, they were aware that the surgical findings would be the gold standard. This contributes to a reporting bias as observers may expect more patients to have ischemia. As previous review articles have suggested, the use of DECT and iodine density maps in ABI diagnosis are heavily related to the increased conspicuity [23, 24]. In a study where identification of ABI is the main focus, these benefits may be less pronounced and thus may be more beneficial in cases where ABI is not the primary referral concern.
Secondly, this study only included 29 patients. Despite having a good distribution of surgically confirmed ischemia vs. no ischemia patients, a larger patient population with a bigger variety of negative and positive findings would have contributed to the statistical power of this study [23, 25]. Thirdly, although all observers had some experience with DECT reconstructions, no effort was made to ensure an understanding of the limitations and pitfalls of DECT prior to the evaluation. For future studies, a tailored training session should be considered for all observers to ensure a basic understanding of the technical limitations of DECT.
Lastly, surgical findings are not always accurate in predicting bowel perfusion and viability, as previous studies have suggested [26]. Future studies may benefit from including the histological findings as a gold standard reference.
Conclusion
Our study found no significant difference when adding supplementary iodine map to conventional gray scale images in the diagnosis of ABI. This is the first study to include consecutive patients prospectively using surgical findings as reference standard, and the study outlines some of the challenges and potential pitfalls of using iodine maps in the diagnosis of ABI.
Funding
Open access funding provided by Royal Library, Copenhagen University Library.
Declarations
Competing interests
The authors J.J.X. and P.S.U. have received consulting fees from GE healthcare for presenting at GE Healthcare related webinars. The other authors of this manuscript declare no relationships with any companies whose products or services may be related to the subject matter of the article.
Footnotes
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
References
- 1.Patel A, Kaleya RN, Sammartano RJ. Pathophysiology of Mesenteric Ischemia. Surgical Clinics of North America. 1992;72:31–41. doi: 10.1016/S0039-6109(16)45626-4. [DOI] [PubMed] [Google Scholar]
- 2.Davarpanah AH, Ghamari Khameneh A, Khosravi B, et al (2021) Many faces of acute bowel ischemia: overview of radiologic staging (page 1-23). Insights Imaging 12. [DOI] [PMC free article] [PubMed]
- 3.Bala M, Kashuk J, Moore EE, et al. Acute mesenteric ischemia: guidelines of the World Society of Emergency Surgery. World Journal of Emergency Surgery. 2017;12:38. doi: 10.1186/s13017-017-0150-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Jan M. Diagnostic accuracy of multidetector CT in acute mesenteric ischemia: Systematic review and meta-analysis. Radiology. 2010;256:93–101. doi: 10.1148/radiol.10091938. [DOI] [PubMed] [Google Scholar]
- 5.Luther B, Mamopoulos A, Lehmann C, Klar E. The Ongoing Challenge of Acute Mesenteric Ischemia. Visc Med. 2018;34:215–221. doi: 10.1159/000490318. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 6.Cox VL, Tahvildari AM, Johnson B, et al. Bowel obstruction complicated by ischemia: analysis of CT findings. Abdominal Radiology. 2018;43:3227–3232. doi: 10.1007/s00261-018-1651-8. [DOI] [PubMed] [Google Scholar]
- 7.Paulson EK, Thompson WM. Review of Small-Bowel Obstruction: The Diagnosis and When to Worry. Radiology. 2015;275:332–342. doi: 10.1148/radiol.15131519. [DOI] [PubMed] [Google Scholar]
- 8.Furukawa A, Kanasaki S, Kono N, et al. CT diagnosis of acute mesenteric ischemia from various causes. American Journal of Roentgenology. 2009;192:408–416. doi: 10.2214/AJR.08.1138. [DOI] [PubMed] [Google Scholar]
- 9.Zalcman M, Sy M, Donckier V, et al. Helical CT Signs in the Diagnosis of Intestinal Ischemia in Small-Bowel Obstruction. American Journal of Roentgenology. 2000;175:1601–1607. doi: 10.2214/ajr.175.6.1751601. [DOI] [PubMed] [Google Scholar]
- 10.Millet I, Taourel P, Ruyer A, Molinari N. Value of CT findings to predict surgical ischemia in small bowel obstruction: A systematic review and meta-analysis. Eur Radiol. 2015;25:1823–1835. doi: 10.1007/s00330-014-3440-2. [DOI] [PubMed] [Google Scholar]
- 11.Chai Y, Xing J, Lv P, et al (2022) Evaluation of ischemia and necrosis in adhesive small bowel obstruction based on CT signs: Subjective visual evaluation and objective measurement. Eur J Radiol 147:. 10.1016/j.ejrad.2021.110115 [DOI] [PubMed]
- 12.Lourenco PDM, Rawski R, Mohammed MF, et al. Dual-Energy CT Iodine Mapping and 40-keV Monoenergetic Applications in the Diagnosis of Acute Bowel Ischemia. AJR Am J Roentgenol. 2018;211:564–570. doi: 10.2214/AJR.18.19554. [DOI] [PubMed] [Google Scholar]
- 13.Potretzke TA, Brace CL, Lubner MG, et al. Early Small-Bowel Ischemia: Dual-Energy CT Improves Conspicuity Compared with Conventional CT in a Swine Model. Radiology. 2014;275:119–126. doi: 10.1148/radiol.14140875. [DOI] [PubMed] [Google Scholar]
- 14.Grob D, Smit E, Prince J, et al. Iodine Maps from Subtraction CT or Dual-Energy CT to Detect Pulmonary Emboli with CT Angiography: A Multiple-Observer Study. Radiology. 2019;292:197–205. doi: 10.1148/radiol.2019182666. [DOI] [PubMed] [Google Scholar]
- 15.Lestra T, Mulé S, Millet I, et al. Applications of dual energy computed tomography in abdominal imaging. Diagn Interv Imaging. 2016;97:593–603. doi: 10.1016/j.diii.2015.11.018. [DOI] [PubMed] [Google Scholar]
- 16.Chen L-H, Jin C, Li J-Y, et al. Image quality comparison of two adaptive statistical iterative reconstruction (ASiR, ASiR-V) algorithms and filtered back projection in routine liver CT. Br J Radiol. 2018;91:20170655. doi: 10.1259/bjr.20170655. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Likert R. A technique for the measurement of attitudes. Archives of Psychology. 1932;22(140):55. [Google Scholar]
- 18.Landis JR, Koch GG. The measurement of observer agreement for categorical data. Biometrics. 1977;33:159–174. doi: 10.2307/2529310. [DOI] [PubMed] [Google Scholar]
- 19.Schmid AM, Raunig DL, Miller CG, et al. Radiologists and Clinical Trials: Part 1 The Truth About Reader Disagreements. Ther Innov Regul Sci. 2021;55:1111–1121. doi: 10.1007/s43441-021-00316-6. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 20.Parakh A, Lennartz S, An C, et al. Dual-Energy CT Images: Pearls and Pitfalls. RadioGraphics. 2021;41:98–119. doi: 10.1148/rg.2021200102. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 21.Xu JJ, Ulriksen PS, Bjerrum CW, et al (2022) Characterizing incidental mass lesions in abdominal dual-energy CT compared to conventional contrast-enhanced CT. Acta radiol 02841851221116306. 10.1177/02841851221116306 [DOI] [PubMed]
- 22.Maskell G. Why does demand for medical imaging keep rising? BMJ. 2022;379:o2614. doi: 10.1136/bmj.o2614. [DOI] [PubMed] [Google Scholar]
- 23.Wang TJ, Barrett S, Ali I, et al (2022) Dual-Energy CT in the Acute Setting: Bowel Trauma. Front in Radiology 2:1-8. [DOI] [PMC free article] [PubMed]
- 24.Obmann MM, Punjabi G, Obmann VC, et al. Dual-energy CT of acute bowel ischemia. Abdominal Radiology. 2022;47:1660–1683. doi: 10.1007/s00261-021-03188-4. [DOI] [PubMed] [Google Scholar]
- 25.Winkelmann MT, Hagen F, Artzner K, et al (2022) Dual-Energy CT for Accurate Discrimination of Intraperitoneal Hematoma and Intestinal Structures. Diagnostics 12. 10.3390/diagnostics12102542 [DOI] [PMC free article] [PubMed]
- 26.Joosten JJ, Longchamp G, Khan MF, et al (2022) The use of fluorescence angiography to assess bowel viability in the acute setting: an international multi-centre case series Abstract. Surg Endosc 36(10):7369-7375. 10.1007/s00464-022-09136-7 [DOI] [PMC free article] [PubMed]