Abstract
Purpose:
To perform task-based image quality assessment in CT, it is desirable to have a large number of realistic patient images with known diagnostic truth. One effective way of achieving this objective is to create hybrid images that combine patient images with inserted lesions. Because conventional hybrid images generated in the image domain fails to reflect the impact of scan and reconstruction parameters on lesion appearance, this study explored a projection-domain approach.
Methods:
Lesions were segmented from patient images and forward projected to acquire lesion projections. The forward-projection geometry was designed according to a commercial CT scanner and accommodated both axial and helical modes with various focal spot movement patterns. The energy employed by the commercial CT scanner for beam hardening correction was measured and used for the forward projection. The lesion projections were inserted into patient projections decoded from commercial CT projection data. The combined projections were formatted to match those of commercial CT raw data, loaded onto a commercial CT scanner, and reconstructed to create the hybrid images. Two validations were performed. First, to validate the accuracy of the forward-projection geometry, images were reconstructed from the forward projections of a virtual ACR phantom and compared to physically acquired ACR phantom images in terms of CT number accuracy and high-contrast resolution. Second, to validate the realism of the lesion in hybrid images, liver lesions were segmented from patient images and inserted back into the same patients, each at a new location specified by a radiologist. The inserted lesions were compared to the original lesions and visually assessed for realism by two experienced radiologists in a blinded fashion.
Results:
For the validation of the forward-projection geometry, the images reconstructed from the forward projections of the virtual ACR phantom were consistent with the images physically acquired for the ACR phantom in terms of Hounsfield unit and high-contrast resolution. For the validation of the lesion realism, lesions of various types were successfully inserted, including well circumscribed and invasive lesions, homogeneous and heterogeneous lesions, high-contrast and low-contrast lesions, isolated and vessel-attached lesions, and small and large lesions. The two experienced radiologists who reviewed the original and inserted lesions could not identify the lesions that were inserted. The same lesion, when inserted into the projection domain and reconstructed with different parameters, demonstrated a parameter-dependent appearance.
Conclusions:
A framework has been developed for projection-domain insertion of lesions into commercial CT images, which can be potentially expanded to all geometries of CT scanners. Compared to conventional image-domain methods, the authors’ method reflected the impact of scan and reconstruction parameters on lesion appearance. Compared to prior projection-domain methods, the authors’ method has the potential to achieve higher anatomical complexity by employing clinical patient projections and real patient lesions.
Keywords: computed tomography (CT), image quality assessment, lesion insertion, projection domain, hybrid images, observer performance
1. INTRODUCTION
Assessing CT image quality for lesion detection tasks requires the ground truth for lesion characteristics (size, contrast, texture, boundary, type, and location). Although such information can be collected via chart and image review, the collecting process is time-consuming. Furthermore, the collecting process is retrospective, which means the lesion characteristics cannot be determined prior to the patient scanning. To overcome these barriers, lesions of known characteristics are inserted into patient images to create hybrid images, such that the image quality assessment can be efficiently and prospectively designed.
An easy and common approach to generating hybrid images is the image-domain method, which inserts lesions into reconstructed CT images.1–5 However, because this method inserts the lesions after image reconstruction, simulating the impact of CT scan and reconstruction parameters (radiation dose, slice thickness, reconstruction algorithm, etc.) on the appearance of lesions becomes extremely challenging. This is especially true with the increasing use of iterative reconstruction algorithms, where the imaging system response at the boundary of the lesion is nonlinear and still under exploration;6,7 it is almost impossible to simulate the true appearance of lesion boundaries using image-domain lesion insertion methods when iterative reconstruction is applied.
To accurately reflect the impact of scan and reconstruction parameters on the appearance of lesion boundaries, projection-domain methods that insert lesions into projection data prior to reconstruction were explored by Solomon et al.8 and Xu et al.,9 Xu’s work employed a vendor-developed computer simulation package, drasim,10 to simulate projections of a virtual anthropomorphic phantom with embedded lesions. The simulated projections were then reformatted to match those of commercial raw data, such that they can be uploaded to commercial CT scanners for image reconstruction. However, the study was fundamentally limited by the fact that, restricted by drasim, only analytical phantoms and lesion models could be used for projection simulation (the virtual anthropomorphic phantom defines organs with nonuniform rational B-spline surfaces,11 not voxels). As a result, subtle anatomical variations such as tissue texture, lesion inhomogeneity and invasive lesion boundaries could not be simulated.
To improve the anatomical complexity and reality of the hybrid images, this study explored a new projection-domain method based on real patient projection data. First, voxelized lesions were extracted from patient CT data sets. Then, lesion projections were obtained using a forward-projection program. The lesion projections were combined with patient projections to generate hybrid images. The forward-projection program precisely simulated the gantry movement of a state-of-the-art commercial CT scanner in both axial and helical modes with various focal spot movement patterns and was evaluated in terms of CT number accuracy and high-contrast resolution. Preliminary evaluations of lesion realism in the hybrid images were performed by radiologists.
2. METHODS
2.A. Lesion insertion in projection domain
A flowchart of the projection-domain lesion insertion process is shown in Fig. 1. Voxelized lesion models were built upon segmented lesions, forward projected, and combined with patient CT projections. The modified patient projections were then formatted to match that of commercial CT raw data and reconstructed on scanners to yield hybrid images.
First, voxelized lesion models in the unit of Hounsfield unit (HU) were built upon lesions segmented from patient CT images. The segmentations were performed with free software (Seg3D, University of Utah, Salt Lake City, UT), where the lesion boundaries were manually drawn slice-by-slice under the instruction of a radiologist specialized in abdominal imaging. Basic lesion characteristics such as the volume, contrast, sphericity, and heterogeneity of the lesion were recorded along with the segmented lesion in each lesion model. To minimize the noise while maximizing the resolution of the model, the images for lesion segmentation were reconstructed with an iterative reconstruction algorithm (SAFIRE—Sinogram Affirmed Iterative Reconstruction with strength of 3, Siemens Healthcare, Forchheim, Germany) using a medium sharp I40 kernel, 1 mm image thickness, and 200 mm reconstruction field of view.
The voxel intensity of the segmented lesion model was adjusted in two steps to maintain the lesion’s contrast to the surrounding tissue after it was inserted into the patient images. The first adjustment approximately removed the tissue at the lesion insertion location prior to the insertion, which was done by subtracting the average CT number of the insertion location from the lesion model (assuming that the liver parenchyma at the insertion location is uniform). The second adjustment accounted for the intensity difference between the lesion’s original location and the lesion’s insertion location, which was done by subtracting the background difference from the lesion model. Appendix A mathematically demonstrates how the lesion contrast was maintained through the two adjustments.
Next, a forward-projection program using Siddon’s method12 was developed to compute lesion projections from the lesion model. Only primary beam was considered during the forward projection, which was reasonable given the fact that each lesion was of limited size. The forward-projection program can potentially be used for geometries of any CT scanner, although this work focused on the geometry of a state-of-art multidetector-row scanner (Somatom Definition Flash, Siemens Healthcare, Forchheim, Germany). Specifically, the program accommodated various acquisition conditions, such as axial and helical scans, 32- and 64-row collimations, and flying focal spot (a periodic motion of focal spot to enhance spatial resolution13).
Because the unit of the lesion models was HU, the lesion forward projection needed to undergo an additional unit conversion process to convert CT numbers into linear attenuation coefficients. This conversion requires an x-ray energy spectrum, based on which the water attenuation coefficient can be defined. This spectrum was chosen to be monoenergetic, with its energy equal to the CT vendor’s beam hardening correction energy. This was done because the patient projections, into which the lesion forward projections were inserted, were decoded from commercial CT raw data that had already had beam hardening corrections applied. Therefore, by converting the HU to the linear attenuation coefficient at the CT vendor’s beam hardening correction energy, the lesion forward projections could be readily combined with the patient projections.
The CT vendor’s beam hardening correction energy was proprietary and unknown. To estimate it, a virtual phantom was built from images of an ACR CT accreditation phantom14 (acquired on a Siemens Definition Flash scanner with highest dose available and reconstructed with 5 mm slice thickness and a sharp H70 kernel), named {I0}. Forward projections of the virtual phantom were converted from integral of CT number to integral of linear attenuation coefficients under an initial guess of the beam hardening correction energy and formatted to match those of commercial CT raw data. The forward projections were then loaded back to CT scanners and a new set of images named {I1} were reconstructed. The CT numbers measured from {I1} were compared to those of {I0}, according to which the initial guess of the energy can be calibrated. The calibration process is described in detail in Appendix B. The estimation of beam hardening correction energy was performed with multiple materials, including acrylic, polyethylene, and solid water (inserts in Module 1 of the ACR CT accreditation phantom). The estimation was also performed at multiple tube potentials, including 80, 100, 120, and 140 kV. The initial guess of the beam hardening correction energy for each tube potential was the effective energy of the polychromatic beam (53.8, 62.2, 69.7, and 75.8 keV for 80, 100, 120, and 140 kV, respectively15).
The lesion forward projections after the unit conversion were combined with the patient projections decoded from commercial CT raw data (with the assistance of the vendor). The patient projections with the inserted lesion were then reformatted to match the format of commercial CT projection data and reconstructed on the commercial CT scanner to generate the hybrid images.
2.B. Validation of forward-projection program
The forward-projection program is the key to projection-domain lesion insertion. To validate its accuracy, forward projections were compared to physically acquired CT projections (decoded from commercial CT raw data) in terms of their reconstructed images, as illustrated in Fig. 2. First, forward projections were computed for the virtual ACR phantom built in Sec. 2.A assuming a helical scan (pitch = 1) and use of the flying focal spot technique (both in-plane and along axial directions). The forward projections were converted into unit of μ ⋅ mm using the beam hardening correction energy estimated in Sec. 2.A and reformatted into the format of commercial CT projection data. Next, CT projection data were physically acquired for an ACR phantom on a Siemens Definition Flash scanner using helical scan of unit pitch and flying focal spot. Both forward projections and commercial projection data were reconstructed on the scanner using a medium sharp B40 kernel, 1 mm slice thickness, and 22 cm field of view. The reconstructed images were compared in terms of HU accuracy (Modules 1 and 2 of the ACR phantom) and high-contrast resolution (Module 4 of the ACR phantom).
2.C. Validation of lesion realism
Six liver lesions covering a range of size, boundary type, homogeneity, and contrast were segmented from patient images. As mentioned in Sec. 2.A, the images for segmentation were reconstructed with iterative reconstruction, a medium sharp kernel, thin image thickness, and small field of view, such that the boundary of the lesion was preserved and the noise in the lesion was minimized. The lesions were inserted back into the projection data of the same patients, each at a new location specified by a radiologist. The patient projection data with the inserted lesions were reconstructed on a CT console using clinical protocols (filtered backprojection, medium sharp B40 kernel, 5 mm image thickness, and 320–420 mm field of view) to yield hybrid images. Six lesion pairs (original lesions and the corresponding lesions inserted at a new location) were created from the hybrid images.
To test the realism of the inserted lesions, the six lesion pairs were viewed by two radiologists (both with more than ten years of experience, not the radiologist who specified the lesion insertion location) in the context of the entire liver and across slices. For each lesion pair, the radiologists were blinded to which lesion was inserted and which lesion was original, and chose the lesion in consensus that they thought was inserted. A confidence score on a 1–5 scale was also given to each choice by the radiologists, in consensus, with 1 representing no confidence in their choice and 5 representing full confidence that they had correctly identified the inserted lesion. This assessment of six lesions is limited to a demonstration of feasibility; the small number of lesions does not provide adequate statistical power. In separate work, a full-scale clinical validation study was performed using 51 lesion pairs, and the same methodology and radiologist readers as described here25 (see Sec. 4 for additional information).
To demonstrate the main strength of projection-domain method over image-domain method, which is the ability to reflect the impact of reconstruction parameters on lesion appearance, patient projections with inserted lesion were reconstructed with different reconstruction image thicknesses and kernels to demonstrate the resultant differences of lesion appearance.
3. RESULTS
3.A. Estimation of beam hardening correction energy
Table I lists the estimated energy levels for commercial beam hardening corrections. For 100, 120, and 140 kV, an energy level around 71.1 keV was estimated for materials of acrylic, polyethylene, and solid water. For 80 kV, however, the estimated energy level fluctuated across different materials. This fluctuation was probably caused by beam hardening artifact at 80 kV, which affected the CT number of the virtual ACR phantom and interfered in the energy estimation. The final energy for the beam hardening correction was therefore chosen at 71.1 keV for all kV settings and was used to convert the forward projections from line integral of CT numbers to line integral of linear attenuation coefficients.
TABLE I.
Acrylic | Polyethylene | Solid water | Average | |
---|---|---|---|---|
80 kV | 73.20 | 68.40 | 70.10 | 70.57 |
100 kV | 71.20 | 71.10 | 71.10 | 71.13 |
120 kV | 70.90 | 71.20 | 70.90 | 71.10 |
140 kV | 71.20 | 70.90 | 71.30 | 71.13 |
3.B. Validation of forward-projection program
As a validation of CT number accuracy, Table II lists the CT numbers of the inserts in Module 1 of ACR phantom, measured from both physically acquired images and simulated images (reconstructed from the forward projections of the virtual ACR phantom). Across four tube potentials (80, 100, 120, and 140 kV) and five materials (air, acrylic, bone, polyethylene, and solid water), excellent agreement (within 2 HU) was observed. In addition, to validate the CT number accuracy at low-contrast condition, the contrast of the low-contrast insert in Module 2 of ACR phantom (6 HU nominal contrast) were measured from both physically acquired and simulated images. For all four tube potentials (80, 100, 120, and 140 kV), a contrast of six HU was observed. As a validation of high-contrast resolution, Fig. 3 shows that the bar patterns in the physically acquired and simulated ACR phantom images are essentially identical.
TABLE II.
Air | Acrylic | Bone | Polyethylene | Solid water | ||
---|---|---|---|---|---|---|
80 kV | Commercial | −987 | 102 | 1178 | −111 | 3 |
Forward projection | −988 | 103 | 1180 | −112 | 4 | |
100 kV | Commercial | −987 | 115 | 980 | −93 | 2 |
Forward projection | −988 | 116 | 981 | −94 | 2 | |
120 kV | Commercial | −987 | 121 | 868 | −83 | 3 |
Forward projection | −987 | 121 | 868 | −82 | 4 | |
140 kV | Commercial | −985 | 125 | 797 | −75 | 3 |
Forward projection | −985 | 126 | 796 | −76 | 4 |
3.C. Validation of lesion realism
Figure 4 shows six pairs of original and inserted lesions of various types, including well circumscribed and invasive lesions [Figs. 4(a) and 4(g) and Figs. 4(b) and 4(h), respectively], homogeneous and heterogeneous lesions [Figs. 4(a) and 4(g) and Figs. 4(c) and 4(i), respectively], high-contrast and low-contrast lesions [Figs. 4(a) and 4(g) and Figs. 4(d) and 4(j), respectively], isolated and vessel-attached lesions [Figs. 4(a) and 4(g) and Figs. 4(e) and 4(k), respectively], and small and large lesions [Figs. 4(a) and 4(g) and Figs. 4(f) and 4(l), respectively]. Note that due to partial volume effect (abdominal images are routinely reconstructed with 5 mm slice thickness) and the background differences between original and insertion locations, the inserted lesions do not look exactly the same as the original lesions. However, all inserted locations had realistic appearance and blended naturally into the liver background.
When viewed by the radiologists in a blinded, consensus fashion, lesion pairs 1, 2, and 4 in Fig. 4 were correctly classified (i.e., the radiologists correctly chose the inserted lesion from the lesion pair) with confidence scores of 1, meaning that the radiologists made the right choice by randomly guessing. Lesion pair 5 was correctly classified with a confidence score of 5, because the inserted lesion has an unusual orientation (i.e., the flat border of the lesion should instead appear against a vessel). Lesion pairs 3 and 6 were incorrectly classified by the radiologists with confidence scores of 2 and 3, respectively. Overall, the radiologists reported that they could not effectively distinguish between inserted lesions and original pathologies, as demonstrated by this small reader study. Due to the small number of lesions evaluated, this result is not statistically significant. However, a full-scale clinical validation was performed in a subsequent study25 (see Sec. 4).
Figure 5 demonstrates the major advantage of our projection-domain lesion insertion method over image-domain methods, which is the ability to reflect the impact of reconstruction parameters on the lesion appearance. Figure 5(a) was reconstructed from the original patient projections (no lesion inserted). Figures 5(b)–5(d) were reconstructed from the same modified patient projections, but using different image thicknesses and kernels. As expected, the inserted lesion appeared smoother with thicker image thicknesses and use of the iterative reconstruction algorithm, reflecting the impact of reconstruction parameters. More importantly, the inserted lesion and the original lesion changed appearance in a similar fashion as reconstruction parameter varied.
4. DISCUSSION
Hybrid images have been widely used in the assessment of image quality. For 2D imaging such as radiography and mammography, because of the anatomical overlap, the hybrid images were mostly created by superimposing the lesions onto the images.16–19 For 3D imaging such as CT, the creation of hybrid images is much more challenging as the lesions need to be inserted into image volumes.1,2,9 Moreover, if the lesions are inserted via projection domain instead of image domain, many acquisition parameters need to be precisely simulated, including the energy spectrum of the x-ray and the movement of the focal spot, detector, and patient during the acquisition. This study developed such a projection-domain technique and demonstrated that the technique was capable of precisely simulating acquisition parameters and creating clinically realistic hybrid images.
Because our technique inserted lesions in the projection domain, it reflected the impact of reconstruction parameters on lesion appearance and can be used to study the impact of reconstruction parameters. Because our technique used patient projections and lesions segmented from patient images, the hybrid images demonstrated anatomical complexity typical of clinical images, which is difficult to achieve with projections simulated from anthropomorphic phantoms and mathematical lesions. These strengths enable a number of interesting opportunities. For example, virtual clinical trials could be conducted to evaluate and optimize reconstruction algorithms. Furthermore, the evaluation could be done task-specifically, i.e., with respect to specific lesion characteristics and lesion location, which is required for iterative reconstruction algorithm because multiple studies have shown that the performance of iterative reconstruction is task dependent.20–22 Another example involves the evaluation of radiation dose reduction. The lesion insertion program could be combined with a previously developed projection-domain noise insertion program23 to simulate positive cases at lower dose levels, such that the dose reduction potential can be assessed in a task-specific manner.
To improve the anatomical complexity of the hybrid images, patient projections instead of simulated phantom projections were used in this study. However, because the patient projections were decoded from commercial CT raw data with the assistance of the vendor, which is not a common research resource, our lesion-insertion technique might not be easily adopted by other research groups. A potential solution to this drawback is a projection data reference library being developed by our group, which includes patient projections acquired on commercial CT scanners but converted into an extended DICOM format.24 The format is open and vendor-neutral, such that the library can be accessed by the academic community and used for CT projection related research studies.
For observer studies conducted with hybrid images, it is important to precisely control the contrast of the inserted lesion relative to the background tissue. Therefore, a contrast level was assigned to the lesion prior to the insertion, which by default was the same contrast level as the original pathology. For example, if a lesion with a contrast of 50 HU was segmented from 80 kV images and inserted into 120 kV images, despite the tube voltage difference, the contrast of the inserted lesion would be maintained at 50 HU. However, if the user wishes the inserted the lesion to reflect the impact of tube voltage on CT number, the contrast of the lesion can be manually adjusted prior to the insertion.
This study used lesions segmented from patient data, such that the inserted lesion could be compared to the original pathology. One concern about using segmented lesions is that the lesion database might be limited (our current lesion library contains over 100 liver lesions and over 30 pulmonary nodules). However, the orientation, size, and contrast of the segmented lesions can all be adjusted to create new cases. Other lesion models, such as randomly generated mathematical lesions,1,5,18 could also be used by our lesion-insertion program, as long as the lesion model is voxelized. Another concern about using segmented lesions is that the segmented lesion inherits the noise and boundary blur from the original patient images and introduces them into the hybrid images (i.e., because the segmented lesion has already been imaged once, the forward projected inserted lesion has essentially been imaged twice). The inserted lesion therefore had slightly higher noise than the surrounding tissue and a slightly blurred boundary than the original pathology. We minimized the noise increment by minimizing the noise in the segmented lesion (the lesions for segmentation were reconstructed with iterative reconstruction). We minimized the boundary blur by preserving the edge of the segmented lesion (the lesions for segmentation were reconstructed with a medium sharp kernel). As shown by the six lesion pairs in Fig. 4, the noise increment and boundary blur are barely perceptible. Alternatively, future studies could use mathematical lesions to avoid such noise increment and boundary blur. However, the focus of this paper is the insertion of lesions segmented from patient images, not the creation of lesion models. A third concern about using segmented lesions is that the difference between the inserted lesions and the original pathology, albeit small, may bias the observer performance. However, our intention was not to replicate the original pathology, but to generate hybrid images having realistic looking lesions. In observer studies conducted with the hybrid images, inserted lesions will only be compared to inserted lesions, so that we expect negligible impact of potential bias.
An alternative to validating the forward-projection program with reconstructed images would be to validate the program with projection data, i.e., to compare the projection data simulated from the virtual ACR phantom to the physically acquired projection data. In this study, we chose to compare the reconstructed images because (1) it is hard to translate the differences observed in projection data into differences in reconstructed images, and (2) reconstructed images are what ultimately used for assessment of observer performance.
Although the visual validation of the lesion realism (Figs. 4 and 5) showed that the inserted lesions appeared similar to the original pathologies across varying reconstruction conditions, this quantitative validation of lesion realism in the form of an observer study included only six cases and is thus not statistically significant. To address this, a full-scale observer study was subsequently performed using radiologist readers.25 In that work, 51 lesion pairs (real and inserted) were evaluated by two board-certified radiologists in consensus using methods similar to those described in Sec. 2.C. The results showed that 49% (25/51) of lesion pairs were incorrectly classified (the inserted lesion being identified as the real lesion). Sixty-three percent (32/51) of lesion pairs were classified with a confidence level of 1 or 2, meaning that the radiologists identified the inserted lesion by randomly guessing. Even for the eight lesion pairs that were confidently classified by the radiologists (confidence level of 4 or 5), 38% (3/8) of them were still incorrectly classified.
To conclude, a framework has been developed for projection-domain insertion of lesions into commercial CT images, which could be expanded to all geometries of CT scanners. Compared to conventional image-domain methods, our method reflects the impact of scan and reconstruction parameters on lesion appearance. Compared to prior projection-domain methods, our method has the potential to achieve higher anatomical complexity because it uses clinical patient projections and real patient lesions.
ACKNOWLEDGMENTS
Research reported in this publication was supported by the National Institute of Biomedical Imaging and Bioengineering of the National Institutes of Health under Award Nos. U01EB017185 and R01EB017095. The content is solely the responsibility of the authors and does not necessarily represent the official views of the National Institutes of Health. The authors would like to thank Dr. Karl Stierstorfer for his assistance in decoding the commercial CT raw data. The authors would also like to thank Dr. Joel G. Fletcher, Dr. Jeff L. Fidler, and Ms. Maria M. Shiung for their help in the patient data collection and lesion segmentation.
APPENDIX A: ADJUSTMENT OF LESION MODEL VOXEL INTENSITY
The CT number of the lesion model is HUlesion. With the first adjustment, which aims to remove the tissue at the lesion-insertion location, the CT number of the lesion model becomes
where HUnewBG is the mean CT number of the background tissue at the location of insertion. With the second adjustment, which aims to adjust for the intensity difference between the lesion’s original location and the lesion’s insertion location, the CT number of the lesion model becomes
where HUoldBG is the mean CT number of the lesion’s original background (i.e., the background of the lesion before it is segmented). Assuming that the imaging/forward-projection process F{} and the reconstruction/filtered backprojection process B{} are inverse processes and both linear, the CT number of the inserted lesion can be calculated as
The contrast of the original lesion to the original background is
The contrast of the inserted lesion to the new background is
Because Cnew equals Cold, the lesion contrast is maintained the same after insertion.
APPENDIX B: ESTIMATION OF BEAM HARDENING CORRECTION ENERGY
Figure 6 illustrates estimation of the beam hardening correction energy through a calibration process. Forward projections are first calculated for {I0}, a set of phantom images acquired on a Siemens Definition Flash scanner. During the forward-projection process, the CT numbers of {I0} (in the units of HU) are converted into attenuation coefficients under an initial guess of the beam hardening correction energy. According to the definition of HU, the relation between the attenuation coefficients and the CT numbers of {I0} is
where μguess is the attenuation coefficient in the forward projections and Eguess is the initial guess of the beam hardening correction energy. The forward projections, formatted to match those of commercial CT raw data, and then reconstructed on a commercial CT scanner to get a new set of images named {I1}. The CT numbers of {I1} can be expressed as
where Escanner is the commercial beam hardening correction energy. This equation can be rewritten as
Given the CT numbers of {I0} and {I1} (measured from the images) and the attenuation coefficient of water at various energy levels (provided by National Institute of Standards and Technology26), the commercial beam hardening correction energy Escanner can be numerically solved. Note that in order to accurately estimate Escanner, the CT numbers in the equation above need to be minimally impacted by the image noise. Therefore, the CT number of a material (acrylic, polyethylene, or water) was averaged from multiple pixels (pixels within a circular region of interest with a diameter of 20 mm).
REFERENCES
- 1.Solomon J. and Samei E., “A generic framework to simulate realistic lung, liver and renal pathologies in CT imaging,” Phys. Med. Biol. 59, 6637–6657 (2014). 10.1088/0031-9155/59/21/6637 [DOI] [PubMed] [Google Scholar]
- 2.Li X., Samei E., Delong D. M., Jones R. P., Gaca A. M., Hollingsworth C. L., Maxfield C. M., Carrico C. W., and Frush D. P., “Three-dimensional simulation of lung nodules for paediatric multidetector array CT,” Br. J. Radiol. 82, 401–411 (2009). 10.1259/bjr/51749983 [DOI] [PubMed] [Google Scholar]
- 3.Madsen M. T., Berbaum K. S., Ellingson A. N., Thompson B. H., Mullan B. F., and Caldwell R. T., “A new software tool for removing, storing, and adding abnormalities to medical images for perception research studies,” Acad. Radiol. 13, 305–312 (2006). 10.1016/j.acra.2005.11.041 [DOI] [PubMed] [Google Scholar]
- 4.Hoe C. L., Samei E., Frush D. P., and Delong D. M., “Simulation of liver lesions for pediatric CT,” Radiology 238, 699–705 (2006). 10.1148/radiol.2381050477 [DOI] [PubMed] [Google Scholar]
- 5.Karantzavelos K., Shin H. O., Jordens S., King B., Ringe K., Hartung D., Wacker F., and von Falck C., “Development and evaluation of a software tool for the generation of virtual liver lesions in multidetector-row CT datasets,” Acad. Radiol. 20, 614–620 (2013). 10.1016/j.acra.2012.12.014 [DOI] [PubMed] [Google Scholar]
- 6.Chen B., Barnhart H., Richard S., Robins M., Colsher J., and Samei E., “Volumetric quantification of lung nodules in CT with iterative reconstruction (ASiR and MBIR),” Med. Phys. 40, 111902 (10pp.) (2013). 10.1118/1.4823463 [DOI] [PubMed] [Google Scholar]
- 7.Solomon J. and Samei E., “Quantum noise properties of CT images with anatomical textured backgrounds across reconstruction algorithms: FBP and SAFIRE,” Med. Phys. 41, 091908 (12pp.) (2014). 10.1118/1.4893497 [DOI] [PubMed] [Google Scholar]
- 8.Solomon J., Giraldo J. C. R., Stierstorfer K., Lin Y., and Samei E., “Towards virtual clinical trials: A framework for clinically relevant CT simulations,” Scientific Assembly and Annual Meeting of Radiological Society of North America, Chicago, IL, 2013, rsna2013.rsna.org/program/details/?emID=13019773, accessed September 25, 2015.
- 9.Xu J., Elshahaby F., Fuld M. K., Fung G. S. K., and Tsui B. M. W., “Application of task-based measures of image quality to evaluation of image reconstruction methods in x-ray CT,” in The Third International Conference on Image Formation in X-ray Computed Tomography (Salt Lake City, UT, 2014), pp. 25–28, see http://www.ucair.med.utah.edu/CTmeeting/ProceedingsCTMeeting2014.pdf. [Google Scholar]
- 10.Fung G. S. K., Stierstorfer K., Segars W. P., Taguchi K., Flohr T. G., and Tsui B. M. W., “XCAT/drasim: A realistic CT/human-model simulation package,” Proc. SPIE 7961, 79613D (2011). 10.1117/12.878034 [DOI] [Google Scholar]
- 11.Segars W. P., Mahesh M., Beck T. J., Frey E. C., and Tsui B. M., “Realistic CT simulation using the 4D XCAT phantom,” Med. Phys. 35, 3800–3808 (2008). 10.1118/1.2955743 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 12.Siddon R. L., “Fast calculation of the exact radiological path for a three-dimensional CT array,” Med. Phys. 12, 252–255 (1985). 10.1118/1.595715 [DOI] [PubMed] [Google Scholar]
- 13.Flohr T. G., Stierstorfer K., Ulzheimer S., Bruder H., Primak A. N., and McCollough C. H., “Image reconstruction and image quality evaluation for a 64-slice CT scanner with z-flying focal spot,” Med. Phys. 32, 2536–2547 (2005). 10.1118/1.1949787 [DOI] [PubMed] [Google Scholar]
- 14.McCollough C. H., Bruesewitz M. R., McNitt-Gray M. F., Bush K., Ruckdeschel T., Payne J. T., Brink J. A., and Zeman R. K., “The phantom portion of the American College of Radiology (ACR) computed tomography (CT) accreditation program: Practical tips, artifact examples, and pitfalls to avoid,” Med. Phys. 31, 2423–2442 (2004). 10.1118/1.1769632 [DOI] [PubMed] [Google Scholar]
- 15.Duan X., Wang J., Yu L., Leng S., and McCollough C. H., “CT scanner x-ray spectrum estimation from transmission measurements,” Med. Phys. 38, 993–997 (2011). 10.1118/1.3547718 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Chakraborty D. P., Breatnach E. S., Yester M. V., Soto B., Barnes G. T., and Fraser R. G., “Digital and conventional chest imaging: A modified ROC study of observer performance using simulated nodules,” Radiology 158, 35–39 (1986). 10.1148/radiology.158.1.3940394 [DOI] [PubMed] [Google Scholar]
- 17.Samei E., Flynn M. J., and Eyler W. R., “Simulation of subtle lung nodules in projection chest radiography,” Radiology 202, 117–124 (1997). 10.1148/radiology.202.1.8988200 [DOI] [PubMed] [Google Scholar]
- 18.de Sisternes L., Brankov J. G., Zysk A. M., Schmidt R. A., Nishikawa R. M., and Wernick M. N., “A computational model to generate simulated three-dimensional breast masses,” Med. Phys. 42, 1098–1118 (2015). 10.1118/1.4905232 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 19.Saunders R., Samei E., Baker J., and Delong D., “Simulation of mammographic lesions,” Acad. Radiol. 13, 860–870 (2006). 10.1016/j.acra.2006.03.015 [DOI] [PubMed] [Google Scholar]
- 20.Chen B., Christianson O., Wilson J. M., and Samei E., “Assessment of volumetric noise and resolution performance for linear and nonlinear CT reconstruction methods,” Med. Phys. 41, 071909 (12pp.) (2014). 10.1118/1.4881519 [DOI] [PubMed] [Google Scholar]
- 21.Yu L., Vrieze T. J., Leng S., Fletcher J. G., and McCollough C. H., “Technical note: Measuring contrast- and noise-dependent spatial resolution of an iterative reconstruction method in CT using ensemble averaging,” Med. Phys. 42, 2261–2267 (2015). 10.1118/1.4923998 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 22.Richard S., Husarik D. B., Yadava G., Murphy S. N., and Samei E., “Towards task-based assessment of CT performance: System and object MTF across different reconstruction algorithms,” Med. Phys. 39, 4115–4122 (2012). 10.1118/1.4725171 [DOI] [PubMed] [Google Scholar]
- 23.Yu L., Shiung M., Jondal D., and McCollough C. H., “Development and validation of a practical lower-dose-simulation tool for optimizing computed tomography scan protocols,” J. Comput. Assisted Tomogr. 36, 477–487 (2012). 10.1097/RCT.0b013e318258e891 [DOI] [PubMed] [Google Scholar]
- 24.Chen B., Duan X., Yu Z., Leng S., Yu L., and McCollough C. H., “Technical Note: Development and validation of an open data format for CT projection data,” Med. Phys. 42, 6964–6972 (2015). 10.1118/1.4935406 [DOI] [PMC free article] [PubMed] [Google Scholar]
- 25.Chen B., Ma C., Leng S., Yu L., Fidler J. L., Sheedy S. P., McCollough C. H., and Fletcher J. G., “Inserting realistic lesions into CT images: A valuable tool for optimization of CT image quality and radiation dose,” Scientific Assembly and Annual Meeting of Radiological Society of North America, Chicago, IL, 2015.
- 26.NIST, X-Ray Mass Attenuation Coefficients–Water, Liquid, available at http://physics.nist.gov/PhysRefData/XrayMassCoef/ComTab/water.html.