Abstract
We propose a novel metal artifact reduction method based on a fractional-order curvature driven diffusion model for X-ray computed tomography. Our method treats projection data with metal regions as a damaged image and uses the fractional-order curvature-driven diffusion model to recover the lost information caused by the metal region. The numerical scheme for our method is also analyzed. We use the peak signal-to-noise ratio as a reference measure. The simulation results demonstrate that our method achieves better performance than existing projection interpolation methods, including linear interpolation and total variation.
1. Introduction
Metal artifact reduction (MAR) is still one of the major challenges in X-ray computed tomography (CT) imaging [1–6]. For high density objects, such as a metal object, the severe attenuation of X-rays allows only a limited number of photos to reach the receiving CT array of sensors. As a result, streak artifacts appear in the reconstructed image after filtered back projection (FBP). The artifacts spread through the whole image, thereby contaminating the imaging quality.
Since the projection data of the metal regions are much larger than ordinary tissue projection data sets, we can assume that the segments of the sinogram with the metal projection data sets are dominated by the metal component only. Based on this assumption, we can deal with projection data of metal objects as lost information, using one of the two main categories of methods: projection interpolation methods [7–12] or iterative reconstruction methods [13–17]. After theoretical analysis, MAR methods based on iterative reconstruction have better reconstruction performance than projection interpolation methods, but they often incur high computational costs and are difficult to implement in current CT imaging systems. In this paper, we concentrate on projection interpolation methods for MAR. In 1978, Lewitt and Bates used a Chebyshev polynomial to implement interpolation [7]. Kalender et al. employed linear interpolation (LI) [8], while Crawford added various assistant processes based on it [9]. Also based on linear interpolation, Gu et al. presented a more accurate metal region segmentation method using the differences in neighboring pixels [10]. Zhao et al. proposed interpolating the wavelet coefficients of the projection data [11]. To obtain a better visual effect, inpainting based on partial differential equations (PDEs) was introduced in [12, 13]. The inpainting method proposed by Gu et al. is based on Euler's elastica and curvature [12]. Duan et al. introduced a classical image inpainting method based on total variation (TV) for MAR [13]. However, the existing PDE image inpainting method cannot connect a wide inpainting region smoothly, and therefore, if wide regions exist, it does not achieve satisfactory results.
In this paper, we propose a fractional-order curvature-driven diffusion (FCDD) MAR model based on our generalized image regularization framework [18]. First, we introduce the FCDD inpainting model. Then, we give the numerical scheme for our method. After presenting our simulation, we conclude this paper.
2. Method
The main steps in our algorithm are similar to those in conventional projection interpolation algorithms as shown in Figure 1.
The main difference between our method and the conventional projection interpolation methods lies in the step “correction for metal projection data.” When the metal damages the original projection data in the form of a gap, conventional methods apply interpolations [7, 8] or PDE inpainting [12, 13] algorithms to restore the data gap. But these conventional methods have some drawbacks. First, the gap boundaries after inpainting lack smoothness. Second, if the gap is wide, the inpainting results do not achieve satisfactory visual effects. The proposed CT MAR method is based on FCDD that can fix these flaws. This method achieves smoother results and can also cope with the artifacts caused by wide data gaps. In this section, we first introduce the well-known TV inpainting model, and then present our FCDD model. Finally, the numerical algorithm is given for our model.
2.1. Review of Classic TV Inpainting Model
Assume a standard image model defined as
(1) |
where u 0 is the original image, n is additive noise, and u is the contaminated image with noise.
Let Ω be the inpainting (open) domain with its boundary ∂Ω, and E an extended domain surrounding the ∂Ω such that ∂Ω lies within E ∪ Ω. The image inpainting model based on TV proposed by Chan and Shen [19] is followed here:
(2) |
The first term is the regularizing term for inpainting damaged domains, while the second term in the energy function is the data fidelity term that can keep important features and sharp edges when noise exists. λ Ω is a scale function to tune the weights of the two terms. According to variational theory, the Euler-Lagrange equation corresponding to (2) is
(3) |
with the Neumann boundary condition, ∂u/∂n = 0 on ∂Ω, where
(4) |
This model is inspired by the classic TV denoising model [20].
2.2. Proposed FCDD Inpainting Model
In the classical TV inpainting model, the conductivity coefficient of the diffusion strength, which only depends on the numerical value of the isophotes, is
(5) |
The geometric information of the isophotes is not considered, which is why a wide gap cannot be restored perfectly. Motivated by the methods in [21, 22], to recover from this situation, we use a new fractional-order conductivity coefficient instead of the old one:
(6) |
where f(·) is a function with the following property:
(7) |
If the isophote has a large fractional-order curvature, the diffusion strength is also large. In this paper, we choose f(s) = s. Thus, the Euler-Lagrange equation for the FCDD model is
(8) |
Here, the inpainting domain D is a mathematical open set, D c denotes the outer area of D, and u 0 is the available part of the image. The fractional-order curvature κ α is defined as
(9) |
2.3. Numerical Scheme
In this section, we apply a time marching scheme to our model. Assuming a time step size of Δt and a space grid size of h, we let
(10) |
The explicit scheme iterates as
(11) |
First, we describe the discretization of the fractional-order gradient operator ∇α and fractional-order Laplacian operator Δα using the Grümwald-Letnikov definition [23] in fractional calculus as the mask we proposed in [24, 25].
The α-order Grümwald-Letnikov definition-based fractional differential can be expressed as
(12) |
where the duration of signal s(x) is [a, x], α is any real number, and s(x − k((x − a)/N)) is the discrete sampling.
If N is big enough with a = 0, the limit symbol can be dispensed with and (12) is rewritten as
(13) |
To obtain the value of s(x + αx/2N − kx/N), we use Lagrange 3-point interpolation with s(x + x/N − kx/N), s(x − kx/N), and s(x − x/N − kx/N). Then, we obtain
(14) |
If k = n ≤ N − 1, from (13), the anterior n + 2 approximate backward differences of the fractional partial differentials on the negative x- and y-axes, respectively, are expressed as
(15) |
For simplicity, we only use fractional order masks in four directions for calculation, including positive x- and y-coordinates and negative x- and y-axes. Let D x+ α, D x− α, D y+ α, and D y− α denote the calculations in the four directions, as illustrated in Figure 2.
The coefficients of the masks in Figure 2 are given below:
(16) |
Thus, we get a discrete representation of each item
(17) |
where ε is a small positive number to prevent dividing by zero, the superscript indexes c, b, and f denote central, backward, and forward differences, respectively, and the minmod function satisfies
(18) |
3. Results
In this section, we present the experimental results of our FCDD model compared with the LI and TV models.
As there is no quantitative method to measure the performance of CT MAR [11], we apply the peak-signal to-noise ratio (PSNR), which is commonly used in image inpainting [26], as the available criterion
(19) |
Here, u is the image after inpainting and u 0 is the original image. The greater the value of the PSNR is, the better is the performance. PSNR is usually used to measure the similarity between an inpainted image and a real image, and as such it is a suitable reference.
Several concrete steps are followed in our method. First, because in this paper we focus on the inpainting algorithm, for simplicity, we only use the threshold method to extract the metal region. It is easy to say that a more accurate segmentation algorithm would enhance the performance of MAR. Second, we locate the corresponding metal regions in the projection data set. Third, we employ the FCDD algorithm to inpaint the metal regions. Finally, we reconstruct the image from the inpainted sinogram and insert the metal regions.
In the first experiment, while dealing with multiple metals, we compared the performance of FCDD against other methods. Five metal regions with much higher attenuation were added into the Shepp-Logan (S-L) phantom (256 × 256) to simulate the metal artifacts. The parameters are given in Table 1.
Table 1.
No. | τ | A | B | x | y | θ |
---|---|---|---|---|---|---|
1 | 1.0 | 0.920 | 0.6900 | 0 | 0 | 90 |
2 | −0.8 | 0.874 | 0.6624 | 0 | −0.0184 | 90 |
3 | −0.2 | 0.310 | 0.1100 | 0.22 | 0 | 72 |
4 | −0.2 | 0.410 | 0.1600 | −0.22 | 0 | 108 |
5 | 0.1 | 0.250 | 0.2100 | 0 | 0.3500 | 90 |
6 | 0.1 | 0.046 | 0.0460 | 0 | 0.1000 | 0 |
7 | 0.1 | 0.046 | 0.0460 | 0 | −0.1000 | 0 |
8 | 0.1 | 0.046 | 0.0230 | −0.08 | −0.6050 | 0 |
9 | 0.1 | 0.023 | 0.0230 | 0 | −0.6050 | 0 |
10 | 0.1 | 0.046 | 0.0230 | 0.06 | −0.6050 | 90 |
11 | 30.0 | 0.075 | 0.0500 | 0 | −0.4800 | 0 |
12 | 25.0 | 0.030 | 0.0250 | 0.25 | −0.6200 | 45 |
13 | 30.0 | 0.040 | 0.0300 | −0.45 | 0.5000 | 135 |
14 | 30.0 | 0.050 | 0.0400 | 0.45 | 0.2000 | 0 |
15 | 30.0 | 0.050 | 0.0450 | −0.42 | −0.3000 | 72 |
Figure 3 shows the results of the different algorithms, where Figure 3(a) gives the original phantom with a metal region while Figure 3(b) shows the phantom reconstructed from the projection data and containing severe metal artifacts. Figures 3(c) to 3(e) illustrate the results of LI, TV, and FCDD, respectively. In these figures, we can see that metal artifacts are suppressed to different degrees. Compared with LI and TV, FCDD achieves a better visual effect. The structure information (edges and shapes) in Figure 3(e) (α = 1.8) is the clearest. In particular, the shapes of the virtual organs are almost maintained, except that the TV method causes an artificial effect. Near the metal regions, the staircase effect is marked. The results of FCDD show the best performance with the highest PSNR. To explain the reason for this, we also give the sinograms after inpainting with these three methods in Figure 4.
When there are multiple metal regions, the gaps to be inpainted are much wider than a single metal region and there is much more missing information that needs to be interpolated. The classic interpolation methods only use the information in the same column for interpolation. The useful information is too scant to obtain an accurate result, as shown in Figure 4(a). As the TV and FCDD methods are 2D inpainting methods, they make use of not only the information in the columns, but also that in the rows and thus they obtain better results. However, TV has a flaw in dealing with wide regions, and the staircase effect occurs. The reason for this is that the order of TV is 2 and to obtain an accurate result, the order must be greater than 2 [27] but less than 4 [28]. In this experiment, we set α = 1.8 in FCDD, which means that the order approximates to 3 and thus the visual effects of inpainting sinograms of FCDD are superior.
Figure 5 gives the variation of the PSNR value with the order of the algorithm. If α = 1, the model is the same as in [22]. As the order increases, the PSNR value also increases. If α ≈ 1.8, the PSNR peaks and subsequently declines.
Figure 6 shows the clinical case of a patient with metal implants in both femurs. In this experiment, we do not know the original image, so we cannot choose α according to the PSNR. Based on the analysis in the previous experiment, we approximately set α = 1.8. Figure 6(a) shows the original image with dark, board streaks radiating from the metals. Figures 6(b) to 6(d) illustrate the reduction in the most severe artifacts using LI, TV, and FCDD, respectively. The dark streaks are not adequately suppressed in Figures 6(b) and 6(c), while fictitious artifacts caused by TV are visible in Figure 6(c). These disturbing artifacts are reduced to a large degree in Figure 6(d). Structural information previously invisible because of artifacts or the incomplete correction becomes visible.
4. Conclusion
A new MAR algorithm has been proposed based on the classic TV inpainting model. We replaced the conditional conductivity coefficient for TV with a new fractional-order curvature, and in comparison with linear interpolation and TV, our method obtained better quantitative results and visual effects.
To achieve the best performance for different images, the fractional order also needs to be different. Thus, future work will focus on the adaptive selection of the order of the algorithm.
Acknowledgments
This work was supported in part by the National Natural Science Foundation of China (60972131). The authors thank the anonymous reviewers for their comments, which have substantially improved the paper.
References
- 1.Hsieh J. Computed Tomography: Principles, Design, Artifacts, and Recent Advances. Bellingham, Wash, USA: SPIE Press; 2003. [Google Scholar]
- 2.Stradiotti P, Curti A, Castellazzi G, Zerbi A. Metal-related artifacts in instrumented spine. techniques for reducing artifacts in CT and MRI: state of the art. European Spine Journal. 2009;18(supplement 1):S102–S108. doi: 10.1007/s00586-009-0998-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Kondo A, Hayakawa Y, Dong J, Honda A. Iterative correction applied to streak artifact reduction in an X-ray computed tomography image of the dento-alveolar region. Oral Radiology. 2010;26(1):61–65. [Google Scholar]
- 4.Yazdia M, Gingras L, Beaulieu L. An adaptive approach to metal artifact reduction in helical computed tomography for radiation therapy treatment planning: experimental and clinical studies. International Journal of Radiation Oncology Biology Physics. 2005;62(4):1224–1231. doi: 10.1016/j.ijrobp.2005.02.052. [DOI] [PubMed] [Google Scholar]
- 5.Ebraheim NA, Coombs R, Rusin JJ, Jackson WT. Reduction of postoperative CT artifacts of pelvic fractures by use of titanium implants. Orthopedics. 1990;13(12):1357–1358. doi: 10.3928/0147-7447-19901201-06. [DOI] [PubMed] [Google Scholar]
- 6.Haramati N, Staron RB, Mazel-Sperling K, et al. CT scans through metal scanning technique versus hardware composition. Computerized Medical Imaging and Graphics. 1994;18(6):429–434. doi: 10.1016/0895-6111(94)90080-9. [DOI] [PubMed] [Google Scholar]
- 7.Lewitt RM, Bates RH. Image reconstruction from projections(III): projection completion methods. Optik. 1978;50(4):189–204. [Google Scholar]
- 8.Kalender WA, Hebel R, Ebersberger J. Reduction of CT artifacts caused by metallic implants. Radiology. 1987;164(2):576–577. doi: 10.1148/radiology.164.2.3602406. [DOI] [PubMed] [Google Scholar]
- 9.Crawford CR. Reprojection using a parallel backprojector. Medical Physics. 1986;13(4):480–483. doi: 10.1118/1.595950. [DOI] [PubMed] [Google Scholar]
- 10.Gu JW, Zhang L, Chen ZQ, Xing YX, Huang ZF. A method based on interpolation for metal artifacts reduction in CT images. Journal of X-Ray Science and Technology. 2006;14(1):11–19. [Google Scholar]
- 11.Zhao S, Robertson DD, Wang G, Whiting B, Bae KT. X-ray CT metal artifact reduction using wavelets: an application for imaging total hip prostheses. IEEE Transactions on Medical Imaging. 2000;19(12):1238–1247. doi: 10.1109/42.897816. [DOI] [PubMed] [Google Scholar]
- 12.Gu J, Zhang L, Yu G, Xing Y, Chen Z. X-ray CT metal artifacts reduction through curvature based sinogram inpainting. Journal of X-Ray Science and Technology. 2006;14(2):73–82. [Google Scholar]
- 13.Duan X, Zhang L, Xiao Y, Cheng J, Chen Z, Xing Y. Metal artifact reduction in CT images sinogram TV inpainting. In: Proceedings of the IEEE Nuclear Science Symposium Conference Record (NSS/MIC '08); October 2008; Dresden, Germany. pp. 4175–4177. [Google Scholar]
- 14.de Man B, Nuyts J, Dupont P, Marchal G, Suetens P. An iterative maximum-likelihood polychromatic algorithm for CT. IEEE Transactions on Medical Imaging. 2001;20(10):999–1008. doi: 10.1109/42.959297. [DOI] [PubMed] [Google Scholar]
- 15.Wang G, Snyder DL, O’Sullivan JA, Vannier MW. Iterative deblurring for metal artifact reduction. IEEE Transactions on Medical Imaging. 1996;15(5):657–667. doi: 10.1109/42.538943. [DOI] [PubMed] [Google Scholar]
- 16.Lemmens C, Faul D, Nuyts J. Suppression of metal artifacts in CT using a reconstruction procedure that combines MAP and projection completion. IEEE Transactions on Medical Imaging. 2009;28(2):250–260. doi: 10.1109/TMI.2008.929103. Article ID 4591397. [DOI] [PubMed] [Google Scholar]
- 17.Prell D, Kyriakou Y, Beister M, Kalender WA. A novel forward projection-based metal artifact reduction method for flat-detector computed tomography. Physics in Medicine and Biology. 2009;54(21):6575–6591. doi: 10.1088/0031-9155/54/21/009. [DOI] [PubMed] [Google Scholar]
- 18.Zhang Y, Pu Y, Hu J, Zhou J. A fractional framework for image inpainting. submitted to IET Image Process. [Google Scholar]
- 19.Chan TF, Shen J. Mathematical models for local nontexture inpaintings. SIAM Journal on Applied Mathematics. 2001;62(3):1019–1043. [Google Scholar]
- 20.Rudin LI, Osher S, Fatemi E. Nonlinear total variation based noise removal algorithms. Physica D. 1992;60(1–4):259–268. [Google Scholar]
- 21.Jun Z, Zhihui W. A class of fractional-order multi-scale variational models and alternating projection algorithm for image denoising. Applied Mathematical Modelling. 2011;35:2516–2528. [Google Scholar]
- 22.Chan TF, Shen J. Nontexture inpainting by curvature-driven diffusions. Journal of Visual Communication and Image Representation. 2001;12(4):436–449. [Google Scholar]
- 23.Oldham KB, Spanie J. The Fractional Calculus. New York, NY, USA: Academic Press; 1974. [Google Scholar]
- 24.Pu Y, Wang W, Zhou J, Jia H, Wang Y. Fractional derivative detection of digital image texture details and implementation of fractional derivative filter. Science in China Series F. 2008;38(12):2252–2272. [Google Scholar]
- 25.Pu YF, Zhou JL, Yuan X. Fractional differential mask: a fractional differential-based approach for multiscale texture enhancement. IEEE Transactions on Image Processing. 2010;19(2):491–511. doi: 10.1109/TIP.2009.2035980. Article ID 5340520. [DOI] [PubMed] [Google Scholar]
- 26.Russ JC. The Image Processing Handbook. 6th edition. Boca Raton, Fla, USA: CRC Press; 2011. [Google Scholar]
- 27.Bertalmío M, Bertozzi A, Sapiro G. Navier-Stokes, fluid dynamics, and image and video inpainting. In: Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, (CVPR '01); December 2001; pp. 355–362. [Google Scholar]
- 28.Bertalmío M. Strong-continuation, contrast-invariant inpainting with a third-order optimal PDE. IEEE Transactions on Image Processing. 2006;15(7):1934–1938. doi: 10.1109/tip.2006.877067. [DOI] [PubMed] [Google Scholar]