Comparison of Filtered Back Projection, Hybrid Iterative Reconstruction, Model-Based Iterative Reconstruction, and Virtual Monoenergetic Reconstruction Images at Both Low- and Standard-Dose Settings in Measurement of Emphysema Volume and Airway Wall Thickness: A CT Phantom Study

Abstract

Objective

To evaluate the accuracy of emphysema volume (EV) and airway measurements (AMs) produced by various iterative reconstruction (IR) algorithms and virtual monoenergetic images (VME) at both low- and standard-dose settings.

Materials and Methods

Computed tomography (CT) images were obtained on phantom at both low- (30 mAs at 120 kVp) and standard-doses (100 mAs at 120 kVp). Each CT scan was reconstructed using filtered back projection, hybrid IR (iDose⁴; Philips Healthcare), model-based IR (IMR-R1, IMR-ST1, IMR-SP1; Philips Healthcare), and VME at 70 keV (VME70). The EV of each air column and wall area percentage (WA%) of each airway tube were measured in all algorithms. Absolute percentage measurement errors of EV (APE_vol) and AM (APE_WA%) were then calculated.

Results

Emphysema volume was most accurately measured in IMR-R1 (APE_vol in low-dose, 0.053 ± 0.002; APE_vol in standard-dose, 0.047 ± 0.003; all p < 0.001) and AM was the most accurate in IMR-SP1 on both low- and standard-doses CT (APE_WA% in low-dose, 0.067 ± 0.002; APE_WA% in standard-dose, 0.06 ± 0.003; all p < 0.001). There were no significant differences in the APE_vol of IMR-R1 between low- and standard-doses (all p > 0.05). VME70 showed a significantly higher APE_vol than iDose⁴, IMR-R1, and IMR-ST1 (all p < 0.004). VME70 also showed a significantly higher APE_WA% compared with the other algorithms (all p < 0.001).

Conclusion

IMR was the most accurate technique for measurement of both EV and airway wall thickness. However, VME70 did not show a significantly better accuracy compared with other algorithms.

INTRODUCTION

Quantification of pulmonary emphysema and airway wall thickness using computed tomography (CT) is correlated with lung function and pathologic findings in chronic obstructive pulmonary disease (COPD) patients and even in normal subjects, and is also increasingly being used to quantify the features of COPD (1,2). Because radiation exposure is an obvious disadvantage of CT-based COPD quantification, various methods including iterative reconstruction (IR) have been developed to reduce radiation dose and maintain image quality.

Filtered back projection (FBP) reconstruction assumes that each pixel accurately indicates attenuation (3), however, FBP reconstruction impairs image quality due to large variations in these pixel values caused by noise. Among various IR, the use of hybrid IR (HIR) reduced image noise or artifacts, and improved image quality over FBP in low-dose chest CT (4,5,6). In recent studies, model-based IR (MIR), which is the latest development among reconstruction algorithms, also showed diagnostically acceptable images in low-dose chest CT which were better than HIR (6,7,8). Few studies have quantitatively examined emphysema volume (EV) or airway measurements (AMs) using IR in low-dose CT. The use of MIR seemed to provide the most accurate AMs (9). Meanwhile, emphysema measure was significantly different at HIR when compared to FBP (10), and low-dose CT images reconstructed with HIR dose reduction using three-dimensional processing could yield reliable emphysema quantification (11). However, AMs were not affected by HIR (10).

Meanwhile, introduction of spectral CT offers virtual monoenergetic images (VME), which allows materials in the scanned body to be rendered at photon energies as though the body was scanned with a monoenergetic X-ray beam of a desired kiloelectron volt (keV) level (12,13). This post-processing technique in spectral CT improves image quality and has been increasingly used for quantitative imaging (14,15). However, no studies have compared the effects of different IR and VME algorithms on quantitative measurements of emphysema and airway thickness.

Therefore, the aim of our study was to evaluate the accuracy of EV and AMs on the CT phantom produced by various IR methods and in VME images created at a fixed keV, at different radiation dose levels.

MATERIALS AND METHODS

Phantom

We used a commercially available phantom (CTP674 Lung phantom; The Phantom Laboratory, Salem, NY, USA) to simulate the human thorax. Characteristics of the phantom are described and shown in Table 1 and Figure 1. The physical phantom consisted of a central oval insert which simulates lung attenuation (250 × 150-mm) and an outer ring that simulates the surrounding soft tissue (350 × 250-mm). In the central oval insert, there are air columns of varying dimensions which simulates emphysema, six polycarbonate tubes which simulates airways of different dimensions, and angles and holes for the sterile water bottle. Among these, 9 air columns with three different diameters and volumes were chosen for the EV measurements (E1–E9), and three polycarbonate tubes (airway tubes) with different wall thicknesses and angles were analyzed for the airway wall measurements (A1–A3). Two airway tubes (A1 and A2) were positioned at a different angle of 30° from the z-axis of the CT couch.

Table 1. Characteristics of Each Air Column and Each Airway Tube Inserted into CTP674 Lung Phantom (The Phantom Laboratory).

Diameter (mm)	Air Columns for EV	Reference Volume (mm3)
30	E1	28.416
10	E2, E3, E4, E5	3.157
5	E6, E7, E8, E9	0.789

EV = emphysema volume, WA% = wall area percentage

Fig. 1. Illustration and CT images of CTP674 lung phantom (The Phantom Laboratory).

A. Illustration of CTP674 lung phantom. Nine air columns with three different diameters and volumes were chosen for EV measurements (E1–E9), and three polycarbonate tubes (airway tubes) with different wall thicknesses and angles were analyzed for airway wall measurements (A1–A3). Two airway tubes (A1 and A2) were placed at different angle of 30° from z-axis of CT couch. B. CT scans with various algorithms at low-dose setting. C. CT scans with various algorithms at standard-dose setting. CT = computed tomography, EV = emphysema volume, FBP = filtered back projection, IMR-R1 = MIR with image definition of body routine level 1, IMR-SP1 = MIR with image definition of sharp plus level, IMR-ST1 = MIR with image definition of body soft tissue level 1, MIR = model-based iterative reconstruction, VME70 = standard virtual monoenergetic dataset at 70 keV

CT Image Acquisition

All CT images, from the phantom, were obtained on a Philips IQon 128-slice spectral CT (Philips Healthcare, Cleveland, OH, USA). The acquisitions were carried out using two different radiation dose levels: low dose (30 mAs at 120 kVp) and standard-dose (100 mAs at 120 kVp). The dose on low-dose CT was 69.5% less than that on standard dose CT. Radiation dose of low-dose CT was as follows: volume CT dose index (CTDIvol), 2.7 mGy; dose-length product (DLP), 25.4 mGy; effective dose (k: 0.014), 0.36 mSv. Radiation dose of standard-dose CT was as follows: CTDIvol, 9 mGy; DLP, 84.3 mGy; effective dose (k: 0.014), 1.18 mSv.

Static scan parameters were 64 × 0.625-mm collimation, 40-mm beam width, 0.67-mm slice thickness, 1.08 pitch, and a rotation time of 0.75 seconds.

Image Reconstruction Techniques

A series of CT scans with two radiation dose settings were reconstructed with FBP, HIR (iDose⁴; Philips Healthcare), MIR (IMR; Philips Healthcare), and a VME created at a fixed keV (Fig. 1). For iDose⁴, level 4 was used with a reconstruction filter B. With IMR image, sharpness is controlled by the “Image Definition” setting instead of filter kernel. For IMR, level 1 was used with three different image definitions: body routine (IMR-R1), body soft tissue (IMR-ST1), and sharp plus (IMR-SP1). For VME, a standard virtual monoenergetic dataset at 70 keV (VME70) was calculated and level 4 was used with reconstruction filter B. The 70 keV was chosen to be equivalent to 120 kVp, which is standard algorithm for CT angiography examinations at our institution. Also, it is known that monochromatic images from 70 keV produce similar CT numbers of the subcutaneous fat which are comparable to 120 kVp polychromatic results.

Among these six reconstructions, FBP, iDose⁴, IMR-R1, IMR-ST1, and VME70 were used for EV analysis, and FBP, iDose⁴, IMR-R1, IMR-SP1, and VME70 were used for the airway wall measurement. Therefore, five datasets for each radiation dose and emphysema/airway measurement were reconstructed.

Emphysema Volume Measurements and Airway Wall Measurements

All measurements were performed by a technician using a commercial software (Aview, Coreline Soft, Seoul, Korea). To measure the EV, automatic segmentation and volume quantification were performed by clicking on each air column. A threshold of −950 HU was used to define emphysema in the air columns. For correctly selected and segmented air columns, the volume of each air column was recorded. For AM, the airway wall area (WA) and the luminal area (LA) were measured. Then, the WA percentage (WA%) was calculated as follows: WA / (WA + LA). Finally, five calculated WA% were obtained using five LA and WA measurements at randomly selected five locations. Correctness of the lesion segmentation and selection was inspected visually and there was no manual correction. For the analysis of the difference between measurements in each algorithm and reference measurements, the absolute percentage measurement error of EV (APE_vol) and WA% (APE_WA%) was calculated. The APE_vol or APE_WA% was calculated as follows: |measurement in each algorithm - reference measurement| × 100 / reference measurement. The APE_vol or APE_WA% was expressed as mean ± standard deviation.

Statistical Analysis

Repeated measures analysis of variance (ANOVA) was performed on the repeated measured data. The Bonferroni method for confidence interval adjustment was used to compare the main effects. If the sphericity assumption for ANOVA was not met, and then the p value from the Greenhouse-Geisser correction was used instead. A p value of less than 0.05 indicated statistical significance. All statistical analyses were performed using SPSS (version 20; IBM Corp., Armonk, NY, USA).

RESULTS

Accuracy of Emphysema Volume

The APE_vol of across all air columns (all of 5-, 10-, and 30-mm air columns) was significantly lower when IMR-R1 was used for reconstruction in both low-dose (p < 0.001) and standard-dose CT (p < 0.001) (Fig. 2). Also, the APE_vol of each column (each 5-, 10-, and 30-mm air column) was significantly lower when IMR-R1 was used in both low-dose and standard-dose (all p < 0.05) (Table 2, Fig. 3). The mean APE_vol decreased as the volume of air columns increased in all reconstruction algorithms and in both low-dose and standard-dose CT (all p < 0.01). VME70 showed significantly lower APE_vol than FBP (p = 0.003), but showed significantly higher APE_vol than iDose⁴, IMR-R1, and IMR-ST1 (all p < 0.004).

Fig. 2. APE_vol of across all air columns (all of 5-, 10-, and 30-mm air columns) on (A) low-dose CT and (B) standard-dose CT.

Mean APE_vol in all air columns was lowest in IMR-R1 in both low-dose and standard-dose settings. APE = absolute percentage measurement error, APE_vol = APE of EV

Table 2. APE_vol according to Different Air Columns, CT Tube Current, and Reconstruction Algorithms.

Air Column Diameter	FBP		iDose4		IMR-R1		IMR-ST1		VME70		P†
	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose
Across all air columns	0.105 ± 0.003	0.082 ± 0.002*	0.086 ± 0.002	0.078 ± 0.003	0.053 ± 0.002	0.047 ± 0.003	0.065 ± 0.002	0.058 ± 0.003	0.094 ± 0.003	0.081 ± 0.002	< 0.001	< 0.001
5 mm	0.207 ± 0.004	0.165 ± 0.004*	0.176 ± 0.004	0.159 ± 0.004*	0.107 ± 0.008	0.097 ± 0.004	0.128 ± 0.004	0.118 ± 0.005	0.187 ± 0.006	0.160 ± 0.004*	0.015	0.019
10 mm	0.090 ± 0.004	0.069 ± 0.004*	0.071 ± 0.004	0.064 ± 0.004	0.047 ± 0.003	0.039 ± 0.004	0.058 ± 0.004	0.050 ± 0.005	0.080 ± 0.006	0.069 ± 0.004	0.042	0.021
30 mm	0.019 ± 0.004	0.011 ± 0.004	0.012 ± 0.004	0.011 ± 0.004	0.006 ± 0.003	0.004 ± 0.004	0.009 ± 0.004	0.007 ± 0.005	0.015 ± 0.006	0.013 ± 0.004	< 0.001	< 0.001

APE_vol are expressed as mean ± standard deviation. ^*Showing significant difference between APE between low dose and standard dose (p < 0.05), ^†Showing significant difference between reconstruction algorithms. APE = absolute percentage measurement error, APE_vol = APE of EV, CT = computed tomography, FBP = filtered back projection, IMR-R1 = body routine level 1, IMR-ST1 = body soft tissue level 1, VME70 = standard virtual monoenergetic dataset at 70 keV

Fig. 3. APE_vol of each column (each 5-, 10-, and 30-mm) on (A) low-dose CT and (B) standard-dose CT.

Mean APE_vol in all air columns was lowest in IMR-R1 in both low-dose and standard-dose settings. Mean APE_vol decreased as volume of air columns increased.

There were also significant differences in APE_vol between IMR-R1 and each algorithm in 5-mm and 10-mm air columns on both low-dose and standard-dose CT (Fig. 4). However, the APE_vol of the largest air column volume (30-mm air column) showed significant differences only between IMR-R1 and FBP and between IMR-R1 and iDose⁴, whereas there were no significant differences between IMR-R1, IMR-ST1, and VME70 on low-dose and standard-dose CT.

Fig. 4. Mean APE_vol in each air column on (A) low-dose CT and (B) standard-dose CT.

Significant differences in APE_vol from IMR-R1 are marked with an asterisk (^*).

The lowest mean APE_vol is shown in IMR-R1 at a standard dose, follow by IMR-R1 at a low dose, IMR-ST1 at a standard dose, and IMR-ST1 at a low dose. There were no significant differences in mean APE_vol of all the air columns between IMR-R1 at a low dose and a standard dose (all p > 0.05).

Accuracy of Airways Measurement

The APE_WA% of across all airway tubes (all of A1, A2, and A3 airway tubes) was significantly lower when IMR-SP1 was used for reconstruction in both low-dose (p < 0.001) and standard-dose CT (p < 0.001) (Fig. 5). The APE_WA% of each airway tube (each A1, A2, and A3 airway tube) was also significantly lower when IMR-SP1 was used for reconstruction on both low-dose and standard-dose CT (all p < 0.05) (Table 3, Fig. 6). The mean APE_WA% increased as the WA% of airway tubes decreased in all reconstruction algorithms and in both low-dose and standard-dose CT (all p < 0.01). There were no significant differences in the mean APE_WA% between different axes in all reconstruction algorithms and in both low-dose and standard-dose CT (A1 and A2, all p > 0.05). There were significant differences in APE_WA% between IMR-SP1 and the other algorithms in all the airway tubes in both low-dose and standard-dose CT (Fig. 7). VME70 showed significantly higher APE_WA% compared with IMR-R1 and IMR-SP1 in both low-dose and standard-dose CT (all p < 0.001).

Fig. 5. APE_WA% of across all airway tubes (all of A1, A2, and A3 airway tubes) on (A) low-dose CT and (B) standard-dose CT.

Mean APE_WA% of across all airway tubes was lowest in IMR-SP1 in both low-dose and standard-dose settings. Mean APE_WA% decreased as WA% increased. APE_WA% = absolute percentage measurement error of wall area percentage, WA% = wall area percentage

Table 3. APE_WA% according to Different Air Columns, CT Tube Current, and Reconstruction Algorithms.

Airway Tube	FBP		iDose4		IMR-R1		IMR-SP1		VME70		P†
	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose	Low Dose	Standard Dose
Across all airway tubes	0.242 ± 0.002	0.221 ± 0.001*	0.242 ± 0.001	0.221 ± 0.001*	0.151 ± 0.002	0.158 ± 0.001*	0.067 ± 0.002	0.060 ± 0.003*	0.251 ± 0.002	0.221 ± 0.001*	< 0.001	< 0.001
A1	0.210 ± 0.003	0.190 ± 0.002*	0.209 ± 0.003	0.190 ± 0.002*	0.113 ± 0.003	0.112 ± 0.002	0.014 ± 0.003	0.011 ± 0.004	0.218 ± 0.003	0.190 ± 0.003*	0.003	0.011
A2	0.190 ± 0.003	0.168 ± 0.002*	0.189 ± 0.003	0.168 ± 0.002*	0.096 ± 0.003	0.108 ± 0.002*	0.010 ± 0.003	0.013 ± 0.004	0.202 ± 0.003	0.168 ± 0.003*	0.029	0.045
A3	0.327 ± 0.003	0.306 ± 0.002*	0.327 ± 0.003	0.305 ± 0.002*	0.243 ± 0.003	0.253 ± 0.002*	0.176 ± 0.003	0.156 ± 0.004*	0.334 ± 0.003	0.306 ± 0.003*	0.016	0.032

APE_WA% are expressed as mean ± standard deviation. ^*Showing significant difference between APE between low dose and standard dose (p < 0.05), ^†Showing significant difference between reconstruction algorithms. APE_WA% = absolute percentage measurement error of wall area percentage, IMR-SPI = sharp plus level 1

Fig. 6. Absolute percentage measurement error of each airway tube (each A1, A2, and A3 airway tube) on (A) low-dose CT and (B) standard-dose CT.

Mean APE_WA% decreased as WA% increased.

Fig. 7. Mean APE_WA% in each airway tube on (A) low-dose and (B) standard-dose CT.

Significant differences in APE_WA% from IMR-SP1 are marked with asterisk (^*).

The mean APE_WA% of the airway tube with a lower WA% (A3) was significantly lower in IMR-SP1 at the standard dose than at the low dose (p = 0.046), although there were no significant differences in the mean APE_WA% of two airway tubes which had same WA% but different axes (A1 and A2) between low-dose and standard-dose IMR-SP1 (all p > 0.05).

DISCUSSION

Our study demonstrated that IMR was the most accurate modality for measurement of both EV and airway wall thickness. However, VME70 did not show significantly better accuracy compared with other algorithms.

There have been few studies that compared MIR with FBP and HIR for emphysema detection and accurate measurement of EV and airway thickness (9,16,17). Choo et al. (9) demonstrated that IR could affect quantitative measurements of lung and airways: MIR seemed to provide the most accurate emphysema and AMs, compared with FBP and adaptive statistical IR. Therefore, they emphasized that care should be taken in selecting the appropriate IR algorithms. However, this study was limited by the fact that there was no reference for emphysema quantification. Gomez-Cardona et al. (16) showed that the optimal reconstruction algorithm for airway thickness measurement was MIR using an airway phantom. In their study, MIR enabled a significant reduction in both the relative bias and angular standard deviation of airway wall thickness.

Our study also showed that MIR provided the most accurate measurement values for both EV and airway wall thickness. Among MIR, EV was the most accurate in the IMR-R1 algorithm, whereas airway wall thickness was the most accurate in the IMR-SP1 algorithm. We used three different image definitions for MIR in this study: body routine (IMR-R1) and body soft tissue (IMR-ST1) for EV analysis, and body routine (IMR-R1) and sharp plus (IMR-SP1) for airway wall thickness. Body routine (IMR-R1) was the closest to filter B, which was used for FBP and HIR in our study. As sharp kernels are usually employed for lung parenchyma, image noise is too high at reduced dose levels; therefore, a soft tissue filter (filter B or IMR-R1) is recommended by the vendor and is routinely used for both soft tissue and parenchyma analyses (17,18). In the measurement of airway wall thickness, a sharp filter provided the most accurate value, which is recommended for analysis of airway thickness by the vendor. Our study revealed the usefulness of these filters in IMR for accurate measurement of EV and airway wall thickness. There have not been any previous articles on filter differences in IMR. We recommend use of these filters when analyzing EV or airway wall thickness using IMR.

We found no significant differences between IMR-R1 and IMR-ST1 or VME70 when measuring the 30-mm air column, whose volume was 28.416 mm³, although there were significant differences between IMR-R1 and FBP or iDose⁴. However, IMR-R1 had significantly different accuracy from the other algorithms when measuring the 5-mm and 10-mm air columns; the EVs were 0.789 mm³ and 3.157 mm³, respectively. These results demonstrate that IMR-R1, IMR-ST1, or VME70 could be used when the EV was larger than 28.416 mm³, but IMR can measure more accurate values when the EV is smaller than 3.157 mm³. It is important to measure small-volume emphysema accurately to understand the distribution of the low-attenuation areas in the emphysema quantification study, in addition to accurately measuring the EV (19,20,21). Such information is useful for classification or monitoring of patients with emphysema.

The major concern in CT quantification of EV and airway wall thickness is exposure to radiation, and these patients are more likely to undergo multiple CT scans than other patients. Our study showed that there was no significant difference in EV measurements between standard-dose and low-dose CT using IMR. Therefore, the EV could be followed with low-dose CT reconstructed with IMR. However, airway wall measurements for airways with a WA% of 40.83 or less (WA% of A3 was 40.83) may be inaccurate if low-dose CT is used, even though MIR is used. Therefore, when attempting to perform low-dose CT quantification, the reconstruction algorithm should be appropriately reconstructed.

Our study also demonstrated the measurement accuracy of EV and airway wall thickness in the VME70 algorithm, which is known to reduce metallic artifact and improve image quality. However, no studies have yet shown CT quantification in VME. Disappointingly, the VME did not appear suitable for CT quantification of EV and airway wall thickness.

Our study has several limitations. First, there are inherent limitations of phantom studies. All air columns and airway tubes were cylindrical in shape within a chest phantom, eliminating complicating factors in real clinical situations such as different emphysema morphology, breathing and cardiac motion artifacts, and different body sizes. Therefore, further clinical studies will be needed. Second, the number of air columns and airway tubes was limited. We believe that a larger number of air columns and airway tubes with various diameters and wall thicknesses are required for more precise evaluation of measurement feasibility. Third, we only observed the at the 70-keV setting, but we were not able to study what the impact would be in other keV settings. Therefore, further research from this perspective will be needed in the future.

In conclusion, IMR significantly improves the accuracy of emphysema and AMs compared with FBP and HIR in both low-dose and standard-dose CT. The EV was most accurate in IMR-R1, and the airway wall thickness was most accurately measured in IMR-SP1. However, VME70 did not result in any improvement of measurement accuracy.