Skip to main content
Elsevier - PMC COVID-19 Collection logoLink to Elsevier - PMC COVID-19 Collection
. 2022 Aug 2;148:105934. doi: 10.1016/j.compbiomed.2022.105934

Genetic algorithm based image reconstruction applying the digital holography process with the Discrete Orthonormal Stockwell Transform technique for diagnosis of COVID-19

Gülhan Ustabaş Kaya 1, Tuğba Özge Onur 1,
PMCID: PMC9344740  PMID: 35961086

Abstract

World Health Organization has described the real-time reverse transcription-polymerase chain reaction test method for the diagnosis of the novel coronavirus disease (COVID-19). However, the limited number of test kits, the long-term results of the tests, the high probability of the disease spreading during the test and imaging without focused images necessitate the use of alternative diagnostic methods such as chest X-ray (CXR) imaging. The storage of data obtained for the diagnosis of the disease also poses a major problem. This causes misdiagnosis and delays treatment. In this work, we propose a hybrid 3D reconstruction method of CXR images (CXRI) to detect coronavirus pneumonia and prevent misdiagnosis on CXRI. We used the digital holography technique (DHT) for obtaining a priori information of CXRI stored in created digital hologram (CDH). In this way, the elimination of the storage problem that requires high space was revealed. In addition, Discrete Orthonormal S-Transform (DOST) is applied to the reconstructed CDH image obtained by using DHT. This method is called CDH_DHT_DOST. A multiresolution spatial-frequency representation of the lung images that belong to healthy people and diseased people with the COVID-19 virus is obtained by using the CDH_DHT_DOST. Moreover, the genetic algorithm (GA) is adopted for the reconstruction process for optimization of the CDH image and then DOST is applied. This hybrid method is called CDH_GA_DOST. Finally, we compare the results obtained from CDH_DHT_DOST and CDH_GA_DOST. The results show the feasibility of reconstructing CXRI with CDH_GA_DOST. The proposed method holds promises to meet demands for the detection of the COVID-19 virus.

Keywords: Image reconstruction, Digital holography, Discrete Orthonormal Stockwell Transform, COVID-19, Genetic algorithm

1. Introduction

COVID-19 spread rapidly all over the world after its discovery in China’s Hubei province in December 2019. Since the infectious disease appeared in Wuhan, it has had a huge global impact. Therefore, isolation of patients by establishing an early diagnosis has been an important step in controlling the spread of the disease. For the diagnosis of COVID-19, viral RNA is identified in a reverse transcriptase-polymerase chain reaction (RT-PCR) with laboratory tests. Because, such viruses are composed of RNA rather than DNA, and for these viruses, RNA must be converted to DNA before they are replicated [1]. COVID-19 virus is one such virus. However, researches indicate that the symptoms of COVID-19 were not specific and did not always provide an accurate diagnosis. Additionally, RT-PCR testing has proven to be both slow and unreliable in the early stages of the COVID-19 outbreak [1]. In studies conducted in China, the sensitivity of the swab test was proven to be as low as 30%, and this finding was consistent with the RT-PCR test of liquid samples  Aljondi and Salem, 2020, Altmayer et al., 2020.

On the other hand, in the early diagnosis and the treatment planning for all patients of the COVID-19 pandemic, computed tomography (CT), ultrasound, chest X-ray imaging, etc. methods play a very important role in imaging modalities considered Aljondi and Salem, 2020, Wang et al., 2020.

For instance, CT is explained as highly sensitive to detect cases such as the swab misses [3]. It is claimed that CT has higher sensitivity (over 90%) and real-time results occur at the risk of increased false positives. Therefore, medical imaging techniques have emerged as a useful tool in diagnosis. For instance, with a CT scan, doctors can diagnose a COVID-19 infection that goes deep into the lungs and may have been overlooked with a swab test. However, there can be some disadvantages of CT imaging. According to the American College of Radiology, the specificity of CT scans for COVID-19 appears to be a problem because it can overlap with the findings for influenza, seasonal flu, pneumonia, and lung problems caused by other types of infections [3]. In the study conducted by Thomas and Robert Kwee, it was shown that a negative CT result does not definitely rule out COVID-19. Furthermore, they found that a significant number of false-positive chest CT scan results were obtained due to overlapping imaging with many other diseases or other viral pneumonia [5]. In this case, imaging indications are not specific enough to confirm COVID-19 and may only indicate signs of infection. Additionally, since some of the radiation passing through a body is absorbed, in a CT scan the patients, especially the younger patients, are exposed the excessive radiation. Because in particular children or younger persons are more radiosensitive than adults [6]. Therefore, in this method, there have been several scanner disinfection procedures that have to be done [7].

On the other hand, as for that chest X-ray imaging (CXRI), most hospitals use CXRI as the first-line method that allows the initial assessment of patients. Because in this method, the movement of patients is reduced. The risk of cross-infection is minimized by using portable X-ray units Giovagnoni, 2020, Subir, 2020. The CXRI method gives faster results compared to the RT-PCR mentioned above. In addition to these features, since the CXRI method is cheaper, easier, and less harmful, it is also preferred more than the CT scans [10]. Thanks to these advantages, CXRI can guide the differential diagnosis to other possible pulmonary parenchymal causes other than COVID-19 infection [11]. However, the disadvantage of the CXRI is adjusting the proper position between the patient and the film. If the distance between the source of the X-ray and the object is not far enough, the distortion of the object can occur. On the other hand, when the object is further from the source, it gets smaller and sharper. This means that in CXRI, magnification and sharpness depending on the distance between the X-ray source and the chest. Thereby, this focusing problem in the CXR images may cause misdiagnosis and delay treatment. However, it is possible to obtain 3D information about the obtained CXR images by applying the digital holography technique. Thus, even if there is a focusing problem in the CXR images, detailed data about the infection or chest can be obtained and an accurate diagnosis can be made. Since all human visual cues such as stereopsis and eye focusing are accounted for by holography, it can be considered to be the ultimate display technology. Since the complete and focused image of the object can be achieved with digital holography, the obtained phase, amplitude, and frequency information allows for characterizing the infection by giving detailed information about the CXR image.

Digital holography has been a widely applied technique to record and reconstructed numerically the objects with 3D information. DH records 3D objects in a two-dimensional (2D) pattern and retrieves numerically using a computer the phase and the intensity of the sample from the recorded holograms. The reconstruction process is performed computer-driven numerically [12]. Since the DH technique was first proposed by Goodman and Lawrence, it has been successfully applied in a wide range of different applications such as surface contouring, particle analysis, microscopy, 3D information processing and etc. Zhang, 2006, Micó et al., 2008, Yu et al., 2014, Tahara et al., 2018. The purpose of digital holography is not just to retrieve 3D information. At the same time, the quality and resolution of the reconstructed image are expected to be high. In this context, various methods are performed to increase the image quality and resolution of the images obtained from holograms. For instance, Nomura et al. improved the image quality by superposing the reconstructed images obtained by using different wavelengths [16]. Claus et al. utilized the subpixel sampling method to improve the optical resolution for image quality and phase measurement accuracy [17]. Verrier and Fournier improved the reconstruction process of the recorded holograms, where they predict the characteristic parameters and position of the objects, by utilizing the information redundancy of videos [18]. Furthermore, Funamizu et al. used the spatial correlation features of speckle patterns to increase the spatial resolution required in digital holographic microscopy (DHM) [19]. In addition to all these methods presented in the literature, the Discrete Orthonormal Stockwell Transform (DOST) method can be used to provide the multiresolution in the spatial frequency domain of a signal or image [20]. High-accurate retrieved images can be obtained by using the DOST technique which makes reconstruction more convincing. However, since lower frequencies are subsampled in the DOST technique, it is important that its coefficients are properly distributed. So, in order to provide this distribution, a set of orthogonal unit-length basis vectors, which target a particular region in the time–frequency domain, are constructed by choosing the center of each frequency band, the width of that band, and location in time suitably. We provide solutions to these types of problems in this work which develops a novel method of image reconstruction by using the CDH_GA_DOST technique. In recent years GAs have been widely used for the applications of image reconstruction [21]. Since it requires only to define a genetic representation of the solution domain, it is an easy-to-use algorithm and can be thought as a minimizing problem. The purpose of the genetic algorithm is to find the smaller fitness value that corresponds to the fitter individual. In this paper, we develop an image reconstruction method in digital holography to prevent misdiagnosis on CXR images [22] and confusion of COVID-19 virus with influenza, seasonal flu, etc. infections. A hologram is created by using the CXR images obtained from the database [22]. The CDH_GA_DOST technique is used to increase the quality and the resolution of the images reconstructed from these holograms. In addition, by using digital holography and the genetic algorithm in the reconstruction process, the problem of selecting appropriate parameters encountered in the DOST technique will be overcome. The reconstructed images were obtained by applying the CDH_GA_DOST method and the normalized and centered 2D Fast Fourier Transform (2D-FFT) images are compared. Even though the DOST technique has been used in image compression for a long time, it is can be used for parameterizing the reconstructed image [23]. By applying the CDH_GA_DOST technique, matrices related to amplitude and phase are created. As a result of the application of this technique, the multiresolution images are retrieved. It has been done a performance comparison in the presence of the CXR images for persons with and without the COVID-19 virus. In order to prove the accuracy of the results obtained and to show the advantages of using reconstructed hologram images, the mentioned above algorithms were applied both directly to the CXR images and to the created holograms of these images. The main novelties and contributions are listed as follows.

  • We devise digital holography for the first time to promote the diagnosis of COVID-19 from CXR images.

  • The storage problem that requires high space for CXR image is eliminated by using CDH.

  • We devise to combine the genetic algorithm with DOST method and so that the reconstruction process became a minimizing problem. Therefore, a robust reconstructed image is obtained with the optimization algorithm.

  • Different from original CXR images, we devise multiresolution images.

  • We devise the ability to obtain 3D information on phase and amplitude.

Section 2 reviews related works and highlights the difference of the proposed method in this paper from other methods in the literature. In Section 3, the detailed information about image acquisition by using digital holography via simulation, the proposed CDH_GA_DOST technique and the dataset is reviewed. Section 4 is devoted to the framework of the reconstruction and simulation results. CXR images of COVID-19 and viral pneumonia cases are analyzed. In Section 5, the reconstruction with digital holography examples of CXR images of persons with and without the COVID-19 virus are presented. Throughout Section 5, we compare the performance of applying digital holography to CXR images by calculating the mean squared error, mean absolute error, peak signal-to-noise ratio, and structural similarity and evaluate the results. Finally, the concluding remark is included.

2. Related works and motivation

There have been various researches based on designing artificial intelligence (AI) models to diagnose COVID-19 via CXRI have been published in the literature. Wang et al. designed a model that includes two-dimensional fractional Fourier entropy and deep stacked sparse autoencoder (DSSAE). They achieved 92.32% success in detecting COVID-19 by handling a four-class problem [24]. Besides this study, Wang et al. developed a deep rank-based average pooling network (DRAPNet) model to recognize COVID-19 and they proved that their model is effective in distinguishing COVID-19 from other infectious diseases [25]. Ismael and Şengür used pre-trained deep convolutional neural network (CNN) models to classify COVID-19 and healthy CXR images. They achieved 92.6% success in classifying by using the ResNet50 model [26]. Toraman et al. [27] proposed a convolutional CapsNet to perform the detection of COVID-19 based on CXRI and their method yielded a 97.24% accuracy rate for binary classification. Sobahi et al. [28] developed an attention-based 3D CNN model with residual connections and they used binary and multiclass classifications for ECG-based COVID-19 detection. The authors attained 99.0% and 92.0% accuracy for binary and multiclass classifications, respectively.

However, in the studies mentioned above, although AI models have been designed for the detection of COVID-19 using images obtained from CXR, alternative imaging, image acquisition or reconstruction methods are not presented to eliminate the problems in the imaging phase of CXR. Therefore, in this paper, digital holography which provides to obtain 3D information on phase and amplitude is proposed for the first time to promote the diagnosis of COVID-19 from CXR images. In addition, unlike existing studies in the literature, a robust reconstructed image is obtained by combining genetic algorithm and DOST method. Thanks to the method proposed in this study, both multiresolution and robust reconstructed CXR images can be obtained with the use of hologram or genetic algorithm and DOST methods. Thus, this paper does not study classification like previous papers, it proves the feasibility of reconstructing images of CXR with DOST_GA method to meet demands for detection of COVID-19 virus.

3. Materials and methods

Image compression techniques are applied to remove excess information from the images without losing image quality and information. Thus, basic information can be extracted by transformation techniques that can be reconstructed to retrieve the images to an acceptable level to human eyes [29]. Images have been processed by using various techniques, such as predictive image coding, scalar/vector quantization, and transform algorithms [30]. Among these techniques transform algorithms, which are Discrete Cosine Transform (DCT), Discrete Orthogonal Stockwell Transform and etc., are the most efficient way to restore an image with partial coefficients. To validate the superiority of DCT and DOST transform several studies have been conducted. For instance, Rhee and Kang proposed discrete cosine transform (DCT) based on the generalized deconvolution technique. They proved the superiority of this method, which they assumed to be a computationally efficient reconstruction algorithm, with theoretical and experimental results [31]. Gu  et al. introduced a new reconstruction method based on DCT employing to parameterize the reconstructed image. They showed that the performance of their work is too high when compared with conventional model-based iterative image reconstruction algorithms and image coding algorithms such as traditional nonparametric MOBIIR codes [32]. The ability of perfect frequency localization, multiresolution decomposition, and some other advantages in terms of time–frequency analysis caused DOST to rise to prominence. There have been various successful applications of DOST in a variety of research to verify that the DOST significantly reduces the storage and calculation cost [33]. Wang and Orchard used a new automated image reconstruction algorithm based on discrete orthonormal Stockwell transform (DOST) to provide a multiresolution spatial-frequency imagery of a signal and image. They show that the proposed algorithm achieves higher performance over the related compression techniques [34].

Despite DOST is a relatively new method compared to other transform algorithms, it has been used in many areas such as image texture analysis, image compression, signal analysis, and image restoration [35]. Huang et al. performed a study using DOST to denoise and compress medical images [36]. Thresholding denoising using DOST is introduced for medical image compression as described in [37]. Yusof et al. compared the DOST performance for the reconstruction of medical images [38]. In addition, transforms such as Discrete Wavelet (DWT) and q-Recursive Zernike Moment (q-RZM) have been used to reconstruct the images.

In the current work, as well as the genetic algorithm and DOST method is used in the reconstruction of CXR images, images are obtained from the holograms created numerically by simulation using the MATLAB program. Unlike the previous studies, after genetic algorithm and 2D-DOST applying to the images obtained by both methods, these images were analyzed in the frequency region. We have seen there is a need for reconstructing multiresolution images with accurate parameters; reduced noise level and likelihood functions that do not necessitate any prior processing on images. We provide solutions by use of a genetic algorithm to all of these requirements in this work which develops a novel method for reconstruction of CXR images and detection of COVID-19 virus. In addition, the differences between the proposed CDH_GA_DOST method and the CDH_DHT_DOST techniques are compared with the help of the image quality measurement metric methods. Fig. 1 summarizes the workflow of the proposed reconstruction method based on the genetic algorithm. First, the images which belong to CXR images of healthy and diagnosed patients with COVID-19 to be analyzed are selected Thereafter, a binary genetic algorithm is applied to find the optimal reconstructed image and then reduced sub-images are used to apply the DOST method and each transformed sub-images are analyzed in the frequency domain. Each of these steps is discussed in more detail in the following subsections.

Fig. 1.

Fig. 1

Workflow of the proposed method for CXR image analysis.

3.1. Image acquisition by using digital holography via simulation

Holography is a technique that commonly used to record and reconstruct the 3D information of an object. Recent advances in computer technology have permitted creating the holographic patterns and performing the reconstruction with the computer-driven numerical reconstruction of the created image. In addition, 3D objects are recorded in 2D holographic interference patterns with digital holography. It retrieves both the phase and amplitude information of the objects from the created-recorded holograms and allows the analysis of these images in the frequency domain.

In this work, the holographic patterns are created with simulation by using CXR images. This process is depicted as a flowchart in Fig. 2.

Fig. 2.

Fig. 2

Calculation steps of creating holographic image.

To make a brief statement, the hologram is first created with simulation based on mathematical expression [39]. These mathematical expressions are given in Fig. 2. Here, the coordinate axis is identified as (x,y). Oexitwave(x,y) and Rincident(x,y) are called object and reference waves, respectively. t(x,y) is a transmission function that is used for defining wave propagation. The propagated wave spreads from the object plane (x,y) toward the recording-detector plane (X,Y). α(x,y) on the right side of Oexitwave(x,y) equation is defined as absorption and φ(x,y) is called the phase distribution. The wavelength of the light (λ) is correlated with the number of waves (k=2π/λ). The distance between the object plane and the detector plane is given as rR, where the phase is neglected.

A sample image and its created hologram obtained from simulation are depicted in Fig. 3a and b , respectively.

Fig. 3.

Fig. 3

Digital holographic images (a) a sample image (b) created hologram (interference pattern).

After the hologram is created, the image is reconstructed from the created hologram by using inverse Fast Fourier algorithm [39].

The Fourier transform algorithm is one of the most widely preferred methods for reconstructing images in optical interference analysis and was first used by Takeda in optical profilometry [40]. Hence, the reconstruction process can be defined mathematically.

In this context, firstly, the U_detector(x,y), which is the mathematical definition of interference pattern refers given in Fig. 2, including amplitude and phase information parameters are briefly expressed as follows.

Udetector(x,y)=g(x,y)+p(x,y) (1)

Here, g(x,y) and p(x,y) give the amplitude and phase information of the hologram, respectively. To define the phase information (p(x,y)) given in (1), the Fourier transform of the equation should be taken.

G(kx,y)=A(kx)+C(kxk0,y)+C(kxk0,y)=F(Udetector(x,y)) (2)

where A(kx) is the background density of the hologram and represents the amplitude. C(kxk0,y) and C(kxk0,y) expressions are the pattern spectrum with distortion and contain phase information. They represent the real and imaginary parts of the phase, respectively.

In order to find the real phase information of the hologram created by simulation, first of all, the inverse Fast Fourier transform of the expression given by (2) is taken.

p(x,y)=F1(G(kx,y)) (3)
φ(x,y)=tan1Im(p(x,y))Re(p(x,y)) (4)

Then, a phase hologram of one amplitude is created using the phase information obtained with the Inverse Fast Fourier transform. Finally, the real image of the object is obtained from this expression.

r(x,y)=exp(iφ(x,y)) (5)
Γr(ζ,η)=F1(r(x,y)) (6)

The reconstructed image obtained from Fig. 3 by using inverse Fast Fourier algorithm is given in Fig. 4.

Fig. 4.

Fig. 4

The reconstructed image.

3.2. CDH_GA_DOST algorithm

The proposed CDH_GA_DOST algorithm is accomplished with the MATLAB program. Algorithm 1 presents the full procedure of GA steps applied to the reconstruction of the CXR images.

graphic file with name fx1001_lrg.jpg

For this work, mean absolute error (MAE) fitness function has been used to reconstruct the image which is defined as follows:

F=(1+EM)1 (7)

where EM is the MAE value between the reference or measured image and computed reconstructions [23]. Once GA is applied and the optimum solution is found, the image parameterizations are aligned. Since all pixel values of the image are now in correspondence, DOST can be applied to obtain frequency domain analysis and to detect the COVID-19 virus. Image quality is an important issue in the analysis of medical images. Recently, various techniques such as Principal Component Analysis (PCA), Wavelet-based methods, etc. are applied to medical images to be helpful for diagnosis [41]. However, among these methods, the DOST method is younger than the others. It can be useful in image processing and applied successfully to medical images [42]. First, 2D Fourier Transform (2D-FT) will be defined to describe the process of calculating the DOST of a 2D image in the frequency domain. The 2D-FT of a function and inverse 2D-FT transform can be calculated as given in (8), (9), respectively.

H[m,n]=x=0M1y=0N1h[x,y]e2πi(mx/M+ny/N) (8)
h[x,y]=1/MNm=M/2M/21n=N/2N/21H[m,n]e2πi(mx/M+ny/N) (9)

Considering the (8), (9), the 2D-DOST of a N×N image h[x,y] is calculated as,

S[x,y,vx,vy]=1/2px+py2m=2px22px21n=2py22py21H[m+vx,n+vy]e2πi(mx/2px1+ny/2py1) (10)

where vx=2px1+2px2 and vy=2py1+2py2 are defined as the horizontal and vertical frequencies, respectively [43]. The inverse 2D-DOST transform is similar to the case 1D given in ref [43].

H[m,n]=2px+py2m=2px22px21n=2py22py21s[mvx,nvy]e2πi(mx/2px1+ny/2py1) (11)

Then, by performing inverse FT, the image can be reconstructed as given in  (12),

h[x,y]=1/N2m=N/2N/21n=N/2N/21H[m,n]e2πi(mx/N+ny/N) (12)

DOST transform ensures information for the (vx,vy) frequencies which include a bandwidth of 2px1x2py1 frequencies and defines the amplitude of each Fourier frequency component in the horizontal and vertical directions by the minimum number of points. Hence the DOST technique can be quickly calculated and enables every pixel of a large image to be analyzed in seconds. However, DOST coefficients are important to store and recover the image efficiently. Therefore, the parameters in DOST such as the center of each band, and widths of that bands have to be chosen appropriately to obtain proper coefficients. Thus, most features of an image can be captured [23].

Table 2.

DOST coefficients for normal cases.

graphic file with name fx2_lrg.gif

3.3. Dataset and implementation

A thorough assessment of the proposed reconstruction method has been conducted on the healthy and COVID-19 patient datasets, obtained from Ref. [22]. This dataset consists of ten CXR images that belong to five healthy and five COVID-19 patients. All codes were executed on a Window 7 machine equipped with an Intel Core i7 CPU (3.5 GHz and 16 GB RAM)

In this work, the names of used CXR images, which are obtained from Ref. [22] for COVID-19 and viral pneumonia cases are person808_virus_1442, person701_virus_1297, bacteria_2136, person500_ bacteria_2105, person5_bacteria_15 respectively. These names are defined as a,b,c,d, and e, respectively throughout the paper. Additionally, normal cases are normal2_IM_0925_0001, normal2_IM_0860-0001, IM_0226-0001, IM_0764_0001, IM-0480-0001, respectively. These names are defined as k,l,m,n, and x, respectively throughout the paper, too. To make the images more apparent, 2D-DOST coefficients of the original CXR images and the reconstructed CXR images using the proposed method obtained from created hologram are plotted in Table 1, Table 2, respectively. These tables are obtained for COVID-19 and viral pneumonia cases and normal cases.

Table 1.

DOST coefficients for COVID-19 and viral pneumonia cases.

graphic file with name fx1_lrg.gif

While the main DOST coefficients are centered at the high spatial frequency corner, it is clearly seen that the lower frequency coefficients are close to zero. Additionally, it can be seen from Table 1, Table 2 that the obtained coefficients of DOST appear to be lower in amplitude for the cases of COVID-19 and viral pneumonia than normal cases.

4. Results

The work conducted here builds on that reconstruction of CXR images and detection of COVID-19 with the help of the proposed image and compared the results to the original CXR images. In this context, the images of the normalized and centered Fast Fourier Transform (nc-fft2) and DOST2 are obtained for CXR images, reconstructed images obtained from CDH_DHT_DOST (RIOF- CDH_DHT_DOST) and CDH_GA_DOST (RIOF- CDH_GA_DOST), respectively.

In Table 3, CXR images of COVID-19 and viral pneumonia cases are analyzed. While original images given in Table 3(a–e) are investigated, it can be seen that the lungs seem darker in the case of COVID-19 than bacteria. However, it can be seen in Table 3(a–e) that the darkening in the lungs decreases according to the bacterial density. Therefore, in order to prevent confusion with COVID-19 and to provide correct diagnosis and treatment by obtaining detailed data about the chest, frequency analysis so that image reconstruction can be necessary and beneficial in such cases. If the DOST transforms and normalized and centered FFT transforms of the original images given in Table 3(a–e) are investigated, it can be seen that, as the darkness in the lungs increases, the darkness in the frequency analysis increases, too. Also, it can be seen that the frequency oscillations and center frequency amplitude are higher for the bacterial cases than the COVID-19 cases even if there is a very dense bacterial condition. Additionally, to make the results more persuasive, a representative qualitative analysis is also carried out. The reconstructed images obtained from CDH_DHT_DOST and the proposed method CDH_GA_DOST that correspond to RIOF- CDH_DHT_DOST and RIOF- CDH_GA_DOST respectively, are analyzed. Table 3 shows that the center frequency amplitudes and frequency oscillations for the DOST transform of the reconstructed images using proposed method are much closer to the ones for original images in the COVID-19 cases.

Table 3.

The results of COVID-19 and viral pneumonia cases with related images by giving the nc-fft2, dost2 for (a) a (b) b (c) c (d) d (e) e.

graphic file with name fx3_lrg.gif

Table 4 presents the results obtained for the normal cases (without COVID-19 or viral pneumonia). It can be seen that proposed reconstruction process is more successful than COVID-19 or viral pneumonia cases for all of the normal cases. In addition, the center frequencies and frequency oscillations obtained by the proposed CDH_GA_DOST method are almost similar to the original CXR images and reconstructed images obtained with RIOF-CDH_DHT_DOST. In addition, by comparing Table 3, Table 4, it can be easily seen that the center frequency amplitudes in the case of COVID-19 and viral pneumonia are much lower than in the normal case.

Table 4.

The results of normal cases with related images by giving the nc-fft2, dost2 for (a) k (b) l (c) m (d) n (e) x.

graphic file with name fx4_lrg.gif

The simulations described above attempt to provide a robust diagnosis of digital holography based on the frequency analysis with the proposed method CDH_GA_DOST and increase the diagnosis and treatment abilities of the clinicians by examining the frequency changes in the images. However, visual quality may deteriorate because images are exposed to deterioration due to various reasons in processes such as image acquisition, storing, and recovering any image. For this reason, it is necessary to measure the image quality, which is important for image processing applications. Image quality assessment means inferring the image similarity (or differences) between original images and degraded images. To measure the image quality without time-consuming and expensive way, objective evaluations, have been used in recent years. Mean squared error (MSE), mean absolute error (MAE), peak signal-to-noise ratio (PSNR) and structural similarity (SSIM) are the well-known objective methods.

The most common predictor of the image quality measurement metric is MSE. It measures the average of the square errors and close to zero values are better for MSE [42]. MAE is the mean absolute error between the original and recovered images. The large value of MAE means that image is poor quality  Asamoah et al., 2018, Tanchenko, 2014. The ratio between the maximum possible signal power and the power of the distorting noise is calculated by PSNR. The small value of PSNR corresponds to poor image quality [46]. The similarity between the original and recovered images is measured by SSIM [45]. MSE, MAE, PSNR and SSIM metrics are used to evaluate the quality of the reconstructed images in this work. The mathematical expressions for MSE, MAE, PSNR and SSIM are defined in (13), respectively:

MSE=1/MNi=1Mj=1N(x(i,j)y(i,j))2
MAE=1/MNi=1Mj=1N(x(i,j)y(i,j))
PSNR=10log10(2n1)2/MSE
SSIM=(2x¯y¯+C1)(2σxy+C2)/(σx2+σy2+C2)((x¯)2+(y¯)2+C1), (13)

The expressions given in (13) are defined in Table 5.

Table 5.

The definitions in (13).

Attribute Parameter Equation
Constant C1
Constant C2
Original image x¯ x¯=1/Ni=1Nxi
Test image y¯ y¯=1/Ni=1Nyi
Correlation coefficient of x σx2 σx2=1/N1i=1N(xix¯)2
Correlation coefficient of y σy2 σy2=1/N1i=1N(yiy¯)2
Correlation coefficient between x and y σxy σxy=1/N1i=1N(xix¯)(yiy¯)
Original image x(i,j)
Distorted image y(i,j)
Pixel motion of MxN image (i,j)

Using (13), the similarity between the original CXR and the CXR images reconstructed from the created hologram by using both methods is deduced. Table 6, Table 7 present the results extracted for COVID-19 and viral pneumonia cases and normal cases, respectively. In the figures in Table 6, for all columns in the first and third lines, the left ones correspond to the original CXR images. The figures on the right of these columns belong to the reconstructed ones with the help of CDH_DHT_DOST and the proposed method CDH_GA_DOST that correspond to RIOF-CDH_DHT_DOST and RIOF-CDH_GA_DOST, respectively. In addition, in the second and fourth lines, the similarity between these images is given by calculating SSIM values. As it can be seen from Table 6, for both COVID-19 and viral pneumonia cases, the reconstructed figures RIOF-CDH_GA_DOST which are obtained by the proposed method pretty well match the original ones.

Table 6.

Images of obtained SSIM values.

graphic file with name fx5_lrg.gif

Table 7.

Images of obtained SSIM values.

graphic file with name fx6_lrg.gif

Similar to Table 6, the first and third rows in Table 7, the left ones correspond to the original CXR images. The figures on the right of these columns belong to the reconstructed ones RIOF-CDH_DHT_DOST and RIOF- CDH_GA_DOST that are obtained with the help of CDH_DHT _DOST and the proposed CDH_GA_DOST methods, in the first and third lines respectively. In addition, in the second and fourth lines, the similarity between these images is given by calculating SSIM values. As it can be seen from Table 7, for normal cases, the reconstructed figures RIOF-CDH_GA_DOST obtained by the proposed CDH_GA_DOST method, pretty well match the original ones as the results presented in Table 6. Besides all these results, when the images presented in Table 6, Table 7 are compared, it can be seen that in the case of the COVID-19 and viral pneumonia cases, luminosity in the lungs slightly affects the reconstruction performance.

In order to examine the images given visually in Table 6, Table 7 with numerical values, MAE, MSE, PSNR, SSIM values between the original and reconstructed images for normal and COVID-19 conditions are calculated in Table 8, Table 9 for RIOF-CDH_DHT_DOST and the RIOF- CDH_GA_DOST, respectively. As mentioned above, the obtained values for normal cases for all of the evaluation metric criters are better than COVID-19 and viral pneumonia cases due to the luminosity in the CXR images. In addition, it can be seen easily from Table 9 that the proposed method provides better results for both normal and COVID-19 and viral pneumonia cases in all metrics.

Table 8.

The difference between the original and the RIOF-CDH_GA_DOST images: MAE, MSE, PSNR and SSIM values for normal cases and COVID-19 and viral pneumonia cases.

Normal cases
(COVID-19 and viral pneumonia cases
MAE MSE PSNR SSIM MAE MSE PSNR SSIM

k 0.0095 0.0040 91.9242 0.1770 a 0.0106 0.0049 83.1615 0.1910
l 0.0095 0.0041 90.8315 0.1780 b 0.0101 0.0043 88.5023 0.1590
m 0.0091 0.0037 94.9351 0.1900 c 0.0130 0.0066 70.1831 0.1890
n 0.0087 0.0036 97.1448 0.2110 d 0.0116 0.0056 77.2225 0.2180
x 0.0098 0.0042 89.4757 0.1970 e 0.0105 0.0046 85.7135 0.1950

Table 9.

The difference between the original and the RIOF-CDH_DHT_DOST images: MAE, MSE, PSNR and SSIM values for normal cases and COVID-19 and viral pneumonia cases.

Normal cases
(COVID-19 and viral pneumonia cases
MAE MSE PSNR SSIM MAE MSE PSNR SSIM

k 0.0104 0.0050 82.669 0.0438 a 0.0123 0.0065 71.103 0.0301
l 0.0106 0.0050 82.168 0.0327 b 0.0119 0.0060 74.590 0.0320
m 0.0089 0.0039 92.822 0.0506 c 0.0172 0.0103 50.982 0.0277
n 0.0089 0.0039 93.050 0.0569 d 0.0151 0.0087 58.574 0.0430
x 0.0114 0.0057 76.589 0.0360 e 0.0125 0.0063 72.301 0.0310

In addition to all these, it should be emphasized that on the basis of the high-performance results obtained with the genetic algorithm, the need to set the parameters required for the algorithm correctly. In this context, to ensure the algorithm work accurately and found the optimum solution, some parameters should be set. These parameters are population, number of genes and chromosomes, mutation, selection, and crossover. Among these parameters, the gene and chromosome numbers depend on the model parameters. On the other hand, the big search area is obtained with the large size of the population. The new chromosomes are determined with crossover probability. In general, due to the replacing the all parents with new chromosomes in the next generation, the crossover probability is chosen between the range of 0.8 and 0.95. In addition, mutation probability is preferred as only 0.05% to 1% [47].

In this study, 100 individuals are chosen for the population. 100 chromosomes and 25 000 genes are taken for the optimal solution after 50 testing process. Moreover, the probability of crossover is set at 0.95 and probability of mutation is taken as 0.001.

5. Discussion and conclusion

Although machine learning (ML) techniques have been proved to be efficient alternatives in detecting or classifying challenging COVID-19 diagnosing problems and have started to attract great recent attention from the researches interested in determining COVID-19 pneumonia. In this context, various studies for COVID-19 detection via CXR and CT scans have been published in the literature. However, the main purpose of these researches is to diagnose COVID-19 virus CXR or CT scans. Nevertheless, there may occur defects during the imaging process via CXR or CT. The focusing problem in the CXR images may cause misdiagnosis and delay the treatment. To overcome this problem and prevent misdiagnosis on CXR images and confusion of COVID-19 virus with influenza, seasonal flu, etc. infections, image reconstruction processes are performed. In this work, the results indicate that digital holography provides an advantage in examining X-ray images, as 3-dimensional information of X-ray images can be obtained with a hologram. In addition, when imaging is performed optically instead of X-ray, patients are prevented from being exposed to radiation. DOST is a technique that is often used for the reconstruction of images. However, it can be challenging in some cases to reconstruct the multiresolution images with accurate parameters; reduced noise level, and likelihood functions that do not necessitate any prior processing of images. Because, while reconstructing the image by using the DOST method, the parameters have to be determined appropriately. If the proper values for the parameters are not chosen, the margin of error between the original image and the reconstructed one increases. Moreover, using various algorithms to determine the appropriate values increases the computational load and the complexity of the method. Therefore, we provide solutions by the use of a genetic algorithm to all of these requirements in this work. In addition, there has been any research based on analysis with the DOST method for images reconstructed from holograms which are created by using digital holography. The novelty of this work is that the DOST technique is combined with the genetic algorithm and used for CXR images reconstructed from the hologram. It has been observed that the application of the proposed method to the images which are reconstructed with DHT_DOST, provides more convenience in diagnosis and treatment. The obtained reconstructed image qualities have been judged by applying the metrics explained in the previous section and the methods of CDH_DHT_DOST and the proposed CDH_GA_DOST from CXR images have been assessed numerically. Consistent results are obtained for all the metrics in the case of the proposed method is used. In this paper, we have shown that the combination of DOST, genetic algorithm, and digital holography techniques can be considered as an alternative reconstruction method in the reconstruction process.

In addition to all these results, in this study, the storage problem of images of CXR that requires large space has been overcome by using CDH. The size of each image used for this study is approximately 74 kilobytes. However, the area occupied by the holograms of these images created by simulation is approximately 1.9 kilobytes. In other words, it takes up 37 times less space. If we calculate for the 10 images presented as an example in this study, 370 times less space will be needed to store the images than the actual storage area. Moreover, real images can be reconstructed from holograms at any time without any loss of data.

This study is the first to devise digital holography to promote the diagnosis of COVID-19 from CXR images with the help of the combination of the genetic algorithm and DOST method; thus, it can be further extended to other diseases or imaging systems, i.e, MRI or CT by applying the proposed method for the dataset of that imaging method which is seen as future work.

Declaration of Competing Interest

The authors declare that they have no known competing financial interests or personal relationships that could have appeared to influence the work reported in this paper.

References

  1. Lu R., Zhao L., Huang B., Ye F., Wang W., Tan W. Real-time reverse transcription-polymerase chain reaction assay panel for the detection of severe acute respiratory syndrome coronavirus 2 and its variants. Chin. Med. J. 2021;134(17):2048–2053. doi: 10.1097/CM9.0000000000001687. [DOI] [PMC free article] [PubMed] [Google Scholar]
  2. Aljondi R., Salem A. Diagnostic value of imaging modalities for COVID-19: scoping review. J. Med. Internet Res. 2020;22(8) doi: 10.2196/19673. [DOI] [PMC free article] [PubMed] [Google Scholar]
  3. Altmayer S., Zanon M., Pacini G.S., Watte G., Barros M.C., Mohammed T.L., Verma N., Marchiori E., Hochhegger B. Comparison of the computed tomography findings in COVID-19 and other viral pneumonia in immunocompetent adults: a systematic review and meta-analysis. Eur. Radiol. 2020:1–12. doi: 10.1007/s00330-020-07018-x. [DOI] [PMC free article] [PubMed] [Google Scholar]
  4. Wang W., Xu Y., Gao R., Lu R., Han K., Wu G., Tan W. Detection of SARS-CoV-2 in different types of clinical specimens. JAMA. 2020;323(18):1843–1844. doi: 10.1001/jama.2020.3786. [DOI] [PMC free article] [PubMed] [Google Scholar]
  5. Kwee T.C., Kwee M.M. Chest CT in COVID-19: what the radiologist needs to know. RadioGraphics. 2020;40(7):1848–1865. doi: 10.1148/rg.2020200159. [DOI] [PMC free article] [PubMed] [Google Scholar]
  6. Pearce M.S., Salotti J.A., Lee C., Kim K.P., Howe N.L., Ronckers C.M., Rajaraman P., Craft A.W., Parker L., González A.B. Radiation exposure from CT scans in childhood and subsequent risk of leukaemia and brain tumours: a retrospective cohort study. Lancet. 2012;380(9840):499–505. doi: 10.1016/S0140-6736(12)60815-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  7. Cozzi D., Albanesi M., Cavigli E., Moroni C., Bindi A., Luvara S., Lucarini S., Busoni S., Mazzoni L.N., Miele V. Chest X-ray in new coronavirus disease 2019 COVID-19) infection: findings and correlation with clinical outcome. Radiol. Med. 2019;(2020):1–8. doi: 10.1007/s11547-020-01232-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  8. Giovagnoni A. Facing the COVID-19 emergency: we can and we do. Radiol. Med. 2020;125(4):337–338. doi: 10.1007/s11547-020-01178-y. [DOI] [PMC free article] [PubMed] [Google Scholar]
  9. Subir K.D. The pathophysiology, diagnosis and treatment of corona virus disease 2019 (COVID-19) Indian J. Clin. Biochem. 2020;35(4):385–396. doi: 10.1007/s12291-020-00919-0. [DOI] [PMC free article] [PubMed] [Google Scholar]
  10. Avci M., Kozaci N. Comparison of x-Ray imaging and computed tomography scan in the evaluation of knee trauma. Medicina. 2019;55(623):1–9. doi: 10.3390/medicina55100623. [DOI] [PMC free article] [PubMed] [Google Scholar]
  11. Neri E., Miele V., Coppola F., Grassi R. Use of CT and artificial intelligence in suspected or COVID-19 positive patients: statement of the Italian society of medical and interventional radiology. Radiol. Med. 2020:1–4. doi: 10.1007/s11547-020-01197-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
  12. Zhang S. Application of super-resolution image reconstruction to digital holography. EURASIP J. Adv. Signal Process. 2006:1–7. [Google Scholar]
  13. Micó V., Zalevsky Z., Ferreira C., García J. Super resolution digital holographic microscopy for three-dimensional samples. Opt. Express. 2008;16(23):19260–19270. doi: 10.1364/oe.16.019260. [DOI] [PubMed] [Google Scholar]
  14. Yu X., Hong J., Liu C., Kim M.K. Review of digital holographic microscopy for three-dimensional profiling and tracking. Opt. Eng. 2014;53(11) (1-21) [Google Scholar]
  15. Tahara T., Quan X., Otani R., Takaki Y., Matoba O. Digital holography and its multidimensional imaging applications: a review. J. Microsc. 2018:55–67. doi: 10.1093/jmicro/dfy007. [DOI] [PMC free article] [PubMed] [Google Scholar]
  16. Nomura T., Okamura M., Nitanai E., Numata T. Image quality improvement of digital holography by superposition of reconstructed images obtained by multiple wavelengths. Appl. Opt. 2008;47(19):D38–D43. doi: 10.1364/ao.47.000d38. [DOI] [PubMed] [Google Scholar]
  17. Claus D., Fritzsche M., Iliescu D., Timmerman B., Bryanston-Cross P. High-resolution digital holography utilized by the subpixel sampling method. Appl. Opt. 2011;50(24) doi: 10.1364/AO.50.004711. [DOI] [PubMed] [Google Scholar]
  18. Verrier N., Fournier C. Digital holography super-resolution for accurate three-dimensional reconstruction of particle holograms. Opt. Lett. 2015;40(2):217–220. doi: 10.1364/OL.40.000217. [DOI] [PubMed] [Google Scholar]
  19. Funamizu H., Uozumi J., Aizu Y. Enhancement of spatial resolution in digital holographic microscopy using the spatial correlation properties of speckle patterns. OSA Continuum. 2019;2(6):1822–1837. [Google Scholar]
  20. Wang Y., Orchard J. Fast discrete orthonormal stockwell transform. SIAM J. Sci. Comput. 2009;31(5):4000–4012. [Google Scholar]
  21. Abouhawwash M., Deb K., Alessio A. Exploration of multi-objective optimization with genetic algorithms for PET image reconstruction. J. Nucl. Med. 2020;61(1):572. [Google Scholar]
  22. https://www.kaggle.com/paultimothymooney/chest-xray-pneumonia.
  23. Gu X., Ren K., Masciotti J., Hielscher A.H. Parametric image reconstruction using the discrete cosine transform for optical tomography. J. Biomed. Opt. 2009;14(6) doi: 10.1117/1.3259360. [DOI] [PMC free article] [PubMed] [Google Scholar]
  24. Wang S.H., Zhang X., Zhang Y.D. DSSAE: Deep stacked sparse autoencoder analytical model for COVID-19 diagnosis by fractional Fourier entropy. ACM Trans. Inf. Syst. 2001;13(1):1–20. [Google Scholar]
  25. Wang S.H., Khan M.A., Govindaraj V., Fernandes S.L., Zhu Z., Zhang Y.D. Deep rank-based average pooling network for Covid-19 recognition. Comput. Mater. Contin. 2011;70(2):2797–2813. [Google Scholar]
  26. Ismael A.M., Şengür A. Deep learning approaches for COVID-19 detection based on chest X-ray images. Expert Syst. Appl. 2021;164 doi: 10.1016/j.eswa.2020.114054. [DOI] [PMC free article] [PubMed] [Google Scholar]
  27. Toraman S., Alakus T.B., Turkoglu I. Convolutional capsnet: a novel artificial neural network approach to detect COVID-19 disease from Xray images using capsule networks. Chaos Solitons Fractals. 2020;140 doi: 10.1016/j.chaos.2020.110122. [DOI] [PMC free article] [PubMed] [Google Scholar]
  28. Sobahi N., Sengur A., Tan R.S., Acharya U.R. Attention-based 3D CNN with residual connections for efficient ECG-based COVID-19 detection. Comput. Biol. Med. 2022;143 doi: 10.1016/j.compbiomed.2022.105335. [DOI] [PMC free article] [PubMed] [Google Scholar]
  29. Deshlahra A., Shirnewar G.S., Sahoo A. International Conference on Emerging Trends in Computer and Image Processing(ICETCIP) IRD India; Bangalore: 2013. A comparative study of DCT, DWT & hybrid (DCT-dwt) transform. [Google Scholar]
  30. Stockwell R.G. A basis for efficient representation of the S-transform. Digit. Signal Process. 2007;27(1):371–393. [Google Scholar]
  31. Rhee S., Kang M.G. Discrete cosine transform based regularized high-resolution image reconstruction algorithm. Opt. Eng. 1999;38(8):1348–1356. [Google Scholar]
  32. Gu X., Ren K., Masciotti J., Hielscher A.H. Parametric image reconstruction using the discrete cosine transform for optical tomography. J. Biomed. Opt. 2009;14(6) doi: 10.1117/1.3259360. (1-11) [DOI] [PMC free article] [PubMed] [Google Scholar]
  33. Bini A.A. Image restoration via DOST and total variation regularisation. IET Image Process. 2019;13(3):458–468. [Google Scholar]
  34. Wang Y., Orchard J. 2009 16th IEEE International Conference on Image Processing (ICIP) 2009. The discrete orthonormal stockwell transform for image restoration; pp. 2761–2764. [Google Scholar]
  35. Saoud S., Bousselmi S., Naser M.B., Cherif A. New speech enhancement based on discrete orthonormal stockwell transform. Int. J. Adv. Comput. Sci. Appl. (IJACSA) 2016;7(10) [Google Scholar]
  36. Huang H., Sun F.R., Babyn P., Zhou Z.Z., Wang L.X. 2nd International Conference on Electrical Computer Engineering and Electronics (ICECEE 2015) 24. 2015. Medical image denoising and compressing using discrete orthonormal S-transform; pp. 291–296. [Google Scholar]
  37. Qianlei Y., Fengrong S., Paul B., Cuicui Z., Fanglei L., Jiaojiao Q., Haitao Y., Guihua Y. 2017 3rd IEEE International Conference on Computer and Communications (ICCC) 2017. Medical image compression with thresholding denoising using discrete cosine-based discrete orthogonal stockwell transform; pp. 1857–1860. [Google Scholar]
  38. Yusof Y.W.M., Saparon A., Jalil N.A. 2015 IEEE European Modelling Symposium (EMS) 2015. Performance comparison of discrete orthonormal S-transform for the reconstruction of medical images; pp. 128–132. [Google Scholar]
  39. Schnars U., Jüptner W. Direct recording of holograms by a CCD target and numerical reconstruction. Appl. Opt. 1994;33:179–181. doi: 10.1364/AO.33.000179. [DOI] [PubMed] [Google Scholar]
  40. Takeda M., Mutoh K. Fourier transform profilometry for the automatic of 3-D objects shapes. Appl. Opt. 1983;22(24):3977–3982. doi: 10.1364/ao.22.003977. [DOI] [PubMed] [Google Scholar]
  41. Yan Y., Zhu H. 2011 19th European Signal Processing Conference. 2011. The generalization of discrete Stockwell transforms; pp. 1209–1213. [Google Scholar]
  42. Yusof Y.W.M., Saparon A., Jalil N.A. 2014 2nd International Conference on Electrical, Electronics and System Engineering (ICEESE) 2014. A comparative analysis of transformation techniques for the reconstruction of medical images; pp. 95–100. [Google Scholar]
  43. Sara U., Akter M., Uddin M. Image quality assessment through FSIM, SSIM, MSE and PSNR—A comparative study. Comput. Commun. 2019;7:8–18. [Google Scholar]
  44. Asamoah D., Oppong E.O., Oppong S.O., Danso J. Measuring the performance of image contrast enhancement technique. Int. J. Comput. Appl. 2018;181(22):6–13. [Google Scholar]
  45. Tanchenko A. Visual-PSNR measure of image quality. J. Vis. Commun. Image Represent. 2014;25(5):874–878. [Google Scholar]
  46. Flynn J.R., Ward S., Abich J., Poole D. In: Engineering Psychology and Cognitive Ergonomics. UnderstandIng Human Cognition. EPCE 2013. D. Harris., editor. Springer; Berlin, Heidelberg: 2013. Image quality assessment using the SSIM and the just noticeable difference paradigm. [Google Scholar]
  47. Hassanat A., Almohammadi K., Alkafaween E., Abunawas E., Hammouri A., Prasath V.B.S. Choosing mutation and crossover ratios for genetic algorithms- a review with a new dynamic approach. Information. 2019;10(390):2–36. [Google Scholar]

Articles from Computers in Biology and Medicine are provided here courtesy of Elsevier

RESOURCES