Abstract
Background noise in many fields such as medical imaging poses significant challenges for accurate diagnosis, prompting the development of denoising algorithms. Traditional methodologies, however, often struggle to address the complexities of noisy environments in high dimensional imaging systems. This paper introduces a novel quantum-inspired approach for image denoising, drawing upon principles of quantum and condensed matter physics. Our approach views medical images as amorphous structures akin to those found in condensed matter physics and we propose an algorithm that incorporates the concept of mode resolved localization directly into the denoising process. Notably, our approach eliminates the need for hyperparameter tuning. The proposed method is a standalone algorithm with minimal manual intervention, demonstrating its potential to use quantum-based techniques in classical signal denoising. Through numerical validation, we showcase the effectiveness of our approach in addressing noise-related challenges in imaging and especially medical imaging, underscoring its relevance for possible quantum computing applications.
Keywords: Quantum Mechanics, Disorder, Anderson Localization, Image Denoising, Medical Imaging
Introduction
Imaging noise, such as speckle noise in ultrasound, Gaussian noise in magnetic resonance imaging (MRI), and sway of electronic noise, scatter radiation, random coincidences, and attenuation effects in nuclear imaging can obscure important anatomical structures and details, making it difficult for clinicians to accurately interpret images and make informed diagnoses. By effectively removing this noise, denoising algorithms enhance the clarity and fidelity of medical images, improving their diagnostic utility and enabling clinicians to identify subtle abnormalities or pathologies more accurately. In recent years, many computational techniques such as neural networks1–4, regularization-based techniques5–7, and statistical approach8,9 have shown positive progress on addressing the challenges of image denoising and background noise reduction. However, despite the success of these methodologies, they exhibit deficiencies when confronted with the complexities inherent in noisy image environments. For instance, neural networks when dealing with learning intricate patterns and representations, often struggle with the detailed structures present in noisy images, especially in domains like medical imaging where data acquisition is constrained in imaging modalities due to design or target applications such as limited angle tomography10–13 or Compton camera14–16. Furthermore, the reliance on large annotated datasets for training can be prohibitive, hindering the robustness and generalization capabilities of neural networks, particularly in the presence of significant noise levels. Additionally, neural networks suffer from overfitting, particularly when trained on small datasets or noisy images, leading to suboptimal denoising performance. Similarly, while regularization-based approaches provide a framework for controlling computational model and preventing overfitting, they may struggle to capture the diverse and complex structures present in noisy images due to non-linearity and inability to capture local extrema, or complex regularizations, thereby limiting their effectiveness in noise reduction tasks. These limitations underscore the need for alternative methodologies that can effectively address the complexities of denoising in high dimensional medical imaging while ensuring robustness and generalization across diverse imaging modalities and noise conditions.
In recent years, a few attempts have been made to apply quantum principles in image or signal processing, including early work17 and proceeding efforts in image segmentation18,19. More recent developments20–23 adopt a quantum inspired approach to imaging systems. These methods show promising start for the utilization of quantum physics into the denoising problems. One important aspect of those works was to process images as block-wise to preserve pixel correlation for efficient denoising, unlike previous methods that begin with a continuous mathematical representation and then discretize. Also, it was shown that one can use the quantum localization phenomenon and quantum interference effects to address noise dependence; however previous works do not fully exploit localization in terms of modal analysis. Additionally, like neural network and regularization approaches, prior quantum-inspired methods rely on a set of hyperparameters regarding key parameters in both quantum mechanics theory and the filtering process, rendering them as quasi-automatic approaches requiring some manual intervention. With the imminent rise of quantum computation, there is a growing need for standalone quantum approaches that effectively address these issues.
In this paper, we extend on the previous work20 on quantum inspired approach for denoising problems. We introduce a contrasting view of the medical image where we idealize a medical image as amorphous (disordered) structure akin to the condensed matter physics, and we use the amorphous model analysis to characterize the locality and propagating behaviors of the signals in decomposed imaging systems. In this view, we consider a noiseless image as a localized structure with the absence of diffusive behaviors, and therefore, in contrast, we consider the background noise as diffusive and non-local modal representatives. We will show that in various examples, similar characterization of the disordered regime is relevant in imaging space and is particularly useful for denoising. While the primary focus of this paper is on medical imaging, we also include examples of classical natural images to enable all readers to better evaluate its performance. Overall, the contribution of this paper lies in different points:
We present a contrasting view where we draw a parallel between an image (e.g. medical image) and the theory of amorphous structures in condensed matter physics.
Thresholding and filtering are conducted in the quantum domain, using rules inspired by the laws of physics.
The core of the proposed method is the Schrödinger’s equation. Here, the Planck constant is defined within a physical context as opposed to existing methods.
The approach eliminates the need for hyperparameter optimization, presenting a standalone quantum-inspired method.
It achieves a reduction in computational costs.
The paper proceeds with an organized examination of our proposition, beginning with an exposition on the basics of quantum mechanics. It then delves into modal analysis techniques applied to amorphous structures in condensed matter, offering insights into the characterization of vibrational modes. Next, the paper introduces quantum-inspired denoising methodologies, tailored specifically for image systems depicted as amorphous structures. Subsequently, it discusses the connection between the amorphous model and images affected by background noise, laying the groundwork for denoising in compressed sensing applications and filtering process. Through various examples, the paper demonstrates the effectiveness of these techniques in enhancing image quality and compressing the essential image components.
Methods
Basics of Quantum Mechanics
Quantum physics theory explores the behavior of particles at the quantum scales, challenging the classical understanding of the surrounding phenomena. This theory has been crucial for understanding the properties of complex systems such as solids, liquids, and gases. At the heart of quantum physics lies Schrödinger’s equation, a fundamental equation that describes how the wave function of a quantum system evolves over time. In a non-relativistic single particle quantum system, a wave function describes the probability of presence of a particle in a potential , where is the spatial position. This wave function is an element of a Hilbert space with bounded integrals and follows the stationary Schrödinger Eq. 24:
| 1 |
where is the Hamiltonian operator. Here and are the mass and the energy of the particle and is the Planck constant that relates the energy of the particle to its frequency, is spatial Laplacian derivatives at spatial positions .
In condensed matter physics, the amorphous structure is often locally described by harmonic oscillators and the potential energy function takes the form of where is the angular frequency of the oscillator. Substituting this potential into the Schrödinger equation yields the following:
| 2 |
This equation is known as the time-independent Schrödinger equation for the harmonic oscillator. It describes the energy levels and wave functions of a quantum harmonic oscillator system. The solutions to this equation give the quantized energy levels of the harmonic oscillator, which are equally spaced, and the corresponding wave functions represent the probability distributions of finding the particle at various positions along the oscillator. Thus, from the Schrödinger equation with the harmonic oscillator potential, we obtain a dynamical system of the quantum harmonic oscillator. The harmonic oscillator model can provide insights into the vibrational behavior of amorphous materials. In this context, the vibrational modes are not strictly phonons, but rather collective excitations involving the motion of atoms or molecules within the material. These excitations can still be approximated as harmonic oscillators, with each mode characterized by a specific frequency and associated energy.
In imaging examples, we assume that the pixels are the particles, and the potential is described by the intensity values of the pixels (i.e., for 2D image, , where represents the intensity value of image containing pixels). Therefore, the Schrödinger equation yields the following form:
| 3 |
and similarly, this results in a dynamical system where the solution is the set of eigenvectors that serve as an adaptive basis in decomposed images or signals. As discussed in previous works, for a vectorized 2D image, when the conventional zero padding is used as boundary conditions for the Hamiltonian operator, the discretized Hamiltonian matrix, , takes the simplified form of
| 4 |
where is the -th component of the Hamiltonian operator. Unlike in quantum mechanics, the Planck constant in image processing is a parameter that should be tuned. Previous studies have optimized the value of the Planck constant manually to choose the optimal one in order to denoise an image. Here we propose a formula to estimate the optimal value based on quantum mechanics:
| 5 |
where and are the energy and frequency of the decomposed image. Here the denominator represents the maximum frequency of an image denoted by a half of pixel number inonedirection, , and the numerator is denoted by the total normalized squared intensity of an image. Furthermore, we define where as an augmented value to study its influence on our problem.
Amorphous Regime in Disordered Harmonic Solids
In amorphous regime, materials exhibit a lack of long-range order in their atomic structure, setting them apart from crystalline solids. Within this context, the atomistic vibrational eigenmodes in amorphous materials can be classified into two main categories: propagating and non-propagating modes25. Propagating modes, characterized by longer wavelengths, are wavelike vibrational movements through a homogeneous medium and they are undiscerning of atomistic disorder. On the other hand, non-propagating modes are called diffusons and locons. Diffusons extend across the entire amorphous sample, representing vibrational eigenmodes that diffuse energy over the material without being confined to specific regions. In contrast, locons are spatially localized modes, where vibrational movements are trapped within specific regions of the material. In essence, the vibrational modes of atoms in amorphous materials can be broadly categorized into three types: propagons, which propagate and are non-local; diffusons, which do not propagate but are non-local; and locons, which are localized and non-propagating25–27. Figure 1 demonstrates the behaviors of these three vibrational modes in amorphous structure.
Figure 1.
Demonstration of vibrational modes in amorphous structures: a) propagon, b) diffuson c) locon.
The distinction criteria of the vibrational modes in amorphous structures correspond directly to the structural properties of the disorder. For distinction between propagons and diffusons, a well-known Ioffe-Regel criterion28 comes into play. According to this criterion, as the mean free path of a particle, such as a phonon, approaches the magnitude of the interatomic spacing or the size of the material’s structural units, a transition occurs in the vibrational modes from propagons, indicative of propagating states, to diffusons, representing diffusive or non-propagating states. For diffusons-locons separation, Anderson localization29 provides a useful picture which refers to the phenomenon where wavefunctions become localized in a disordered medium, preventing the propagation of waves over long distances. In the case of vibrational modes in amorphous materials, Anderson localization can lead to the trapping of vibrational energy within specific regions due to the disorder in the atomic arrangement. The distinguishing criterion for separating diffusons from locons is commonly referred to as the mobility edge25.
In terms of computational tools, the participation ratio serves as one of the indicators of localized modes and Anderson localization phenomena in amorphous materials. A low participation ratio means that an eigenstate is highly localized, indicating that its amplitude is concentrated within a small number of elements. Conversely, a high participation ratio implies that the eigenstate is more spread out or delocalized, with its amplitude distributed across numerous elements. For vibrational modes, the participation ratio is given as follows:
| 6 |
when is the eigenvector for mode at atom and is the total number of atoms.
To demonstrate the relevance of the participation ratio and criteria for distinguishing vibrational modes in amorphous structures, we computed participation ratio for a common amorphous Silicon (a-Si) structure that inhibits the short-range order (SRO), which means a length scale smaller than 5 Å, while lacking long-range order30. We employed a previously developed continuous random network (CRN)31 as an illustrative example. The atomistic structure generated from the CRN utilizes a random-based atomic arrangement method with a bond-swapping algorithm. The CRN framework constructs the structure with SRO and preserves disorder beyond the second neighbor lengths, resulting in the elimination of defects and voids. Specifically, the CRN structure of a-Si exhibits a defect and void concentration of less than 1–3%. The simulated system contains 4096 atoms and the Tersoff potential32 is used in GULP package33 to obtain eigenvectors by solving the dynamical system. Figure 2 shows the participation ratio for example a-Si structure.
Figure 2.
Mode resolved participation ratio in a-Si; regions P, D, and L correspond to propagons, diffusons, and locons.
The two shaded regions indicate the separation of propagons at low frequencies from diffusons and diffusons from locons at higher frequencies. While diffusons dominate the frequency range the propagons and locons count for small fraction of the total modes. We should note that the separation criteria are subjective and usually multiple factors are considered to obtain a clear-cut separation. However, the calculation for participation ratio is straightforward with relatively low computational cost and this behavior is rather consistent between all amorphous structures.
Results and discussions
Amorphous Regime and Localization in Image Processing
Images are broadly considered as spatially structured data with localized patterns. This prompted us to explore whether mode resolved localization characterization tools are applicable for addressing medical imaging problems and other scenarios where spatial localization within the image is a key aspect. Here we investigate the presence of localization in image with noise and noiseless structures using the concept of mode resolved participation ratio, inspired with the analogy with amorphous solids. Similar to condensed matter analysis of vibrational modes, we calculate the participation ratio of the sample image as following:
| 7 |
when is the eigenvector for mode and pixel number and is total number of pixels.
The top row of Fig. 3 shows the benchmark synthetic image of the size 64×64 pixels (which results in the same total number of modes as a-Si in Fig. 2.) and noisy images with Poisson noise at signal to noise ratio (SNR) of 2, 5, and 15. The eigenvectors and eigenvalues of the synthetic image and noisy ones were calculated from dynamical system, equations 3 and 4, at estimated Planck constant of 0.7864 and subsequently the normalized participation ratio, the normalization is defined as the participation ratio over the total number of modes (pixels). The bottom plots in Fig. 3 show the participation ratios for the corresponding synthetic image and noisy ones.
Figure 3.
Benchmark synthetic image, and noisy images with Poisson noise and SNR of 2, 5, and 15 are shown in the top. The bottom shows the corresponding the normalized participation ratio [normalized by the total number of pixels] plots of the clean and noisy images.
Interestingly the pattern of localization and participation ratio resemble the similar behavior as vibrational modes in amorphous regime. The comparison between participation ratio results shows that as SNR increases, the degree of the localization is diminished, and the mode resolved participation ratio uniformly increases particularly for the mid-range eigenvalues. In parallel, the identification of localized modes becomes more and more clear for low and high eigenvalues as SNR increases. This implies that the increase in noise level increases the participation of the non-local modes and ultimately results in a more clear-cut separation of the low and high localized modes. For large noise, e.g. SNR = 2, there is a clear localization of the low and high eigenvalues, and the mid values dominate the eigenvalue domain. To further demonstrate the similarities between the vibrational modes in amorphous regime and mode resolved image, we show the plots of selected eigenvectors through three cross-sections [corresponding to the first to third rows of the image] for low, mid, and high eigenvalues in Fig. 4.
Figure 4.
Sample eigenvectors of the decomposed image signal for SNR=2 at (a) low, (b) mid, and (c) high eigenvalues. Each row shows three cross-sections of an eigenvector.
Three cases show the propagating and non-local behavior for the low range modes, scattered and non-localized behavior for mid-range modes and, localized with non-propagating nature for high-range modes. Therefore, with comparison with Fig. 1, the eigenvectors of imaging system are comparable to amorphous structures in condensed matter physics. We should note that although the same characteristics are apparent between the mode resolved image regime and vibrational modes in amorphous regime, the similar naming of propagon, diffuson and locons may not be appropriate in studying imaging systems. Also, we emphasize that the quantum localization premise in imaging systems relies on the spatial localization of the image’s structural components. Hence, this characteristic can be effectively utilized for image processing. In the next section, we will discuss the connection between localization and background noise, and we propose our approach of utilizing localization to remove noise and compress the image reconstruction.
Applications to Denoising and Compressed Sensing
Besides the environmental conditions and the limitations on the measurement systems, background noise often refers to unwanted signals or interference that diffuses through the image due to the scattering of incident radiation or waves by particles or structures within the imaged area. Hence, we consider background noise as a non-localized mode that is participant in the characteristics of many pixels, and they represent the scattered behavior similar to the diffusons in vibrational modes of amorphous structures. To examine this proposition, we use a modified version of the quantum inspired approach20 for denoising process that was constructed by smoothing the input signal, computing the eigenmodes, manually thresholding them, and then back-projecting the thresholder eigenmodes. In the modified approach, we introduce a criterion to remove/filter the non-localized modes with high participation ratio based on the histogram distribution plot of the normalized participation ratio. Given that the majority of modes are non-local modes with high participation ratio, we fit a Lorentzian function on the spectral distribution to select these non-local modes. The Lorentzian function, , as a function of participation ratio is defined as
| 8 |
where the is the peak participation ratio value, is the half width at half maximum (HWHM). Figure 5 shows the distribution of the participation ratio for the noisy synthetic image of SNR = 2 and fitted Lorentzian function on the peak distribution in the outset. The corresponding region below the Lorentzian function fit gives a good approximation of the high participation and non-local modes. Here we consider the lower bound of the Lorentzian fit and the eigenvalues corresponding to the low and high values as the threshold to filter the signals for both low and high range modes. The inset of the Fig. 5 shows the selected region that is used in the modified approach.
Figure 5.
Outset plot shows the distribution of the normalized participation ratio of the synthetic image with the fitted Lorentzian function at the peak of the distribution. The inset plot shows the zoom-in view of the selected regions that was used to extract the localized modes at low and high eigenvalue ranges.
This results in fixing an effective value for the thresholding in the adaptive basis, which is in this way determined from the noisy image directly. The summary of presented modifications is summarized in Algorithm 1.
Algorithm 1:
denoising algorithm using the proposed approach
| Input: Image, x |
| 1. Compute the Planck constant using Eq. (5) and Hamiltonian matrices, H, using Eq. (4) |
| 2. Calculate the eigenvectors of Eq. (3) and singular value decomposition (SVD) |
| 3. Calculate the participation ratio using Eq. (7) |
| 4. Fit the Lorentzian fit using Eq. (8) to the distribution of normalized participation ratio and threshold based on the image modes with non-local and non-propagating modes |
| 5. Recover the denoised image using the filtered image |
| Output: Denoised image, x′ |
Figure 6 shows the denoised images using the full set of eigenvectors based on the previous work20 and filtered denoised images are the results of modified quantum approach using only low and high range modes which are shaded in the corresponding participation ratio of noisy image, these results are shown for three SNR’s of 2, 5, 10, and 15. Additionally, histograms of the normalized participation ratio are provided for further clarification on its behavior.
Figure 6.
Comparison between the denoised results of the (i) modified and (ii) original approaches at SNR’s of (a) 2 (b) 5 (c) 15. Corresponding normalized participation ratio plots with the shaded regions which indicate the filtered regions in modified approach and corresponding histogram of the normalized participation ratio are shown in (iii) and (iv) respectively.
In all cases, we observe the comparable results between the modified approach, which include only shaded region, versus the approach with all mode inclusion. To clarify the differences Table I shows the comparison of SSIM and PSNR between two methods.
Table 1.
Comparison SSIM and PSNR for the synthetic Image
| SNR | SSIM | PSNR (dB) | ||
|---|---|---|---|---|
| All modes | Selected modes | All modes | Selected modes | |
| 2 | 0.5 | 0.5 | 22.1 | 21.91 |
| 5 | 0.65 | 0.64 | 24.73 | 24.48 |
| 15 | 0.89 | 0.9 | 31.73 | 32.46 |
The values of SSIM’s are slightly smaller for lower SNR values while slightly larger for the higher SNR values. Overall, the comparison between two approaches, filtered and non-filtered, shows that the contribution of the mid-range eigenvectors is minimal in the reconstruction process and the majority of those modes are related to the added noise. Also, we observe that as the noise level increases, the efficacy of the filtering becomes more effective.
The Role of Planck Constant on Localization in Imaging System
The Planck constant is not a well-established concept for imaging systems. To understand the influence of the Planck constant on the localization, we calculated the participation ratio based on the augmented Planck constants, , as assumed for , and 4 [where for the is near to the previously used Planck constant]. Figure 7 shows the corresponding results for the synthetic image with SNR = 2, for the augmented Planck constants.
Figure 7.
Normalized participation ratio plots of the synthetic image with SNR=2 with augmented Planck constant for (a) α=1 (b) α=2, and (c) α=4.
The results show that the localization or the distinction between different regimes is largely diminished as Planck constant increases. In physics sense, a large Planck constant implies that the Planck length can become larger than the corresponding localization length. Our results show that the choice of Planck constant plays an important role in the identification of the different modes.
Results for the complex image
Here, we present the results for a complex image (Lena image) with a size of 256×256 pixels. We compare the outcomes obtained through the original method, where all modes are utilized for the denoising process, with those achieved through the modified approach, which involves selecting specific modes for denoising and reconstruction, as shown in Fig. 8. The added noise follows a Poisson distribution with an SNR of 15.
Figure 8.
Comparative analysis of denoising methods: quantum inspired approach with all modes vs. modified approach with selected high localization modes. The figure illustrates (a) the Lena image and its zoom-in counterpart (a’), (b) the noisy image and its zoom-in counterpart (b’), (c) the denoised image using all modes and its zoom-in counterpart (c’), and (d) the denoised image using the modified approach and its zoom-in counterpart (d’).
The results illustrate that the denoising process yields comparable results for the modified version when compared to considering all modes. Specifically, the denoising results exhibit a slight decrease in contrast, accompanied by a slightly smoother appearance compared to the original denoising approach. The SSIM values for the original and modified approaches are 0.76 and 0.75, respectively, while the PSNR values for the original and modified approaches are 28.15 dB and 27.85 dB, respectively.
Additionally, Fig. 9 shows the normalized participation ratio for the noisy Lena image presented in Fig. 8-(b). The shaded regions represent the corresponding low and high eigenvalue ranges based on the Lorentzian fit of the participation ratio distribution following the modified approach. We observe a nearly symmetrical participation ratio between low and high eigenvalues, with greater localization and distinct separation into the high participation ratio (mid-eigenvalue) region. These results suggest that for complex images, localization is notably more pronounced compared to simple structured images.
Figure 9.
Normalized participation ratio plots of noisy Lena images. Shaded regions approximately show the corresponding low and high eigenvalue parts that are truncated in modified approach.
Results for the medical image
Lastly, we compare the results obtained between original and modified methods for a computed tomography (CT) image with a size of 260×260 pixels in Fig. 10.
Figure 10.
Comparative analysis of denoising methods: quantum inspired approach with all modes vs. modified Approach with selected high localization modes for CT Images. The figure depicts (a) the original CT image, (b) normalized participation ratio vs. eigenvalues for a noisy CT image with SNR=5, and (c) normalized participation ratio vs. eigenvalues for a noisy CT image with SNR=15; shaded regions show the low and high eigenvalues that are selected in modified approach. For SNR=5, the figure displays (d) the noisy CT image, (e) the denoised image using all modes, and (f) the denoised image using the modified approach. For SNR=15, it shows (g) the noisy CT image, (h) the denoised image using all modes, and (i) the denoised image using the modified approach.
The results show the success of the modified approach to capture the comparative results in all cases while about 70% of all mid-range eigenvalues are dismissed. To compare two approaches in terms of quality metrics, Table 2 summarizes the SSIM and PSNR values; those values consistently show the excellent performance for the modified approach and point to the success of the criteria to choose the effective modes based on the quantum localization for the medical image example.
Table 2.
Comparison SSIM and PSNR for the CT Image
| SNR | SSIM | PSNR (dB) | ||
|---|---|---|---|---|
| All modes | Selected modes | All modes | Selected modes | |
| 2 | 0.51 | 0.51 | 22.73 | 22.73 |
| 5 | 0.57 | 0.57 | 24.62 | 24.6 |
| 10 | 0.69 | 0.69 | 27.81 | 27.81 |
| 15 | 0.79 | 0.79 | 30.84 | 30.85 |
Additionally, we tabulated the simulation times of both approaches for the CT image in Table 3. Each simulation was conducted using in-house MATLAB code on a single node of Bridges2 (with the regular memory 256 GB) at the Pittsburgh Supercomputing Center, and a cluster with 2 AMD EPYC 7742 CPUs, with each node boasting 64 cores and 128 threads. The results demonstrate a consistent computational time savings of over 30% across all SNR cases. We should note that the computational performance of the modified approach also influences the compression of the decomposed image and enhances the management of memory allocation. Although, we demonstrated performance improvement using the modified quantum-inspired approach even on classical computing units such as CPU supercomputers, but the full extent of the computational performance could be prominent when applied on quantum computing devices.
Table 3.
Computational times for the CT Image
| SNR | Computational time selected modes (hrs) | Computational time all modes (hrs) |
|---|---|---|
| 2 | 30.78 | 45.75 |
| 5 | 38.08 | 55.69 |
| 10 | 55.21 | 84.9 |
| 15 | 75.46 | 109.18 |
Remarks
In this paper, we compared an imaging system to an amorphous structure in condensed matter physics and used the idea of localization directly to deal with the noisy image. We proposed an algorithm as a complementary revision of previously developed quantum inspired approach for denoising that utilizes the concept of the localization for filtering process. The modified approach has nearly identical performance to compared with the original method while it compresses the decomposed imaging modes by over 70 %.
One important advantage of the proposed approach is the independence to the set of hyperparameters which were involved in the filtering process and Planck constant value. The Lorentzian function proves to be a robust fit for describing the spectral lines of distribution plots and is effective to determine the separation lines in participation ratio vs eigenvalue plots. In regard to Planck constant definition, the goal was to select the smallest value to capture all quantized image elements. Based on our observations, our definition provides a sufficiently small value where the localized modes are identifiable and the denoising process performs with a good quality. We should note that even smaller value Planck constant results in high localization even for mid-range eigenvalue modes and considerably lower quality denoised images. Despite this trade-off, we maintain confidence in the suitability of our chosen Planck constant definition for our imaging system.
We note that in previous work20 a smoothing process on the image was used in order to compute the adaptive basis. This process was necessary when Anderson localization due to high noise levels leads to all wave functions being localized on a small part of the system and will be difficult to couple with the present approach. This smoothing process was especially needed for one-dimensional signals, even with relatively moderate levels of noise. For two-dimensional systems like images, this regime is present but only at very high noise values, and the present procedure can be safely used up to quite high values of noise.
The modified approach is a standalone algorithm with minimal manual handling of the variables. As mentioned in the recent literature34,35, achieving quantum level performance using conventional classical algorithms such as machine learning may not be tenable on future quantum computers. This exemplifies the importance of this work where the quantum inspired approach solely relies on quantum physics basics with minimal appeal to conventional classical algorithms such as regularization and machine learning. Additionally, the concept of localization is not limited to the participation ratio characterization, as discussed in previous works25,27, there are number of other tools to characterize the amorphous model that might be relevant and applicable to the imaging systems. We purposefully limited the current algorithm to the use of participation ratio due to simple required modifications, and low computational cost. We should further note that the current modifications and depiction of imaging system as amorphous model is adaptable and can be combined with other previous developments of quantum inspired approaches36–39.
Conclusions
In conclusion, this paper presents a novel quantum-inspired approach for denoising images, leveraging the concept of localization within an amorphous model framework. Building upon previous work, the proposed algorithm demonstrates comparable performance to existing methods while significantly reducing the computational complexity and eliminating the need for manual intervention in parameter tuning. Furthermore, the adoption of quantum principles aligns with the growing interest in quantum computing and offers promising avenues for addressing noise-related challenges across diverse imaging modalities both on system level and component level. The former refers to reconstructed image resolution in nuclear medicine modalities especially in count starved geometries such as limited angle tomography using time of flight Positron Emission Tomography10,11,40,41, organ-specific Single Photon Emission Computed Tomography14,42,43. On detector level implementation, quantum-inspired denoising can play a significant role in nuclear imaging detectors during event positioning estimation44, and detector projection processing for novel unconventional detector designs45–48. By embracing quantum principles without heavy reliance on additional classical algorithms, our standalone approach presents a promising path for using quantum-inspired tools in image processing and could lead to new quantum computing algorithms in the line of recent proposals38.
Acknowledgments
We acknowledge support from NSF grant: med240002p, enabling computational simulations through the ACCESS program clusters. This work is partially supported by the NIH grant R01HL145160. This work was also supported by CIMI Excellence Laboratory under ANR Grant ANR-11-LABX-0040 within the French State Programme “Investissements d’Avenir.”
Footnotes
Competing interests
The authors declare no competing interests.
Contributor Information
Amirreza Hashemi, Massachusetts General Hospital & Harvard Medical School.
Sayantan Dutta, Weill Cornell Medicine.
Bertrand Georgeot, Université de Toulouse, CNRS, UPS, LPT.
Denis Kouamé, Université de Toulouse, CNRS, IRIT.
Hamid Sabet, Massachusetts General Hospital & Harvard Medical School.
Data Availability
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.
References
- 1.Arabi H. & Zaidi H. Spatially guided nonlocal mean approach for denoising of PET images. Medical Physics 47, (2020). [DOI] [PubMed] [Google Scholar]
- 2.Mishra D., Chaudhury S., Sarkar M. & Soin A. S. Ultrasound image enhancement using structure oriented adversarial network. IEEE Signal Processing Letters 25, 1349–1353 (2018). [Google Scholar]
- 3.Mannam V. et al. Real-time image denoising of mixed Poisson–Gaussian noise in fluorescence microscopy images using ImageJ. Optica, OPTICA 9, 335–345 (2022). [Google Scholar]
- 4.Hashemi A., Feng Y. & Sabet H. Spherical CNN for Medical Imaging Applications: Importance of Equivariance in image reconstruction and denoising. Preprint at 10.48550/arXiv.2307.03298 (2023). [DOI] [Google Scholar]
- 5.Melot C., Boursier Y., Aujol J.-F. & Anthoine S. Some proximal methods for Poisson intensity CBCT and PET. Inverse Problems and Imaging 6, 565–598 (2012). [Google Scholar]
- 6.Mikhno A., Angelini E. D., Bai B. & Laine A. F. Locally weighted total variation denoising for ringing artifact suppression in PET reconstruction using PSF modeling. Proc IEEE Int Symp Biomed Imaging 2013, 1252–1255 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 7.Melot C. et al. Locally weighted total variation denoising for ringing artifact suppression in pet reconstruction using PSF modeling. Biomedical Imaging (ISBI), 2013 IEEE 10th International Symposium on 6, 1252–1255 (2013). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 8.Achim A., Bezerianos A. & Tsakalides P. Novel bayesian multiscale method for speckle removal in medical ultrasound images. IEEE Transactions on Medical Imaging 20, 772–783 (2001). [DOI] [PubMed] [Google Scholar]
- 9.Santos C. A. N., Martins D. L. N. & Mascarenhas N. D. A. Ultrasound image despeckling using stochastic distance-based bm3d. IEEE Transactions on Image Processing 26, 2632–2643 (2017). [DOI] [PubMed] [Google Scholar]
- 10.Sajedi S., Bläckberg L., Majewski S. & Sabet H. Limited-angle TOF-PET for intraoperative surgical applications: proof of concept and first experimental data. J. Inst. 17, T01002 (2022). [Google Scholar]
- 11.Sajedi S., Feng Y. & Sabet H. Limited-angle TOF-PET for intraoperative surgical applications: Simulation Study. Preprint at 10.48550/arXiv.2402.06742 (2024). [DOI] [Google Scholar]
- 12.Barutcu S., Aslan S., Katsaggelos A. K. & Gürsoy D. Limited-angle computed tomography with deep image and physics priors. Sci Rep 11, 17740 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 13.Hu Z. et al. An improved statistical iterative algorithm for sparse-view and limited-angle CT image reconstruction. Sci Rep 7, 10747 (2017). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 14.Feng Y. & Sabet H. Novel Compton SPECT Camera for Whole-Body Diagnostic and Targeted Radionuclide Therapy Applications. in 2023 IEEE Nuclear Science Symposium, Medical Imaging Conference and International Symposium on Room-Temperature Semiconductor Detectors (NSS MIC RTSD) 1–1 (2023). doi:10.1109/NSSMICRTSD49126.2023.10338384. [Google Scholar]
- 15.Omata A. et al. Multi-modal 3D imaging of radionuclides using multiple hybrid Compton cameras. Sci Rep 12, 2546 (2022). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Uenomachi M. et al. Simultaneous in vivo imaging with PET and SPECT tracers using a Compton-PET hybrid camera. Sci Rep 11, 17933 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 17.Eldar Y. C. Quantum signal processing. (Massachusetts Institute of Technology, 2001). [Google Scholar]
- 18.Aytekin Ç., Kiranyaz S. & Gabbouj M. Quantum mechanics in computer vision: Automatic object extraction. in 2013 IEEE International Conference on Image Processing 2489–2493 (2013). doi: 10.1109/ICIP.2013.6738513. [DOI] [Google Scholar]
- 19.Youssry A., El-Rafei A. & Elramly S. A quantum mechanics-based framework for image processing and its application to image segmentation. Quantum Information Processing 14, 3613–3638 (2015). [Google Scholar]
- 20.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. Quantum Mechanics-Based Signal and Image Representation: Application to Denoising. IEEE Open Journal of Signal Processing (2021) doi: 10.1109/OJSP.2021.3067507. [DOI] [Google Scholar]
- 21.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. Despeckling Ultrasound Images Using Quantum Many-Body Physics. 2021 IEEE International Ultrasonics Symposium (2021) doi:10.1109/IUS52206.2021.9593778. [Google Scholar]
- 22.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. Plug-and-Play Quantum Adaptive Denoiser for Deconvolving Poisson Noisy Images. IEEE ACCESS (2021) doi: 10.1109/ACCESS.2021.3118608. [DOI] [Google Scholar]
- 23.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. Image Denoising Inspired by Quantum Many-Body physics. 2021 IEEE International Conference on Image Processing (2021) doi: 10.1109/ICIP42928.2021.9506794. [DOI] [Google Scholar]
- 24.Schrödinger E. An Undulatory Theory of the Mechanics of Atoms and Molecules. Phys. Rev. 28, 1049–1070 (1926). [Google Scholar]
- 25.Allen P. B., Feldman J. L., Fabian J. & Wooten F. Diffusons, locons and propagons: Character of atomic vibrations in amorphous Si. Philosophical Magazine B 79, 1715–1731 (1999). [Google Scholar]
- 26.Feldman J. L., Kluge M. D., Allen P. B. & Wooten F. Thermal conductivity and localization in glasses: Numerical study of a model of amorphous silicon. Physical Review B 48, 12589–12602 (1993). [DOI] [PubMed] [Google Scholar]
- 27.Seyf H. R. & Henry A. A method for distinguishing between propagons, diffusions, and locons. Journal of Applied Physics 120, (2016). [Google Scholar]
- 28.Ioffe A. F. & Regel A. R.. Non-Crystalline Amorphous, and Liquid Electronic Semiconductors. Progress in semiconductors 4, 237–291 (1960). [Google Scholar]
- 29.Anderson P. W. Absence of Diffusion in Certain Random Lattices. Phys. Rev. 109, 1492–1505 (1958). [Google Scholar]
- 30.Elliott S. R. Physics of Amorphous Materials. (Longman Scientific & Technical, 1990). [Google Scholar]
- 31.Barkema G. & Mousseau N. High-quality continuous random networks. Physical Review B 62, 4985–4990 (2000). [Google Scholar]
- 32.Tersoff J. Empirical interatomic potential for silicon with improved elastic properties. Physical Review B 38, 9902–9905 (1988). [DOI] [PubMed] [Google Scholar]
- 33.Gale J. D. & Rohl A. L. The General Utility Lattice Program (GULP). Molecular Simulation 29, 291–341 (2003). [Google Scholar]
- 34.Lau J. W. Z., Lim K. H., Shrotriya H. & Kwek L. C. NISQ computing: where are we and where do we go? AAPPS Bull. 32, 27 (2022). [Google Scholar]
- 35.Schuld M. & Killoran N. Is Quantum Advantage the Right Goal for Quantum Machine Learning? PRX Quantum 3, 030101 (2022). [Google Scholar]
- 36.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. Deep Unfolding of Image Denoising by Quantum Interactive Patches. 2022 IEEE International Conference on Image Processing (2022) doi: 10.1109/ICIP46576.2022.9897959. [DOI] [Google Scholar]
- 37.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. A Novel Image Denoising Algorithm Using Concepts of Quantum Many-Body Theory. (2022). [Google Scholar]
- 38.Dutta S., Basarab A., Kouamé D. & Georgeot B. Quantum Algorithm for Signal Denoising. IEEE Signal Processing Letters 31, 156–160 (2024). [Google Scholar]
- 39.Dutta S., Basarab A., Georgeot B. & Kouameˊ D. DIVA: Deep Unfolded Network from Quantum Interactive Patches for Image Restoration. Pattern Recognition (2024). [Google Scholar]
- 40.Worstell W. A. et al. Measurement of the Parametrized Single-Photon Response Function of a Large Area Picosecond Photodetector for Time-of-Flight PET Applications. IEEE Transactions on Radiation and Plasma Medical Sciences 5, 651–661 (2021). [Google Scholar]
- 41.Sheikhzadeh P. et al. Concept design and Monte Carlo performance evaluation of HeadphonePET: a novel brain-dedicated PET system based on partial cylindrical detectors. J. Inst. 13, P07008 (2018). [Google Scholar]
- 42.Bläckberg L. et al. Dynamic Cardiac SPECT for diagnostic and theranostics applications: latest results . 2020 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC) (2020) doi:10.1109/NSS/MIC42677.2020.9508002. [Google Scholar]
- 43.Feng Y., Hashemi A., Soleymani S., Ottensmeyer M. & Sabet H. DB-SPECT, a Fixed-Gantry SPECT Scanner for Dynamic Brain Imaging: Design Concept and First Results. in 2022 IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC) 1–3 (2022). doi:10.1109/NSS/MIC44845.2022.10399152. [Google Scholar]
- 44.Ullah M. N. & Levin C. S. Application of Artificial Intelligence in PET Instrumentation. PET Clinics 17, 175–182 (2022). [DOI] [PubMed] [Google Scholar]
- 45.Bläckberg L., Moebius M., El Fakhri G., Mazur E. & Sabet H. Light Spread Manipulation in Scintillators Using Laser Induced Optical Barriers. IEEE Transactions on Nuclear Science 65, 2208–2215 (2018). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Yoshida E., Obata F., Kamada K., Yoshikawa A. & Yamaya T. Development of crosshair light sharing PET detector with TOF and DOI capabilities using fast LGSO scintillator. Phys. Med. Biol. 66, 225003 (2021). [DOI] [PubMed] [Google Scholar]
- 47.Bläckberg L., Sajedi S., Fakhri G. E. & Sabet H. A layered single-side readout depth of interaction time-of-flight-PET detector. Phys. Med. Biol. 66, 045025 (2021). [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Freire M. et al. Position estimation using neural networks in semi-monolithic PET detectors. Phys. Med. Biol. 67, 245011 (2022). [DOI] [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
The datasets used and/or analysed during the current study available from the corresponding author on reasonable request.










