Abstract
Background
The first solid-state silicon photomultiplier (SiPM) digital photon counting (DPC) clinical PET/CT system was introduced by Philips in recent years. The system differs from other SiPM-based PET/CT systems and uses lutetiumyttrium oxyorthosilicate (LYSO) scintillators directly coupled with their own individual SiPM DPC detectors eliminating the need for Anger-logic positioning decoding. We evaluated the system performance, characteristics, and stability of the next generation DPC clinical PET/CT based on NEMA NU2-2012 tests, NEMA NU2-2018 test (timing resolution) and human studies.
Results
An energy resolution of 11.2% was measured. NEMA NU2-2012 tests revealed a spatial resolution (mm in FWHM) from (3.96, 4.01, 4.01) at 1 cm to (5.81, 5.83, 4.95) at 20 cm for (axial, radial, tangential). A 5.7 cps/kBq system sensitivity was measured. Peak noise equivalent count rate (NECR) and peak true count rate could not be determined as each exhibited increasing values up to the maximum activity measured (~ 1100 MBq). The maximum NECR was 171 kcps @ 50.5 kBq/mL, with corresponding scatter fraction of 30.8% and maximum trues of 681 kcps. NEMA hot sphere contrast ranged from 62% (10 mm) to 88% (22 mm), cold sphere contrast of 86% (28 mm) and 89% (37 mm). A timing resolution of 322 ps (22Na point source based) and 332 ps (NEMA NU2-2018) was obtained. It revealed < 1% change in TOF timing and ± 0.4% change in energy resolution during 31-month stability monitoring. CQIE assessment found < 3% axial variance in SUV. 100–60% recovery coefficients of activity concentration at various sphere sizes and contrast levels were measured.
Conclusions
This scanner represents the first solid-state DPC PET/CT, a technologic leap beyond photomultipliers tubes and anger logic. It presents considerable improvements in system performance and characteristics with excellent time-of-flight capability compared to conventional photomultiplier tube (PMT) PET/CT systems. The DPC system leads to promising clinical opportunities with excellent image quality, lesion detectability, and diagnostic confidence.
Keywords: Digital photon counting, Solid state, Silicon photomultiplier, Positron emission tomography, System performance
Background
PET/CT has evolved to be an essential imaging modality in oncology and neuroscience. Up to now, PET detectors have been mainly based on photomultiplier tubes (PMT) which have advantages of high gain signal amplification, multichannel capabilities and good timing performance, however have also disadvantages of limited photon-to-electron quantum conversion efficiency and relative bulkiness [1, 2]. Recent efforts pushed beyond these limitations to further improve PMT PET/CT system performance [3–5].
Modern solid-state detectors were developed in the 90s using silicon metal oxide semiconductor (MOS) structures with avalanche breakdown mode operation capable of detecting single light photons [6]. An initial concept of Geiger-mode avalanche photodiodes (APDs) or silicon photomultipliers (SiPMs) was proposed in the late 90s combining with many features of PMTs and traditional APDs [7]. Analog SiPM detectors started to be available for medical applications around 2004 [8] and were introduced to more imaging applications with relative compact design and better MR compatibility however initially without time of flight (TOF) capabilities [9–16]. Analog SiPM detectors using light-sharing designs use single photon avalanche diode (SPAD) arrays to detect single scintillation photons, while the pulses generated by multiple SPADs are combined into one analog output signal requiring off-chip processing and anger logic decoding [17].
Philips Healthcare introduced the first solid-state, SiPM digital photon counting (DPC) PET/CT system at RSNA 2013. Before that, its prototype system demonstrated better image quality and diagnostic accuracy compared with Gemini TF PET [18]. The DPC detector differs from analog SiPM detectors: each SPAD is part of an array running as a digital counter, and the readout of the digital signal provides a direct count of the number of scintillation photons detected without analog signal processing [17, 19]. The system uses lutetiumyttrium oxyorthosilicate (LYSO) scintillators directly coupled with individual SiPM DPC detectors eliminating the need for Anger-logic positioning decoding [20, 21].
This medical physics focused study evaluates the DPC system performance characteristics in sensitivity, noise equivalent counting rate (NECR), spatial resolution, image quality, energy resolution, and TOF timing resolution using National Electrical Manufacturers Association (NEMA) NU2-2012 and the recent NU2-2018 as well as other methodologies.
Methods
System specifications
The Vereos PET/CT (dPET) (Philips, Cleveland OH) is a system based on SiPM DPC technology coupled with a 64-slice helical CT of the Ingenuity class, and its first system was operational at Wright Center of Innovation in Biomedical Imaging (WCIBMI) at The Ohio State University (OSU) since 07/2014. This system fulfilled all system specifications of the commercially released system (10/2017) and was used to perform clinical trials for regulatory submissions. The CT uses a 40 mm axial field of view (FOV) with 3D dose modulation for low dose CT capabilities integrated with an iterative reconstruction technique (iDose4) and the Metal Artifact Reduction for Orthopedic Implants algorithm. The 764 mm PET detector ring spans 164 mm in the axial FOV and is composed of 18 flat detector modules with 4 by 5 array SiPM detector tiles on each module. Every tile consists of a 4 × 4 matrix of sensor silicon dies, and each die is a 2 × 2 matrix of digital photon counter detectors (silicon pixels). Every pixel couples directly to a 3.86 × 3.86 × 19 mm3 single LYSO crystal for a total of 23,040 crystal-DPC pairs. 3200 SPAD (microcells) are integrated on each pixel resulting in 73,728,000 microcells that enable detection of single scintillation photons with each photon being converted directly into a pure binary output signal (Fig. 1). The number of microcells recording a photon is read out as the total number of photons detected by a pixel.
PET data are acquired in 3D mode and stored in a list-mode file containing position, timing, and energy information of each DPC-collected event. PET reconstruction is performed using a list-mode-based TOF OSEM algorithm with blobs as basic functions [22, 23]. It uses a Monte Carlo-based scatter simulation for scatter correction [24] and Casey averaging for smoothed randoms estimation [25]. The system applies 2.0 ns, 4.0 ns, and 4.6 ns coincidence windows depending on the transaxial FOVs (256 mm for brain, 576 mm and 676 mm for body). PET reconstruction uses isotropic voxels for standard definition (SD) (4 × 4 × 4 mm3), high definition (HD) (2 × 2 × 2 mm3) and ultra-high definition (UHD) (1 × 1 × 1 mm3). Post-reconstruction image processing includes an optional Richardson–Lucy, maximum-likelihood resolution recovery implementation and Gaussian filtering [26–28].
Digital photon counting (DPC)
The DPC technology allows every microcell to be individually activated or inactivated, SPADs and data processing are integrated onto a single silicon chip at each pixel allowing fast and accurate ultra-low light single photon detection, and each microcell directly detects and counts the breakdown of an individual SPAD on its silicon chip. A light photon is detected by one of the integrated 3200 microcells yielding a pure binary signal measured by the on-chip photon counter and timer. Background noise, or say dark count rate (DCR), is measured and managed effectively for each individual counter. The biggest contribution to the overall sensor DCR is caused by only a small percentage of the cells (such as ~ 10% cells responsible for 70–80% DCR). Disabling high dark count rate cells on a small active sensor area leads to significantly reduced overall sensor DCR; therefore, the overall DCR can be greatly reduced by switching off the noisiest cells. Each sensor operates independently from the other sensors. Only those die sensors that detect sufficient photons reaching the configured thresholds will start the acquisition sequence (Fig. 2). In the beginning, a die sensor is in the “ready state,” where all its microcells are fully charged, and the system waits for the start of the photon events until a trigger occurs. When the number of photons detected in a silicon pixel becomes higher than the configured threshold, it prompts a timestamp to be saved and begins a validation process to detect a user-configured number of further photons within a certain time. If this validation threshold is exceeded, there is a subsequent integration period before a readout process sends data (four photon count values, one per silicon pixel on the die, and one timestamp per event) to a readout buffer. After readout, the microcells are recharged so that the die is ready for further data acquisition. If the validation threshold was never reached, all microcells are immediately recharged and go back to the “ready state.” At the end, the photon counter is read out by summing overall detected photons with a timestamp, and the whole process is entirely digital without need of signal amplification. The localization determination of the scintillation light created by gamma-ray interaction using the DPC compared to traditional PMT-based approach is shown in Fig. 3.
System performance measurements
System performance measurements of the dPET utilized NEMA NU 2-2012 procedures [29] for spatial resolution, sensitivity, scatter fraction, count loss, NECR, and image quality.
Spatial resolution of a PET scanner is an intrinsic feature of the device, which reflects the ability of the system to distinguish between two points after image reconstruction, and is usually measured in transaxial (radially and tangentially) and axial directions. Spatial resolution of the system was measured using a point source of 4 MBq 18F in a capillary tube (tube inside diameter ≤ 1 mm, tube length = 100 mm, axial extend of the activity: approximately 1 mm). Measurements were performed at the center of axial FOV and three-eighths of the axial FOV from the center of the FOV with (x, y) locations of (0, 1), (0, 10), and (0, 20) cm. For the axial resolution measurements, we rotated the capillary with 90° which was perpendicular to the long axis of the system so that the axial extent of the source was within the diameter of the capillary (1 mm or less). List-mode data were reconstructed using 3D Fourier re-projection with an unapodized filter [30]. Pixel size of the reconstructed images used for spatial resolution calculation was 1 × 1 × 1 mm3. Axial, radial, and tangential resolutions in full width at half-maximum (FWHM) and full width at tenth-maximum (FWTM) for each radius (1, 10, and 20 cm), averaged over both axial positions were calculated and reported.
Sensitivity of PET represents the ability to detect true coincidence events in cps/kBq, which typically depends on solid angle, system photon detection efficiency, dead time and other factors, and is measured based on established techniques [31, 32]. NEMA sensitivity was measured at the center and 10 cm off in transverse FOV using five aluminum sleeves (Data Spectrum Corp., Hillsborough, NC; 70 cm in length, inner diameters 3.9–16.6 mm) and a length of 70 cm plastic tubing with 6 MBq 18F. The initial activity was calibrated in a dose calibrator which in general has less than 1% accuracy error. Successive measurements were performed 10 min post 18F injection by adding aluminum sleeves of known attenuation. Decay-corrected count rate was summed for all slices to give the total count rate for each sleeve and then extrapolated to an attenuation free measurement.
Measurements of scatter fraction, count losses, and NECR were performed using the NEMA PET scatter phantom. A plastic tubing (3.2 mm inner diameter) filled with ~ 1100 MBq 18F over a length of 70 cm was measured over 16-h until the activity decayed to a low level with true events losses of < 1%. Data were binned into sinograms and used to calculate the scatter fraction and count rates.
For measurements of image quality and scatter corrections, a NEMA IEC Body phantom with 18F (75.9 MBq) was abutted with a 70 cm scatter cylinder phantom containing 18F line source (140 MBq) to approximate the clinical situation of having activity extending beyond the scanner. The imaging phantom contains two cold spheres (28 and 37 mm) and four hot spheres (10–22 mm), positioned circular with a radius of 57.2 mm at the center of the phantom similar to NEMA NU 2-2012 standard. The sphere-to-background ratio (SBR) was 4. Acquisition was repeated three times with 180 s/bed. Contrast for each hot sphere (QH) and each cold sphere (QC) was calculated as
and
where CM,S and CM,B are the averaged activity concentration in a circular ROI with a diameter equal to the inner diameter of the sphere (S) being measured (M) or in the background (B) and CT,S, CT,B are the true (T) activity concentration.
The lung error was calculated by averaging the relative lung errors of each slice in axial direction according to the NEMA NU2-2012 definition.
Energy and timing resolution are not part of the standard NEMA NU2-2012 testing. The coincidence timing resolution as a function of activities was measured using the NEMA NEC phantom data according to NEMA NU2-2018 standard and its associated methodologies [33–35]. For the stability monitoring, energy and timing resolution were additionally measured using built-in PET daily quality check (QC) procedures. Energy window was set at 88–120% of 511 keV (450–613 keV), and the coincidence-timing window was set at 4 ns with a delayed coincidence window technique utilized to estimate the random coincidences. A 3.7 MBq 22Na point source centered in PET FOV was used with daily acquisition of PET coincidence (~ 200 Mcounts). Energy and timing resolution were then calculated separately from event histograms with 4 keV bins for energy and 19.6 ps bins for timing. In addition, sensitivity as a function of activities was separately measured using the NEMA NEC phantom data [34, 35].
System stability
System stability of sensitivity (in relative count rate), energy resolution, and timing resolution were monitored over a 31-month period between October 2014 and May 2017. These parameters were extracted from the built-in PET daily QC and corresponding system log files.
PET image quality assessment
PET image quality was additionally evaluated for uniformity, partial volume effect (PVE), maximum recovery coefficients (RCmax), and clinical lesion detectability.
PET uniformity assessment was performed according to the NCI Center for Quantitative Imaging Excellence (CQIE) program guidelines [36]. A 9293 mL water cylinder phantom with 53 MBq FDG was scanned and reconstructed using 3D OSEM TOF. A 2D circular region-of-interest (ROI, ~ 200 cm2) was placed across all slices. Images were analyzed according to CQIE criteria (SUVmean of 0.9–1.1 with ≤ 10% variances in axial).
For PVE assessment, a Jaszczak Flangeless Esser PET phantom with rod inserts (4.8–12.7 mm) was imaged at 60 min post 48 MBq 18F-FDG injection with 90 s/bed for body and 10 min for brain according to ACR accreditation guidelines [37]. Images were reconstructed in SD, HD, and UHD with different voxel sizes.
The phantom procedures different from the NEMA NU 2-2012 standard are detailed below for assessment of RC: a NEMA IEC Body phantom (185 ± 3.7 MBq 18F-FDG) filled with 6 hot spheres (10–37 mm) and varying SBRs of 2, 4, 8, 16, 32, 64, and 100 was imaged with 75 s/bed and reconstructed in SD (4 × 4 × 4 mm3) using 3D OSEM TOF (3i15s for dPET and 3i33s for cPET). Spherical ROIs with approximately 37 mm in diameter were placed on each of the spheres. RCmax was analyzed and defined as
where CM,S is the maximum of the measured (M) activity concentration in each sphere, and CT,S is the true (T) activity concentration for sphere ROIs.
Assessments of clinical image quality and lesion detectability were performed based on PET/CT scans of clinical patients. PET/CT scans were acquired with 90 s/bed on the dPET before or after local standard of care PET/CT on a conventional PMT-based Gemini TF 64 system (cPET, 90 s/bed, 75 min uptake, 481 MBq 18F-FDG). All data were reconstructed using 3D TOF OSEM with 3 iterations (subset of 15 for SD dPET, and 33 for SD cPET). dPET CT was reconstructed using iDose4 in 4 mm and used for PET attenuation correction. SUVpeak values of representative lesions were calculated using MIMSoftware 6.7 (MIM Software Inc.). The study (NCT02283125) was approved by the institutional review board, and all subjects signed an informed consent.
Results
System performance measurements and system stability
NEMA spatial resolution, sensitivity, NECR, count rate, scatter fraction, image quality, and timing resolution as well as the system stability in timing resolution, energy resolution and sensitivity are presented.
Table 1 demonstrates the spatial resolution of the dPET system, ranging from (in FWHM) 3.96 mm (axial), 4.01 mm (radial), and 4.01 (tangential) at the center toward the periphery of 5.81 mm (axial), 5.83 mm (radial), and 4.95 mm (tangential) at 20 cm off center.
Table 1.
Spatial resolution | ||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|
Measurements 01a | Measurements 02 | |||||||||||
FWHM | FWTM | FWHM | FWTM | |||||||||
Direction | 1 cm | 10 cm | 20 cm | 1 cm | 10 cm | 20 cm | 1 cm | 10 cm | 20 cm | 1 cm | 10 cm | 20 cm |
Axial | 3.96 | 4.83 | NA | 8.37 | 9.45 | NA | 4.14 | 4.72 | 5.81 | 8.51 | 9.30 | 11.76 |
Transverse (radial) | 4.11 | 4.47 | NA | 8.38 | 8.72 | NA | 4.01 | 4.64 | 5.83 | 8.37 | 8.97 | 10.41 |
Transverse (tangential) | 4.11 | 4.38 | NA | 8.38 | 8.94 | NA | 4.01 | 4.41 | 4.95 | 8.37 | 8.91 | 10.43 |
Spatial resolution is measured in millimeters with radial offset at 1 cm, 10 cm, and 20 cm
aMeasurement 01 contains all tests except for the radial offset at 20 cm; we repeated all test including the 20 cm offset results as shown in measurements 02
The average NEMA sensitivity of the dPET system was 5721 cps/MBq at the center and 5637 cps/MBq at a 10 cm radial offset from the FOV center. Figure 4a details the measured NEMA sensitivity profile along axial slices, and Fig. 4b shows the stability of system sensitivity over 31 months (better than 1.5% variability) by monitoring the relative count rate as a surrogate for sensitivity compared to baseline.
Figure 5 summarizes count loss measurements of the dPET as a function of activity concentration. With the amount of ~ 1100 MBq (~ 30 mCi) 18F used for the count loss test, neither the peak true count rate nor the peak NECR could not be found as the system did not show a peak value beyond which the NECR began to decrease with increasing activity. Consequently, in this study, we use ‘maximum’ instead of ‘peak’ to describe these results. It revealed a maximum NECR of 171 kcps at 50.5 kBq/mL, with corresponding true count rate of 681 kcps and scatter fraction of 30.8% at the maximum NECRs, respectively.
NEMA image quality of the IEC body phantom PET reconstructed in HD using 3D OSEM with point spread function (PSF) is shown in Fig. 6a. Image contrast recovery and background variability are given in Fig. 6b and c. The average lung error was 4.18 ± 0.05%.
Results of timing and energy resolution of the dPET system are shown in Fig. 7. Figure 7a demonstrates the NEMA NU2-2018 coincidence timing resolution as a function of activity concentration which was measured as 332 ps in FWHM and 640 ps in FWTM, with robust distribution (1 ± 2% for FWHM and 2 ± 1% for FWTM) obtained as increasing activity concentration from 0 to 50.5 kBq/mL. Fig. 7b and c shows the stability of timing and energy resolution (22Na point source based) within the monitoring time window. It revealed < 1% variability for timing and < 0.5% variance for energy. The average energy resolution was about 11.2% FWHM.
Additional phantom measurements
Figure 8 summarizes dPET image quality using different phantom measurements. dPET images of the ACR phantom is shown in Fig. 8a. With the reduced PVE using smaller voxels, the smallest 4.8 mm rods are detectable on both HD and UHD dPET. Fig. 8b shows the CQIE uniformity of dPET (256 mm FOV) giving < 3% axial variation in SUV which is well below the CQIE 10% acceptable threshold. Images of the IEC body phantom varying with SBRs are compared between dPET and cPET shown in Fig. 8c. Increasing SBR to 16 and above, deformation of the spheres and artifacts for the lung insert appeared to be more and more visible on cPET but not dPET images, and better sphere delineation with enhanced contrast adapting to different SBRs was found on dPET (the potential reason is given in the “Discussion” section). Quantitatively, it indicated an average differences of (− 7 ± 4%, − 6 ± 5%, − 5 ± 5%, − 6 ± 5%, − 22 ± 8%, and − 28 ± 12%) for spheres of (37, 28, 22, 17, 13, and 10 mm) over all SBRs, and an average differences of (− 3 ± 4%, − 10 ± 7%, − 14 ± 10%, − 7 ± 12%, − 16 ± 11%, − 19 ± 13%, and − 18 ± 15%) for SBRs of (2, 4, 8, 16, 32, 64, and 100) over all spheres, for RCmax of cPET compared to dPET.
Clinical patient studies
While patient studies are not the focus of this paper, Fig. 9 presents an intra-individual comparison between cPET and dPET of the same clinical patient, which demonstrates improved lesion detectability with better contrast of lesions on the 322 ps dPET compared to the 550 ps cPET.
Figure 10 presents a clinical FDG case scanned on the dPET system and reconstructed using SD, HD, and UHD algorithms by isotropically reducing voxel sizes in consistent to the EARL effort using the DPC system [38]. Dramatically enhanced lesion visibility with improved diagnostic confidence using blinded reader studies [39] was found on HD (8 mm3 voxel) and particularly UHD (1 mm3 voxel) dPET images.
Discussion
dPET enables every digital photon counter detector to be directly coupled to a single scintillator and leads to higher count rate detection efficiency across a more uniform scintillator distribution compared to cPET. The individual DPC detector controlling greatly reduces the impact of count rate dependent pile-up on energy and timing resolution, and provides highly stable performance across a large dynamic range of count rates.
The major improvement of the dPET system is its significantly improved TOF timing resolution. The benefit of TOF PET has been well-established and became a benchmark technology [40, 41]. Current cPET has timing resolution of 400–600 ps with a scintillator length range of 12–25 mm [42–50]. With the introduction of SiPM-based photo detection technologies, the available solid-state PET systems are achieving timing resolution in the range of 300–400 ps [21, 51], with the investigated dPET demonstrating 322 ps (Table 2). The 322 ps TOF approximately halves the uncertainty from 600 ps TOF PET systems, limits the noise contribution from fewer voxels during PET reconstruction, improves image SNR, and converges faster in 3D-OSEM TOF reconstructions necessitating less iterative steps to achieve optimal image quality. In addition, the study used both the 22Na point source (daily PET QC) and the NEMA NEC phantom data (NEMA NU2-2018 new standard) to determine the coincidence timing resolution. We found that the timing resolution measured using the point source based method is ~ 10 ps better than using the NEMA NEC phantom based methodology. To the best of our knowledge, this is potentially due to the vendor-specific software improvement in daily QC for the timing resolution measurement, as well as the fact that the 18F line source in the NEMA NEC phantom is typically not perfectly straight.
Table 2.
Manufacture | GE | GE | Philips | Philips | Philips | Siemens | Siemens | Toshiba |
---|---|---|---|---|---|---|---|---|
PET/CT model | Discovery MI (4-ring) [51] | Discovery 690 [43] |
Vereos (this work) | Ingenuity TF [44] | Gemini T [42] | Biograph mCT flow [45] | Biograph mCT [46, 47] | Celesteion [48–50] |
Photo detector | SiPM | PMT | SiPM | PMT | PMT | PMT | PMT | PMT |
Number of detectors | 9792 | 256 | 23,040 | 420 | 560 | 768 | 768 | 480 |
Scintillator | LYSO | LYSO | LYSO | LYSO | LYSO | LSO | LSO | LYSO |
Number of crystals | 19,584 | 13,824 | 23,040 | 28,336 | 28,336 | 32,448 | 32,448 | 30,720 |
Crystal size (mm3) | 3.95 × 5.3 × 25 | 4.2 × 6.3 × 25 | 3.86 × 3.86 × 19 | 4 × 4 × 22 | 4 × 4 × 22 | 4 × 4 × 20 | 4 × 4 × 20 | 4 × 4 × 12 |
Ring diameter (cm) | 74.4 | 81.0 | 76.4 | 90.0 | 90.3 | 84.2 | 84.2 | 88.0 |
Axial FOV (cm) | 20.0 | 15.7 | 16.4 | 18.0 | 18.0 | 22.1 | 22.1 | 19.6 |
Plane spacing (mm) | n/a | n/a | 1, 2, or 4 | 2 or 4 | 2 or 4 | 2 | 2 | 2 |
TOF Timing resolution (ps) | 375 | 544 | 322 | 502 | 585 | 555 | 527 | 410 |
Sensitivity (cps/kBq) | 13.7 | 7.4 | 5.7 | 7.3 | 6.6 | 9.6 | 9.7 | 4.0 |
Transverse resolution @ 1 cm (mm) | 4.1 | 4.7 | 4.0 | 4.8 | 4.8 | 4.3 | 4.4 | 5.1 |
Transverse resolution @ 10 cm (mm) | 5.0 | 5.1 | 4.4 | 5.1 | 5.2 | 4.9 | 4.9 | 5.1 |
Axial resolution @ 1 cm (mm) | 4.5 | 4.7 | 4.0 | 4.7 | 4.8 | 4.3 | 4.4 | 5.0 |
Axial resolution @ 10 cm (mm) | 6.0 | 5.6 | 4.8 | 5.2 | 4.8 | 5.9 | 5.7 | 5.4 |
Peak NECR (kcps @ kBq/mL) | 193.4 @ 21.9 | 139.1 @ 29.0 | 171 @ 50.5 | 124.1 @ 20.3 | 125 @ 17.4 | 185 @ 29 | 156 @ 31.1 | ≥51 @ n/a |
Energy resolution (%) | 9.4 | 12.4 | 11.2 | 11.1 | 11.5 | n/a | 11.5 | 11.3 |
Scatter fraction at peak NECR (%) | 40.6 | 37 | 30.8 | 36.7 | 27 | 33.4 | 32.7 | 42.7 |
Improvement of PET spatial resolution is another important feature of the dPET system. The fundamental limits of PET spatial resolution are impacted predominantly by crystal size in addition to positron range, non-collinearity, positioning decoding, and reconstruction methods. These factors limit the effective spatial resolution to different degrees. The spatial resolution can be parameterized as
where Kr is a factor of 1.2–1.5 that resulted from reconstruction methodologies [52], Ri is the intrinsic resolution given by d/2 with d as the crystal width, Rp is the error due to positron range (~ 0.2 mm for 18F), Ra is the error from PET non-collinearity given by 0.0022D with D as the ring diameter, and Rl as the decoding error due to anger logic positioning localization [31, 53]. The dPET system with 1:1 coupling of scintillator and SiPM detector does not need anger logic position decoding and therefore its degradation including distortions and edge effects is removed (Rl = 0). Kr is adjusted to be 1.43–1.54 for the dPET system after applying our NEMA spatial resolution results onto the above formula. A 10–20% improvement of the NEMA spatial resolution compared to the cPET [42] was obtained. In addition, depth-of-interaction (DOI) corrections may further improve the precision of annihilation localization and spatial resolution; it is expected that DOI integration will be available in future dPET systems.
NEMA sensitivity of the dPET system was found to be less than its former PMT PET/CT systems (Ingenuity TF 64, Gemini TF 64). In 3D mode, PET sensitivity degrades from peak at center to both edges in axial direction and is related to axial FOV length, PET overlap, detector ring size, and scintillator length. Typically, smaller detector rings with larger axial FOV lead to higher sensitivity scanners, and a PET overlap of 50% maintains a near uniform sensitivity at peak level. Compared to the prior cPET, the dPET system reduced the axial FOV length from 180 mm to 164 mm, the PET acquisition overlap from 53% to 39%, and the number of crystals by about 20% which in overall led to a reduced NEMA sensitivity from 7.3 (cPET) to 5.7 cps/kBq (dPET). The question to be asked is why reducing the system sensitivity by ~ 22% does not interfere with lesion detection but conversely has enabled improved image quality and lesion detectability of the dPET. This observation is consistent to the reduction of sensitivity resulting from a sparse-ring configuration [54]. From the sensitivity point of view, NEMA sensitivity measures only a system’s ability to convert photons to raw counts and does not take into account the quality of counts, and its reduction leads to fewer counts in quantity instead of quality. In another words, obtaining high-quality counts is more important than obtaining more lower-quality counts with a higher uncertainty, such as that the PSF resolution recovery curve of PMT systems tend to show long tails caused by ‘bad’ counts. For the dPET system, the SNR gain [55] from improved TOF timing resolution more than compensates for the somewhat reduced system sensitivity, and compared to non-TOF it translates NEMA sensitivity into an “effective sensitivity” improvement which contributes to ‘good’ counts instead of ‘more’ counts, as follows
where Seff is the activity-dependent effective sensitivity, SNEMA is the NEMA sensitivity, and GTOF is the TOF gain defined as the object diameter (D) divided by the TOF localization uncertainty with c the speed of light and ∆t the timing resolution, and fd the dead time correction factor. The 322 ps dPET system presented an effective sensitivity with a gain of 4.1 for thin body size or brain PET (20 cm diameter), 6.2 for average body size (30 cm), and 8.3 for large body size (40 cm) acquisitions, which contribute to better images of high-quality counts, although the NEMA sensitivity is lower. An example of effective sensitivity comparing dPET with cPET is shown in Fig. 11. A potential advantage of the dPET system which may generate good image quality under low sensitivity
Image noise is usually characterized by NECR which is proportional to SNR and frequently used to compare the performance between different PET systems. In this study, even though it is not clear whether or not the measured maximum NECR of 171 kcps at 50.5 kBq/mL is the peak NECR, it seems that the plateau appears around this level. In addition, the dPET system with the introduced 1:1 coupling and vastly increased number of signal processing units allows it to handle far more counts per unit time than traditional PMT systems, which technically translates to a much higher peak true count rate. Despite using higher than usual 18F activity of ~ 1100 MBq for the NEMA count loss test, the testing failed to disclose the peak true count rate and its peak activity concentration of the dPET system. In our recent NEMA test using > 3000 MBq 18F (> 80 mCi, ongoing different project and not included in this work), the system peak true count rate appears to be close to 900 kcps at ~ 85 kBq/mL. This ultra-wide dynamic range of count rates can hopefully provide significant benefits to high count rates acquisitions such as cardiac perfusion PET.
Some factors may contribute to the appearance of artifacts on the cPET compared to the dPET at high SBRs in Fig. 8c. First of all, it is difficult to visually identify the existing artifacts and deformation on the phantom cPET images if using a wider SUV window to display, while they become apparently visible when the window-level settings are calibrated on similar background levels (e.g., 0–5 SUV), as shown in Fig. 8c. Secondly, the NEMA NEC body phantom has a volume of ~ 10 l with a filled activity of ~ 185 MBq (~ 5 mCi) 18F-FDG. This leads to an activity concentration of ~ 18.5 kBq/mL, which is high for the phantom particularly resulting in high count rate spheres when increasing SBRs. It asks for a system with larger dynamic range of count rate performance capability (such as NECR, the plateau @~ 50.5 kBq/mL for the dPET compared to the peak @15.7 kBq/mL for the cPET). Third, the timing resolution is very robust for the dPET (Fig. 7a) however has a big degradation for cPET system as increasing activity concentrations [42]. As a result, a substantial difference of effective NECR, which takes into consideration the TOF gain and the dead time correction factor, was found between both systems with a quick drop for the cPET (~ 50% drop of effective NECR from @15.7 kBq/mL to @25 kBq/mL) compared to a continued rise for the dPET (~ 55% increase from @15.7 kBq/mL to @~ 50.5 kBq/mL). This may cause the changes of count rate behavior and count quality at the ~ 18.5 kBq/mL activity concentration level.
While the broader clinical assessment is beyond the scope of this paper, we found in intra-individual comparison consistently improved image quality, detection, and classification of small lesions. It demonstrated that higher definition reconstruction appears to be of major clinical relevance for improved lesion detectability and characterization of lesion heterogeneity without increasing diagnostic ambiguity. It is expected that both the clinical sensitivity and specificity will be improved by dPET.
Conclusions
This study evaluated system performance of a new generation, solid-state digital photon counting PET/CT representing the first such clinical system used for oncologic PET imaging. The system demonstrates excellent performance characteristics and stability over a 31-month monitoring period. Our findings reveal for the DPC PET clinical opportunities with improved image quality, lesion detectability and diagnostic confidence, and promising capabilities for performing faster and lower dose PET.
Acknowledgements
Philips provided the clinical digital photon counting system for the investigational clinical trials prior to the commercial release of the system as part of a joint Ohio Third Frontier grant ODSA TECH 09-028. Technical support and feedback are greatly acknowledged from Dr. Michael Miller (Philips) and Dr. Yanfei Mao (Philips). We greatly appreciate all the help and support from Dr. Katherine Binzel (WCIBMI) in daily PET QC performance, Dr. Michelle I. Knopp (WCIBMI) in the 10× dose reduction effort, Dr. Yu-Lung Hsieh (WCIBMI) in technical support, and Dr. Chadwick Wright (WCIBMI) for clinical case reviews.
Funding
This project was supported by the Ohio Third Frontier grants ODSA TECH 09-028 and ODSA TECH 13-060.
Availability of data and materials
All data generated or analyzed during this study are included in this published article.
Abbreviations
- APD
Avalanche photodiode
- cPET
Conventional PMT-based PET/CT
- CQIE
Center for Quantitative Imaging Excellence
- DCR
Dark count rate
- DOI
Depth-of-interaction
- DPC
Digital photon counting
- dPET
DPC PET/CT
- FWHM
Full width at half-maximum
- FWTM
Full width at tenth-maximum
- HD
High definition
- LYSO
Lutetiumyttrium oxyorthosilicate
- MOS
Metal oxide semiconductor
- NECR
Noise equivalent count rate
- NEMA
National Electrical Manufacturers Association
- OSU
The Ohio State University
- PMT
Photomultiplier tubes
- PVE
Partial volume effect
- QC
Quality check
- RC
Recovery coefficient
- SBR
Sphere-to-background ratio
- SD
Standard definition
- SiPM
Silicon photomultiplier
- SPAD
Single photon avalanche diode
- SUV
Standardized uptake value
- TOF
Time of flight
- UHD
Ultra-high definition
- WCIBMI
Wright Center of Innovation in Biomedical Imaging
Authors’ contributions
JZ made substantial contributions to the conception and design of the work, experimental performance, data processing, analysis and interpretation, and manuscript write up. He provided final approval of the version submitted for publication and has agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved. PM made substantial contribution to the conception and design of the clinical trial and the lead on the investigational study from the side of the manufacturer. He contributed to the review and editing of the manuscript. MVK made substantial contributions to the conception and design of the work, clinical image reviews, guidelines, and manuscript write up. He provided final approval of the version submitted for publication and has agreed to be accountable for all aspects of the work in ensuring that questions related to the accuracy or integrity of any part of the work are appropriately investigated and resolved.
Ethics approval and consent to participate
The study (NCT02283125) was approved by the institutional review board, and all subjects signed an informed consent.
Consent for publication
The study (NCT02283125) was approved by the institutional review board, and all subjects signed an informed consent.
Competing interests
The first and senior authors declare that they have no competing interests. PM is an employee of Philips and Director of Clinical Science. He was the Philips co-PI of the clinical trials performed.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Contributor Information
Jun Zhang, Email: zhang.538@osu.edu.
Piotr Maniawski, Email: piotr.maniawski@philips.com.
Michael V. Knopp, Phone: 614-293-9998, Email: knopp.16@osu.edu
References
- 1.Mirzoyan R, Laatiaoui M, Teshima M. Very high quantum efficiency PMTs with bialkali photo-cathode. Nucl Instrum Methods Phys Res. 2006;567:230–232. doi: 10.1016/j.nima.2006.05.094. [DOI] [Google Scholar]
- 2.Roncali E, Cherry SR. Application of silicon photomultipliers to positron emission tomography. Ann Biomed Eng. 2011;39(4):1358–1377. doi: 10.1007/s10439-011-0266-9. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 3.Daube-Witherspoon ME, Surti S, Perkins A, Kyba CCM, Wiener R, Werner ME, et al. The imaging performance of a LaBr3-based PET scanner. Phys Med Biol. 2010;55:45–64. doi: 10.1088/0031-9155/55/1/004. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 4.Peng Q, Choong WS, Vu C, Huber JS, Janecek M, Wilson D, et al. Performance of the tachyon time-of-flight PET camera. IEEE Trans Nucl Sci. 2015;62(1):111–119. doi: 10.1109/TNS.2014.2375176. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 5.Son JW, Ko GB, Won JY, Yoon HS, Lee JS. Development and performance evaluation of a time-of-flight positron emission tomography detector based on a high-quantum-efficiency multi-anode photomultiplier tube. IEEE Trans Nucl Sci. 2016;63(1):44–51. doi: 10.1109/TNS.2015.2514118. [DOI] [Google Scholar]
- 6.Gasanov AG. Soviet technical. Physics Letters Sov. 1988;14:313. [Google Scholar]
- 7.Bondarenko G, Buzhan P, Dolgoshein B, Smirnov K. Limited Geiger mode microcell photodiode: new results. Nucl Inst Methods. 2000;A442:187–192. doi: 10.1016/S0168-9002(99)01219-X. [DOI] [Google Scholar]
- 8.Golovin V, Saveliev V. Novel type of avalanche photodetector with Geiger mode operation. Nucl Inst Methods. 2004;A518:560–564. doi: 10.1016/j.nima.2003.11.085. [DOI] [Google Scholar]
- 9.Catana C, Wu Y, Judenhofer MS, Qi J, Pichler BJ, Cherry SR. Simultaneous acquisition of multislice PET and MR images: initial results with a MR-compatible PET scanner. J Nucl Med. 2006;47:1968–1976. [PubMed] [Google Scholar]
- 10.Herbert DJ, Moehrs S, D’Ascenzo N, Belcari N, Del Guerra A, Morsani F. The silicon photomultiplier for application to high-resolution positron emission tomography. Nucl Instrum Methods Phys Res. 2007;A573:84–87. doi: 10.1016/j.nima.2006.11.020. [DOI] [Google Scholar]
- 11.Britvitch I, Johnson I, Renker D, Stoykov A, Lorenz E. Characterization of Geiger-mode avalanche photodiodes for medical imaging applications. Nucl Instrum Methods Phys. Res. 2007;A571:308–311. doi: 10.1016/j.nima.2006.10.089. [DOI] [Google Scholar]
- 12.McElroy DP, Saveliev V, Reznik A, Rowlands LA. Evaluation of silicon photomultipliers: a promising new detector for MR compatible PET. Nucl Instrum Methods Phys Res. 2007;A571:106–109. doi: 10.1016/j.nima.2006.10.040. [DOI] [Google Scholar]
- 13.Musienko Y, Auffray E, Lecoq P, Reucroft S, Swain J, Trummer J. Study of multi-pixelbecame avalanche photodiodes as a read-out for PET. Nucl Instrum Methods Phys Res. 2007;A571:362–365. doi: 10.1016/j.nima.2006.10.109. [DOI] [Google Scholar]
- 14.Renker D. New trends in photodetectors. Nucl Instrum Methods Phys Res. 2007;A71:1–6. doi: 10.1016/j.nima.2006.10.016. [DOI] [Google Scholar]
- 15.Lewellen TK. Recent developments in PET detector technology. Phys Med Biol. 2008;53(17):287–17. doi: 10.1088/0031-9155/53/17/R01. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 16.Delso G, Furst S, Jakoby B, Ladebeck R, Ganter C, Nekolla SG, et al. Performance measurements of the Siemens mMR integrated whole-body PET/MR scanner. J Nucl Med. 2011;52(12):1914–1922. doi: 10.2967/jnumed.111.092726. [DOI] [PubMed] [Google Scholar]
- 17.Th F, Prescher G, Degenhardt G, Gruyter R, Schmitz A, Ballizany R. The digital silicon photomultiplier – principle of operation and intrinsic detector performance. Nuclear Science Symposium Conference Record. 2009. pp. N28–N25. [Google Scholar]
- 18.Nguyen NC, Vercher-Conejero JL, Sattar A, Miller MA, Maniawski PJ, Jordan DW, et al. Image quality and diagnostic performance of a digital PET prototype in patients with oncologic diseases: initial experience and comparison with analog PET. J Nucl Med. 2015;56(9):1378–1385. doi: 10.2967/jnumed.114.148338. [DOI] [PubMed] [Google Scholar]
- 19.Degenhardt C, Zwaans B, Frach T, Gruyter R. Arrays of digital silicon photomultipliers - intrinsic performance and application to scintillator readout. Nuclear science symposium conference record (NSS/MIC). 2010. IEEE. 10.1109/NSSMIC.2010.5874115.
- 20.Schaart DR, Charbon E, Frach T, Schulz V. Advances in digital SiPMs and their application in biomedical imaging. Nucl Inst Methods Phys Res A. 2016;809:31–52. doi: 10.1016/j.nima.2015.10.078. [DOI] [Google Scholar]
- 21.Zhang J, Miller M, Knopp MV. Performance evaluation of digital PET/CT: medical physics basis for the clinical applications. Med Phys. 2016;43(6):3399. [Google Scholar]
- 22.Wang W, Hu Z, Gualtieri EE, Parma MJ, Walsh ES, Sebok D, et al. Systematic and distributed time-of-flight list-mode PET reconstruction. Proc Nuclear Science Symp Conf Rec. 2006;3:1715–1717. [Google Scholar]
- 23.Popescu LM, Lewitt RM. Ray tracing through a grid of blobs. 2004. IEEE. 10.1109/NSSMIC.2004.1466750.
- 24.Ye J, Song X, Hu Z. Scatter correction with combined single-scatter simulation and Monte Carlo simulation for 3D PET. 2014. IEEE. 10.1109/NSSMIC.2014.7431033.
- 25.Casey ME, Hoffman EJ. Quantitation in positron emission computed tomography. A technique to reduce noise in accidental coincidence measurements and coincidence efficiency calibration. J Comput Assist Tomogr. 1986;10:845–850. doi: 10.1097/00004728-198609000-00027. [DOI] [PubMed] [Google Scholar]
- 26.Richardson WH. Bayesian-based iterative method of image restoration. J Opt Soc Am. 1972;62:55–59. doi: 10.1364/JOSA.62.000055. [DOI] [Google Scholar]
- 27.Lucy LB. An iterative technique for the rectification of observed distributions. Astron J. 1974;79:745–765. doi: 10.1086/111605. [DOI] [Google Scholar]
- 28.Zhang B, Olivier P, Lorman B, Tung C. PET image resolution recovery using PSF-based ML-EM deconvolution with blob-based list-mode TOF reconstruction. J Nucl Med. 2011;52(Supplement 1):266. [Google Scholar]
- 29.National Electrical Manufacturers Association. NEMA NU 2-2012: Performance Measurements of Positron Emission Tomographs (PETs). Rosslyn: National Electrical Manufacturers Association; 2013.
- 30.Matej S, Lewitt RM. 3D-FRP: direct Fourier reconstruction with Fourier reprojection for fully 3-D PET. IEEE Trans Nucl Sci. 2001;48(4):1378–1385. doi: 10.1109/23.958359. [DOI] [Google Scholar]
- 31.Saha Gopal B. Basics of PET Imaging. New York, NY: Springer New York; 2010. Performance Characteristics of PET Scanners; pp. 97–116. [Google Scholar]
- 32.Bailey DL, Jones T, Spinks TS. A method for measuring the absolute sensitivity of positron emission tomographic scanners. Eur J Nucl Med. 1991;18:374–379. doi: 10.1007/BF02258426. [DOI] [PubMed] [Google Scholar]
- 33.National Electrical Manufacturers Association. NEMA NU 2-2018: Performance Measurements of Positron Emission Tomographs (PET). Rosslyn: National Electrical Manufacturers Association; 2018.
- 34.Mao Y, Miller M, Bai C, et al. Evaluation of a TOF resolution measurement method using standard NEMA NEC phantom. J Nucl Med. 2017;58(supplement 1):436. [Google Scholar]
- 35.Wang GC, Li X, Niu X, Du H, Balakrishnan K, Ye H, et al. PET timing performance measurement method using NEMA NEC phantom. IEEE Trans Nucl Sci. 2016;63(3):1335–1342. doi: 10.1109/TNS.2016.2522766. [DOI] [Google Scholar]
- 36.Rosen M, Kinahan PE, Gimpel JF, Opanowski A, Siegel BA, Hill GC, et al. Performance observations of scanner qualification of NCI-designated cancer centers: results from the centers of quantitative imaging excellence (CQIE) program. Acad Radiol. 2017;24(2):232–245. doi: 10.1016/j.acra.2016.09.025. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 37.MacFarlane CR. American College of Radiologists. ACR accreditation of nuclear medicine and PET imaging departments. J Nucl Med Technol. 2006;34(1):18–24. [PubMed] [Google Scholar]
- 38.Koopman D, Koerkamp MG, Jager PL, Arkies H, Knollema S, Slump CH, et al. Digital PET compliance to EARL accreditation specifications. EJNMMI Phys. 2017;4:9. doi: 10.1186/s40658-017-0176-5. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 39.Wright Chadwick L., Binzel Katherine, Zhang Jun, Knopp Michael V. Advanced Functional Tumor Imaging and Precision Nuclear Medicine Enabled by Digital PET Technologies. Contrast Media & Molecular Imaging. 2017;2017:1–7. doi: 10.1155/2017/5260305. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 40.Karp JS, Surti S, Daube-Witherspoon ME, Muehllehner G. The benefit of time-of-flight in PET imaging: experimental and clinical results. J Nucl Med. 2008;49(3):462–470. doi: 10.2967/jnumed.107.044834. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 41.Conti M. Focus on time-of-flight PET: the benefits of improved time resolution. Eur J Nucl Med Mol Imaging. 2011;38(6):1147–1157. doi: 10.1007/s00259-010-1711-y. [DOI] [PubMed] [Google Scholar]
- 42.Surti S, Kuhn A, Werner ME, Perkins AE, Kolthammer J, Karp JS. Performance of Philips Gemini TF PET/CT scanner with special consideration for its time-of-flight imaging capabilities. J Nucl Med. 2007;48(3):471–480. [PubMed] [Google Scholar]
- 43.Bettinardi V, Presotto L, Rapisarda E, Picchio M, Gianolli L, Gilardi MC. Physical performance of the new hybrid PET/CT Discovery-690. Med Phys. 2011;38:5394–5311. doi: 10.1118/1.3635220. [DOI] [PubMed] [Google Scholar]
- 44.Kolthammer JA, Su KH, Grover A, Narayanan M, Jordan DW, Muzic RF. Performance evaluation of the ingenuity TF PET/CT scanner with a focus on high count-rate conditions. Phys Med Biol. 2014;59(14):3843–3859. doi: 10.1088/0031-9155/59/14/3843. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 45.Rausch I, Cal-González J, Dapra D, Gallowitsch HJ, Lind P, Beyer T, et al. Performance evaluation of the biograph mCT flow PET/CT system according to the NEMA NU2-2012 standard. EJNMMI Phys. 2015;2:26. doi: 10.1186/s40658-015-0132-1. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 46.Jakoby BW, Bercier Y, Conti M, Casey ME, Bendriem B, Townsend DW. Physical and clinical performance of the mCT time-of-flight PET/CT scanner. Phys Med Biol. 2011;56(8):2375. doi: 10.1088/0031-9155/56/8/004. [DOI] [PubMed] [Google Scholar]
- 47.Karlberg AM, Sæther O, Eikenes L, Goa PE. Quantitative comparison of PET performance—Siemens biograph mCT and mMR. Eur J Nucl Med Mol Imaging Phys. 2016;3:5. doi: 10.1186/s40658-016-0142-7. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 48.Burr KC, Wang G-CJ, Du H, Mann G, Balakrishnan K, Wang J, et al. A new modular and scalable detector for a time-of-flight PET scanner. IEEE Nuclear Science Symposium and Medical Imaging Conference (NSS/MIC) 2012. pp. 2830–2834. [Google Scholar]
- 49.Vandenberghe S, Mikhaylova E, D’Hoe E, Mollet P, Karp JS. Recent developments in time-of-flight PET. EJNMMI Physics. 2016;3:3. doi: 10.1186/s40658-016-0138-3. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 50.Canon medical systems USA. https://us.medical.canon/products/computed-tomography/celesteion/. Accessed 19 Oct 2018.
- 51.Hsu DFC, Ilan E, Peterson WT, Uribe J, Lubberink M, Levin CS. Studies of a next generation silicon-photomultiplier-based time-of-flight PET/CT system. J Nucl Med. 2017;58(9):1511–1518. doi: 10.2967/jnumed.117.189514. [DOI] [PubMed] [Google Scholar]
- 52.Huesman RH. The effects of a finite number of projection angles and finite lateral sampling of projections on the propagation of statistical errors in transverse section reconstruction. Phys Med Biol. 1977;22:511. doi: 10.1088/0031-9155/22/3/012. [DOI] [PubMed] [Google Scholar]
- 53.Moses WW. Fundamental limits of spatial resolution in PET. Nucl Inst Methods Phys Res A. 2011;648:S236–S240. doi: 10.1016/j.nima.2010.11.092. [DOI] [PMC free article] [PubMed] [Google Scholar]
- 54.Zhang J, Knopp MI, Knopp MV. Sparse detector configuration in SiPM digital photon counting PET: a feasibility study. Mol Imaging Biol. 2018. 10.1007/s11307-018-1250-7. [DOI] [PubMed]
- 55.Budinger TF. Time-of-flight positron emission tomography: status relative to conventional PET. J Nucl Med. 1983;24(1):73–78. [PubMed] [Google Scholar]
Associated Data
This section collects any data citations, data availability statements, or supplementary materials included in this article.
Data Availability Statement
All data generated or analyzed during this study are included in this published article.